An overview of the Galileo SDKs
The Galileo SDKs provide a comprehensive set of tools for logging, evaluating, and experimenting with LLM applications. Regardless of how you go about logging your AI application, you will still need to install the Galileo SDK and initialize your API keys by following the steps below.
If you want to use the OpenAI wrapper in Python, you need to install with the optional OpenAI dependencies.
You need a Galileo API key set as an environment variable called GALILEO_API_KEY
. The Galileo SDK will automatically pick this up from the environment variable at run time.
You can also optionally set the following environment variables to define the project, Log stream, and console URL that Galileo should use.
Environment variable | Description |
---|---|
GALILEO_PROJECT | The Galileo project to log to. If this is not set, you will need to pass the project name in code. |
GALILEO_LOG_STREAM | The default Log stream to log to. If this is not set, you will need to pass the Log stream name in code. |
GALILEO_CONSOLE_URL | For custom Galileo deployments only, set this to the URL of your Galileo Console to log to. If this is not set, it will default to the hosted Galileo version at app.galileo.ai. |
If you are using the free version of Galileo, there is no need to set the GALILEO_CONSOLE_URL
environment variable.
When developing your application, you should use a .env
file. Create or update a .env
file with the following values as required:
You can then load the environment variables from this file:
For Python, you will need to install python-dotenv
if you haven’t already.
GALILEO_CONSOLE_URL
to your own installation.The Galileo SDKs allow you to log all prompts, responses, and statistics around your LLM usage. There are three main ways to log your application:
@log
decorator or log
wrapper, the Galileo SDK logs all AI prompts within.GalileoLogger
class - For more control over your logging, you can use the GalileoLogger
directly. This allows you to manually create sessions, start traces, and log spans. This can be mixed with the other methods, for example accessing the logger directly inside a decorated function call to manually add spans.Experiments are logged automatically when they are run, but you can use these same SDK concepts inside the code being run by your experiment for greater control and additional logging. This allows you to not only create distinct experiments, such as in notebooks, but to also add experiments to your production application code.
See our run experiments with code documentation for more details.
Learn how to run experiments with multiple data points using datasets and prompt templates
Log with full control over sessions, traces, and spans using the Galileo logger.
Quickly add logging to your code with the log decorator and wrapper.
Manage logging using the Galileo context manager.
Learn how to integrate and use OpenAI’s API with Galileo’s wrapper client.
Python
Learn how to use the Galileo @log decorator to log functions to traces
Python
Learn how to create log traces and spans manually in your AI apps
Python
The Galileo Python SDK reference.
The Galileo TypeScript SDK reference.