Learn how to handle ignored instructions and ensure that your AI models follow your instructions
gpt-4o
model to generate a response to for a simple prompt. We’ll enable the instruction_adherence
metric to monitor the model’s adherence to the prompt.
To calculate metrics, you will need to configure an integration with an LLM. Visit the relevant API platform to obtain an API key, then add it using the integrations page in the Galileo Console.
The instruction provided was to 'Explain the following topic succinctly: Newton's first law'. The response begins by defining Newton's First Law and provides a clear explanation of the concept of inertia. However, the response is lengthy and provides more detail than the word 'succinctly' implies. While it does effectively cover the essence of the topic, it could be more concise to align better with the instruction. Thus, while informative, the response does not fully adhere to the request for a succinct explanation.