Opik

Opik is an open-source platform designed for evaluating, testing, and monitoring large language model (LLM) applications. Developed by Comet, it aims to facilitate more intuitive collaboration, testing, and monitoring of LLM-based applications.

You can configure SkillFlaw to collect tracing data about your flow executions and automatically send the data to Opik.

Prerequisites

• An Open-Source Opik server or an Opik Cloud account
• A running SkillFlaw server with a flow that you want to trace

tip

If you need a flow to test the Opik integration, see the SkillFlaw quickstart.

Integrate Opik with SkillFlaw

1. If you use Opik Cloud, get an Opik API key.

   An API key isn't required with an Open-Source Opik server.

2. Call the opik configure CLI to save your Opik configuration in the same environment where you run SkillFlaw:

   
   

   _10

   opik configure

   
   

   For self-hosted Opik, you can also use the following Opik CLI command:

   
   

   _10

   opik configure --use_local

   
   

   For more information, see the Opik SDK configuration documentation.

3. Start SkillFlaw in the same terminal or environment where you set the environment variables:

   
   

   _10

   uv run skillflaw run

   
   

4. In SkillFlaw, run a flow to produce activity for Opik to trace.

5. Navigate to your Opik project dashboard and view the collected tracing data.

Disable the Opik integration

To disable the Opik integration, remove the environment variables you set with opik configure, and then restart SkillFlaw.