SDK Integration

We offer Typescript and Python SDKs that act as wrappers for OpenAI's API. We are actively working on adding more providers.

Libretto does not slow down or interrupt your calls to the LLM provider. Instead, we pass-through your calls and asynchronously call our own services to store the data.

Our SDK uses your own provider API and a Libretto API key. In addition to the options offered by the providers, we offer the option to associate your LLM calls with a given prompt template, and to redact personal information (PII). You can also use the feedback feature of the SDKs to send user responses to a given LLM response.

These calls and feedback responses can be viewed in the Monitoring dashboard