Features for AI

The Rate Limit AI Tokens interceptor can be used in API flows that consume Large Language Models (LLMs) to control the consumption of tokens by AI applications.

Find out more by checking out the corresponding documentation.

Ideal for systems that need to integrate chatbots or other AI-based language interactions, the OpenAI Chat Completions API enables chat interactions with OpenAI LLMs with a high level of customization and control over the model’s behavior. As a way of helping to structure and monitor requests and responses, it includes some interceptors already configured in its flow.

Learn how to use it.