> ## Documentation Index
> Fetch the complete documentation index at: https://docs.ailunapro.com/llms.txt
> Use this file to discover all available pages before exploring further.

# LLM

> Voice Agents use LLM (Large Language Models), which are trained to understand the conversational context, and respond to users.

Voice AiLunaPro supports OpenAI, Google AI Studio, Google Vertex AI, Azure OpenAI, AWS Bedrock, Groq, Hopper, OpenRouter, Hugging Face, MiniMax, Sarvam, and AiLunaPro-managed LLMs. There are some models provided by default for you to choose from the drop down.

<Warning>
  LLM providers receive the data needed to generate responses, such as prompts, conversation history, model settings, and any configured tool/function definitions or tool call context. Review the provider's data processing, retention, model training, and regional hosting policies before using sensitive data.
</Warning>

For locally deployed or self-hosted LLMs, AiLunaPro also supports OpenAI-compatible endpoints such as Ollama and vLLM.

<img src="https://mintcdn.com/ail-una-pro/g84ypLKtMs2iJE96/images/models_dropdown.png?fit=max&auto=format&n=g84ypLKtMs2iJE96&q=85&s=f652287a9c071be2429bc126ec7fd15e" alt="Select Models from DropDown" width="2400" height="1500" data-path="images/models_dropdown.png" />

If you don't find a model in the drop-down, tick **Enter Custom Value** and type the model name.

<img src="https://mintcdn.com/ail-una-pro/g84ypLKtMs2iJE96/images/add_model_manually.png?fit=max&auto=format&n=g84ypLKtMs2iJE96&q=85&s=9839ad68f2de0d731139e6c96f14c0de" alt="Select Models from DropDown" width="2400" height="1500" data-path="images/add_model_manually.png" />

## OpenRouter provider routing

By default OpenRouter spreads requests across every provider that serves a model, weighted toward the cheapest. For voice agents that can add noticeable latency, because each turn may land on a slower provider.

Use **Provider order** to list the OpenRouter provider slugs to try first, in order, one slug per entry (for example, `groq`). The slugs are shown on each model's page on OpenRouter. If none of the listed providers is available, OpenRouter falls back to its other providers, so calls keep working.


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.