Skip to main content
OpenRouter is a unified API that provides access to hundreds of models from providers like Anthropic, Google, Meta, Mistral, and more through a single endpoint.
Even though OpenRouter is a built-in provider, it still requires you to bring your own key because ngrok.ai inference is not available for it at this time.

​
Setup

1

Create an access key

Follow the quickstart to create an access key in app.ngrok.ai.
2

Store your OpenRouter API key

Create an account at openrouter.ai and generate an API key from your dashboard. Then add a provider key.
3

Create a configuration

Create an access key configuration with an openrouter routing rule and allow OpenRouter in the access scope.
4

Assign and send requests

Assign the configuration to your access key and send requests with your access key:
from openai import OpenAI

client = OpenAI(
    base_url="https://gateway.ngrok.ai/v1",
    api_key="ng-xxxxx-g1-xxxxx",
)

response = client.chat.completions.create(
    model="openrouter:anthropic/claude-3.5-sonnet",
    messages=[{"role": "user", "content": "Hello!"}]
)

​
Model names

Always prefix OpenRouter model IDs with openrouter:. Without the prefix, the gateway may route to the native provider instead of OpenRouter.
OpenRouter uses a provider/model format for its model IDs. When calling through the ngrok AI Gateway, prefix with openrouter::
What you wantModel string to use
Anthropic Claude via OpenRouteropenrouter:anthropic/claude-3.5-sonnet
Google Gemini via OpenRouteropenrouter:google/gemini-2.0-flash-001
Meta Llama via OpenRouteropenrouter:meta-llama/llama-3.1-8b-instruct
Mistral via OpenRouteropenrouter:mistralai/mistral-7b-instruct
The openrouter: prefix tells the gateway to route to OpenRouter specifically, not to the native provider. Without it, anthropic/claude-3.5-sonnet would fail—the gateway doesn’t recognize the slash-separated format as a valid model without the provider prefix. For the full list of models OpenRouter supports, see openrouter.ai/models.

​
Available models

See the model catalog.

​
Next steps