Use OpenAI or Anthropic without a provider account
Use credits when you want the fastest path to OpenAI or Anthropic. The gateway supplies upstream credentials and bills model usage through your credit balance. Start here: Use ngrok.ai inference.Bring your own provider key
Bring your own key when you want upstream usage billed to your provider account, need a provider that requires your own credentials, or want to use your own OpenAI or Anthropic account. Start here: Bring your own provider key.Use a model you run yourself
Use a custom provider when your model runs on your machine, private network, cloud GPU, or another OpenAI- or Anthropic-compatible endpoint outside the built-in catalog. Start here: Use a model you run yourself.Make the provider usable from a request
Adding a provider or provider key doesn’t route traffic by itself. A working request needs:- A provider: built-in or custom.
- A credential source: credits or a provider key, when required.
- An access key configuration that allows the provider and model.
- An access key assigned to that configuration.
- A request with a matching
modelorprovider:model.
Next steps
- Choose a model: Use model IDs in requests
- Access key configurations: Scope access and choose credentials
- Model catalog: Check providers, models, aliases, and key requirements