> ## Documentation Index
> Fetch the complete documentation index at: https://ngrok.com/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Groq

> Use Groq LPU-accelerated models through the ngrok AI Gateway.

[Groq](https://groq.com) provides high-speed inference for open-source models (Llama, Mixtral, and others) using their custom LPU hardware.

<Note>
  Even though Groq is a **built-in provider**, it still requires you to **bring your own key** because ngrok.ai inference is not available for it at this time.
</Note>

## Setup

<Steps>
  <Step title="Create an access key">
    Follow the [quickstart](/ai-gateway/quickstart) to create an access key in [app.ngrok.ai](https://app.ngrok.ai).
  </Step>

  <Step title="Store your Groq API key">
    Sign up at [console.groq.com](https://console.groq.com) and create an API key. Then [add a provider key](/ai-gateway/guides/attaching-provider-keys#add-a-provider-key).
  </Step>

  <Step title="Create a configuration">
    [Create an access key configuration](/ai-gateway/guides/access-key-configurations#create-a-configuration) with a `groq` routing rule and allow Groq in the access scope.
  </Step>

  <Step title="Assign and send requests">
    Assign the configuration to your access key and send requests with your access key:

    ```python theme={null}
    from openai import OpenAI

    client = OpenAI(
        base_url="https://gateway.ngrok.ai/v1",
        api_key="ng-xxxxx-g1-xxxxx",
    )

    response = client.chat.completions.create(
        model="meta-llama/llama-3.3-70b-versatile",
        messages=[{"role": "user", "content": "Hello!"}]
    )
    ```
  </Step>
</Steps>

## Available models

See the [model catalog](/ai-gateway/reference/model-catalog#groq).

## Next steps

* [Provider Keys](/ai-gateway/guides/attaching-provider-keys)
* [Access Key Configurations](/ai-gateway/guides/access-key-configurations)