Groq Provider Setup: Auth, Model Selection, and Whisper Transcription
Learn how to configure the Groq provider in your gateway, including API key setup, model selection, and Whisper audio transcription. This guide is for developers integrating Groq's fast LPU-based inference.
Read this when
- You want to use Groq with OpenClaw
- You need the API key env var or CLI auth choice
- You are configuring Whisper audio transcription on Groq
Groq delivers extremely fast inference across open-weight models (Llama, Gemma, Kimi, Qwen, GPT OSS, and others) by relying on custom LPU hardware. Through the Groq plugin, two providers are registered: one chat provider compatible with OpenAI and one audio media-understanding provider.
| Property | Value |
|---|---|
| Provider id | groq |
| Plugin | official external package |
| Auth env var | GROQ_API_KEY |
| API | OpenAI-compatible (openai-completions) |
| Base URL | https://api.groq.com/openai/v1 |
| Audio transcription | whisper-large-v3-turbo (default) |
| Suggested chat default | groq/llama-3.3-70b-versatile |
Install plugin
After installing the official plugin, restart Gateway:
openclaw plugins install @openclaw/groq-provider
openclaw gateway restart
Getting started
Get an API key
Generate an API key at console.groq.com/keys.
Set the API key
export GROQ_API_KEY=gsk_...
Set a default model
{
agents: {
defaults: {
model: { primary: "groq/llama-3.3-70b-versatile" },
},
},
}
Verify the catalog is reachable
openclaw models list --provider groq
Config file example
{
env: { GROQ_API_KEY: "gsk_..." },
agents: {
defaults: {
model: { primary: "groq/llama-3.3-70b-versatile" },
},
},
}
Built-in catalog
OpenClaw includes a manifest-based Groq catalog containing both reasoning and non-reasoning models. Execute openclaw models list --provider groq to display the static entries for your current version, or visit console.groq.com/docs/models for Groq's full list.
| Model ref | Name | Reasoning | Input | Context |
|---|---|---|---|---|
groq/llama-3.3-70b-versatile | Llama 3.3 70B Versatile | no | text | 131,072 |
groq/llama-3.1-8b-instant | Llama 3.1 8B Instant | no | text | 131,072 |
groq/meta-llama/llama-4-scout-17b-16e-instruct | Llama 4 Scout 17B | no | text + image | 131,072 |
groq/openai/gpt-oss-120b | GPT OSS 120B | yes | text | 131,072 |
groq/openai/gpt-oss-20b | GPT OSS 20B | yes | text | 131,072 |
groq/openai/gpt-oss-safeguard-20b | Safety GPT OSS 20B | yes | text | 131,072 |
groq/qwen/qwen3-32b | Qwen3 32B | yes | text | 131,072 |
groq/groq/compound | Compound | yes | text | 131,072 |
groq/groq/compound-mini | Compound Mini | yes | text | 131,072 |
Tip
The catalog changes with each OpenClaw release. Use
openclaw models list --provider groqto see the rows recognized by your installed version; verify against console.groq.com/docs/models for models that are new or deprecated.
Reasoning models
For Groq reasoning models (marked with reasoning: true in the table), OpenClaw maps its shared /think levels to reasoning_effort values of low, medium, or high. When /think off or /think none is used, reasoning_effort is left out of the request entirely instead of being sent with a disabled value.
Refer to Thinking modes for the shared /think levels and how OpenClaw translates them for each provider.
Audio transcription
The Groq plugin also registers an audio media-understanding provider, so voice messages can be transcribed through the shared tools.media.audio interface.
| Property | Value |
|---|---|
| Shared config path | tools.media.audio |
| Default base URL | https://api.groq.com/openai/v1 |
| Default model | whisper-large-v3-turbo |
| Auto priority | 20 |
| API endpoint | OpenAI-compatible /audio/transcriptions |
To configure Groq as the default audio backend:
{
tools: {
media: {
audio: {
models: [{ provider: "groq" }],
},
},
},
}
Environment availability for the daemon
When Gateway runs as a managed service (launchd, systemd, Docker), GROQ_API_KEY must be accessible to that process, not only to your interactive shell.
Warning
A key exported solely in an interactive shell will not be available to a launchd or systemd daemon unless that environment is also imported there. Set the key in
~/.openclaw/.envor throughenv.shellEnvso the gateway process can read it.
Custom Groq model ids
OpenClaw accepts any Groq model identifier at runtime. Provide the exact id that Groq displays and prepend groq/. The static catalog handles the most frequent cases; ids not in the catalog fall back to the default OpenAI-compatible template.
{
agents: {
defaults: {
model: { primary: "groq/<your-model-id>" },
},
},
}
Related
- Model providers, Picking providers, model references, and how failover works.
- Thinking modes, Reasoning intensity levels and how they interact with provider policies.
- Configuration reference, Complete configuration schema, covering provider and audio options.
- Groq Console, The Groq dashboard, API documentation, and pricing information.