How to create a Groq API key to use in Ozeki AI Gateway

This guide demonstrates how to create a Groq API key and configure it in Ozeki AI Gateway. You'll learn how to access the Groq console, generate a new API key, and set up Groq as a provider in your gateway. By following these steps, you can connect your Ozeki AI Gateway to Groq's ultra-fast AI inference platform powered by LPU technology. 

API URL: https://api.groq.com/openai/v1
Example API Key: gsk_abc123...
Default model: openai/gpt-oss-120b

What is a Groq API key?

A Groq API key is a unique authentication credential that allows applications to access AI models through the Groq inference platform. Groq specializes in ultra-fast AI inference using their proprietary Language Processing Unit (LPU) technology, delivering exceptional performance and low latency. When configuring Groq as a provider in Ozeki AI Gateway, you need this API key to establish the connection between your gateway and Groq's high-speed inference services.

Overview
Overview

Steps to follow

  1. Access Groq console
  2. Create API key
  3. Configure key settings
  4. Generate and copy key
  5. Open Providers page in Ozeki AI Gateway
  6. Create provider

How to create a Groq API key video

The following video shows how to create a Groq API key and configure it in Ozeki AI Gateway step-by-step. The video covers accessing the Groq console, generating credentials, and setting up the provider in your gateway.

Step 0 - Install Ozeki AI Gateway

Before configuring Groq as a provider, ensure Ozeki AI Gateway is installed and running on your system. If you haven't installed Ozeki AI Gateway yet, follow our Installation on Linux guide or Installation on Windows guide to complete the initial setup.

Step 1 - Access Groq console

Open your web browser and navigate to the Groq console. Sign in with your Groq account credentials. If you don't have a Groq account yet create a new account before proceeding. The Groq console provides access to API key management, usage statistics, and model selection (Figure 1).

Open Groq console
Figure 1 - Open Groq console

Step 2 - Create API key

In the Groq console, navigate to the API Keys section from the main dashboard. Click the "Create API Key" button to begin the key generation process. This opens a dialog where you can configure your new API key (Figure 2).

Begin API key creation
Figure 2 - Begin API key creation

Step 3 - Configure key settings

Enter a descriptive name for your API key, such as "Ozeki AI Gateway". You can also set an expiration date for the key or leave it without expiration for long-term use. A clear naming convention helps identify which keys are used by which applications or services (Figure 3).

Set key name and expiration
Figure 3 - Set key name and expiration

Step 4 - Generate and copy key

After configuring the key settings, click the "Submit" button to generate your API key. Groq will create the authentication credential and display it in the console (Figure 4).

Press submit to generate key
Figure 4 - Press submit to generate key

Once generated, Groq displays the complete API key value. Click the copy button to transfer it to your clipboard. Store this key securely as it provides access to your Groq account and available models (Figure 5).

The API key is only shown once during creation. Make sure to copy and securely store the key before closing this dialog.

Copy key
Figure 5 - Copy API key

Step 5 - Open Providers page in Ozeki AI Gateway

Open the Ozeki AI Gateway web interface and navigate to the Providers page. The Providers page displays all configured AI model connections and allows you to add new providers (Figure 6).

Open Providers page
Figure 6 - Open Providers page in Ozeki AI Gateway

Step 6 - Create provider

Click the "New" button on the Providers page to begin creating a provider configuration. This opens a form where you'll specify the connection details for Groq (Figure 7).

Add new provider
Figure 7 - Click add new provider button

Fill in the configuration form with your Groq information. Enter the provider name, select "OpenAI compatible" as the type, paste the endpoint URL (https://api.groq.com/openai/v1), and add your API key. Select your preferred model from the dropdown list, then click "Create" to save the configuration (Figure 8). 

https://api.groq.com/openai/v1

Enter details and create provider
Figure 8 - Enter Groq provider details and create

After clicking "Create", Groq is added to Ozeki AI Gateway. The provider now appears in the list, confirming that your gateway can route requests to Groq services. You can now create routes that allow users to access Groq's ultra-fast AI models through your gateway (Figure 9).

Provider created
Figure 9 - Groq provider created successfully

Final thoughts

You have successfully created a Groq API key and configured it as a provider in Ozeki AI Gateway. Your gateway can now communicate with Groq's inference platform and access various AI models. This setup allows you to manage Groq access for multiple users and applications from a centralized point while benefiting from Groq's industry-leading inference speeds.

More information