How to create a Together AI API key to use in Ozeki AI Gateway

This guide demonstrates how to create a Together AI API key and configure it in Ozeki AI Gateway. You'll learn how to access the Together AI platform, generate a new API key, and set up Together AI as a provider in your gateway. By following these steps, you can connect your Ozeki AI Gateway to Together AI's platform and access a wide variety of open-source language models with flexible deployment options. 

API URL: https://api.together.xyz/v1/
Example API Key: tgp_v1_abcde...
Default model: google/gemma-2-27b-it

What is a Together AI API key?

A Together AI API key is a unique authentication credential that allows applications to access AI models through the Together AI platform. Together AI provides access to numerous open-source language models with fast inference and competitive pricing. When configuring Together AI as a provider in Ozeki AI Gateway, you need this API key to establish the connection between your gateway and the AI services.

Overview
Overview

Steps to follow

  1. Open Together AI website
  2. Go to Manage API Keys
  3. Create new API key
  4. Copy API key
  5. Open Providers page in Ozeki AI Gateway
  6. Create provider

How to create a Together AI API key video

The following video shows how to create a Together AI API key and configure it in Ozeki AI Gateway step-by-step. The video covers accessing the platform, generating credentials, and setting up the provider in your gateway.

Step 0 - Install Ozeki AI Gateway

Before configuring Together AI as a provider, ensure Ozeki AI Gateway is installed and running on your system. If you haven't installed Ozeki AI Gateway yet, follow our Installation on Linux guide or Installation on Windows guide to complete the initial setup.

Step 1 - Open Together AI website

Open your web browser and navigate to Together AI. Sign in with your account credentials or create a new account if needed. The platform provides access to AI services, API management, and model selection (Figure 1).

Open Together AI website
Figure 1 - Open Together AI website

Step 2 - Go to Manage API Keys

Navigate to the API Keys management section by clicking "Manage API Keys", this is the interface where you can create and manage your authentication credentials (Figure 2).

Go to Manage API Keys
Figure 2 - Go to Manage API Keys

Step 3 - Create new API key

On the API Keys page, click the "Create or add new key" button to begin the API key creation process. This initiates the key generation workflow where you'll configure the settings for your new authentication credential (Figure 3).

Create new API key
Figure 3 - Create new API key

Enter a descriptive name for your API key, such as "Ozeki AI Gateway". Review the configuration settings and click the "Create Key" button to generate your authentication credential (Figure 4).

Enter name and create key
Figure 4 - Enter name and create key

Step 4 - Copy API key

After generation, the platform displays the complete API key value. Click the copy button to transfer it to your clipboard. Store this key securely as it provides access to Together AI services and models (Figure 5).

The API key is only shown once during creation. Make sure to copy and securely store the key before closing this window.

Copy API key
Figure 5 - Copy API key

Step 5 - Open Providers page in Ozeki AI Gateway

Open the Ozeki AI Gateway web interface and navigate to the Providers page. The Providers page displays all configured AI model connections and allows you to add new providers (Figure 6).

Open Providers page
Figure 6 - Open Providers page in Ozeki AI Gateway

Step 6 - Create provider

Click the "New" button on the AI Service Providers page to begin creating a provider configuration. This opens a form where you'll specify the connection details (Figure 7).

Add new provider
Figure 7 - Click add new provider button

Fill in the configuration form with your connection information. Enter the provider name, select "OpenAI compatible" as the type, paste the endpoint URL (https://api.together.xyz/v1/), and add your API key. Select your preferred model from the dropdown list. Click "Create" to save the configuration (Figure 8). 

https://api.together.xyz/v1/

Enter details and create provider
Figure 8 - Enter provider details and create

After successful creation, the provider is added to Ozeki AI Gateway. The provider now appears in the list, confirming that your gateway can route requests to Together AI services. You can now create routes that allow users to access Together AI's diverse selection of open-source models through your gateway (Figure 9).

Provider created
Figure 9 - Provider created successfully

Final thoughts

You have successfully created a Together AI API key and configured it as a provider in Ozeki AI Gateway. Your gateway can now communicate with the platform and access a wide variety of open-source language models. This setup allows you to manage access for multiple users and applications from a centralized point while leveraging Together AI's extensive model catalog.

More information