AI Gateway Overview

Use popular AI models in your code, without needing to manage API keys or external accounts.

This feature is in Beta and is available on Credit-based plans only, including the Free, Personal, and Pro plans. If you are on an Enterprise plan and you’re interested, reach out to your Account Manager.

Overview

The AI Gateway service simplifies technical and operational concerns when using AI inference in your code, by removing the need to:

• Open an account with each provider you want to use.
• Maintain a separate credit balance with each provider.
• Copy the API key from each provider to your projects on Netlify.

How it works

By default, Netlify automatically sets the appropriate environment variables that AI client libraries typically use for configuration, in all Netlify compute contexts (e.g., Netlify Functions, Edge Functions, Preview Server, etc.).

These variables include:

• API keys for OpenAI, Anthropic, and Google Gemini.
• A custom base URL for each provider, to route requests via the AI Gateway service.

These variables are picked up by the official client libraries of these providers, so no extra configuration is necessary. Alternatively, if you make AI calls via a provider’s REST API, these values are easy to incorporate in your code.

When receiving a request from a client, the AI Gateway makes the call to the AI provider on your behalf. Then, it bills your Netlify account by converting the actual token usage in the request into credits, using your existing credit quota.

The AI Gateway does not store your prompts or model outputs. Learn more about Security and Privacy for AI features.

To opt-out of the AI Gateway, see Using the AI Gateway below.

Support in web frameworks

When you develop server-side code with any web framework supported by Netlify (e.g., Astro; Tanstack Start; Next.js, Gatsby, Nuxt, etc.), your code is packaged in Netlify Functions and Edge Functions under the hood, as part of the build process.

Therefore, the above environment variables are available as when explicitly using Netlify compute primitives, without any further settings required.

Using the AI Gateway

For a quickstart, check out our Quickstart for AI Gateway.

The AI Gateway is available by default in all credit-based plans, unless:

1. Netlify AI Features are turned off in your team settings.
2. The environment variable AI_GATEWAY_INJECTION is set to false for a project or team.
3. If you have API keys set via environment variables for any of the AI providers supported by the gateway (OpenAI, Anthropic, Google Gemini), these are not replaced - Netlify does not override usage of your own keys. You can set your own keys, or remove these, at any point.

For full information on which environment variables are automatically set, and how to control this behavior, see here.

Using official client libraries

If you’re using any of the following libraries, no configuration is required:

1. OpenAI TypeScript and JavaScript API Library
2. Anthropic TypeScript API Library (for Claude models)
3. Google Gen AI SDK for TypeScript and JavaScript (for Google Gemini models)

Using official REST APIs

Anthropic Claude

// Anthropic Claude API
const ANTHROPIC_API_KEY = process.env.ANTHROPIC_API_KEY;
const ANTHROPIC_BASE_URL = process.env.ANTHROPIC_BASE_URL;

async function callAnthropic() {
  const response = await fetch(`${ANTHROPIC_BASE_URL}/v1/messages`, {
    method: 'POST',
    headers: {
      'Content-Type': 'application/json',
      'x-api-key': ANTHROPIC_API_KEY,
      'anthropic-version': '2023-06-01'
    },
    body: JSON.stringify({
      model: 'claude-sonnet-4-5-20250929',
      max_tokens: 1024,
      messages: [{ role: 'user', content: 'Hello!' }]
    })
  });
  return await response.json();
}

OpenAI

// OpenAI API
const OPENAI_API_KEY = process.env.OPENAI_API_KEY;
const OPENAI_BASE_URL = process.env.OPENAI_BASE_URL;

async function callOpenAI() {
  const response = await fetch(`${OPENAI_BASE_URL}/v1/chat/completions`, {
    method: 'POST',
    headers: {
      'Content-Type': 'application/json',
      'Authorization': `Bearer ${OPENAI_API_KEY}`
    },
    body: JSON.stringify({
      model: 'gpt-5',
      messages: [{ role: 'user', content: 'Hello!' }]
    })
  });
  return await response.json();
}

Google Gemini

// Google Gemini API
const GEMINI_API_KEY = process.env.GEMINI_API_KEY;
const GEMINI_BASE_URL = process.env.GOOGLE_GEMINI_BASE_URL;

async function callGemini() {
  const response = await fetch(
    `${GEMINI_BASE_URL}/v1beta/models/gemini-2.5-pro:generateContent?key=${GEMINI_API_KEY}`,
    {
      method: 'POST',
      headers: {
        'Content-Type': 'application/json'
      },
      body: JSON.stringify({
        contents: [{
          parts: [{ text: 'Hello!' }]
        }]
      })
    }
  );
  return await response.json();
}

Using third-party client libraries

If you are using a client library that does not work out-of-the-box with the environment variables set for the AI Gateway, you need to manually pass the API key and base URL as arguments to the library.

This is similar to manually reading & passing variable values when using a provider’s REST API. See Using official REST APIs above for the relevant variable names.

Managing environment variables

If you have already set an API key or base URL at the project or team level, Netlify will never override it.

When a Netlify Function or Edge Function is initialized, the following environment variables are set to the appropriate values for the AI Gateway:

1. OPENAI_API_KEY and OPENAI_BASE_URL - unless any of these is already set by you at the project or team level.
2. ANTHROPIC_API_KEY and ANTHROPIC_BASE_URL - unless any of these is already set by you.
3. GEMINI_API_KEY and GOOGLE_GEMINI_BASE_URL- unless any of these is already set by you, or if either GOOGLE_API_KEY or GOOGLE_VERTEX_BASE_URL are set.

For each provider, the above check is done separately. Meaning, if you have only set OPENAI_API_KEY to your own API key, it will not be overridden (and neither would OPENAI_BASE_URL be set) - but the values for Anthropic and Google will be set.

AI_GATEWAY_API_KEY and AI_GATEWAY_BASE_URL environment variables are always injected into the AI Gateway-supported runtimes. If you want to mix different setups with your own keys and Netlify’s or you want to be explicit about using AI Gateway keys in your calls, use these env variables as they will never collide with other environment variables values.

Disabling automatic environment variables

To prevent any variables from being automatically set, you can:

1. Disable AI Features at the Team Settings level (this requires Team Owner permissions),
2. Or, create an environment variable named AI_GATEWAY_INJECTION and set its value to false. You can define this variable at either the project or the team level.

Model availability

The AI Gateway supports the following AI providers and models.

AI Provider	Model
OpenAI	gpt-5
OpenAI	gpt-5-codex
OpenAI	gpt-5-mini
OpenAI	gpt-5-nano
OpenAI	gpt-4.1
OpenAI	gpt-4.1-mini
OpenAI	gpt-4.1-nano
OpenAI	gpt-4o
OpenAI	gpt-4o-mini
OpenAI	o4-mini
OpenAI	o3
OpenAI	o3-mini
OpenAI	codex-mini-latest
Anthropic	claude-opus-4-1-20250805
Anthropic	claude-opus-4-20250514
Anthropic	claude-sonnet-4-5-20250929
Anthropic	claude-sonnet-4-20250514
Anthropic	claude-3-7-sonnet-20250219
Anthropic	claude-3-7-sonnet-latest
Anthropic	claude-3-5-haiku-20241022
Anthropic	claude-3-5-haiku-latest
Anthropic	claude-3-haiku-20240307
Google	gemini-2.5-pro
Google	gemini-flash-latest
Google	gemini-2.5-flash
Google	gemini-2.5-flash-preview-09-2025
Google	gemini-flash-lite-latest
Google	gemini-2.5-flash-lite
Google	gemini-2.5-flash-lite-preview-09-2025
Google	gemini-2.5-flash-image-preview
Google	gemini-2.0-flash
Google	gemini-2.0-flash-lite

You can also programatically access the up-to-date list in JSON format via a public API endpoint: https://api.netlify.com/api/v1/ai-gateway/providers.

Pricing

To understand pricing for AI Gateway, check out our Pricing for AI features docs.

Rate limits

The AI Gateway has two types of limits: Requests Per Minute (RPM) and Tokens Per Minute (TPM). Limits are per model and differ by your account plan.

The rate limit is scoped to your account. Meaning, requests made and tokens used for any project in your account are counted together towards your limits.

Enterprise customers have extended limits - contact your Account Manager to learn more.

Requests per minute (RPM)

AI Provider	Model	Free plan	Personal plan	Pro plan
OpenAI	gpt-5	6	30	60
OpenAI	gpt-5-codex	6	30	60
OpenAI	gpt-5-mini	10	50	80
OpenAI	gpt-5-nano	50	100	150
OpenAI	gpt-4.1	6	30	60
OpenAI	gpt-4.1-mini	10	50	80
OpenAI	gpt-4.1-nano	50	100	150
OpenAI	gpt-4o	6	30	60
OpenAI	gpt-4o-mini	50	100	150
OpenAI	o4-mini	6	30	60
OpenAI	o3	3	6	20
OpenAI	o3-mini	6	30	60
OpenAI	codex-mini-latest	6	30	60
Anthropic	claude-opus-4-1-20250805	3	6	20
Anthropic	claude-opus-4-20250514	3	6	20
Anthropic	claude-sonnet-4-5-20250929	6	30	60
Anthropic	claude-sonnet-4-20250514	6	30	60
Anthropic	claude-3-7-sonnet-20250219	6	30	60
Anthropic	claude-3-7-sonnet-latest	6	30	60
Anthropic	claude-3-5-haiku-20241022	10	50	80
Anthropic	claude-3-5-haiku-latest	10	50	80
Anthropic	claude-3-haiku-20240307	50	100	150
Google	gemini-2.5-pro	6	30	60
Google	gemini-flash-latest	10	50	80
Google	gemini-2.5-flash	10	50	80
Google	gemini-2.5-flash-preview-09-2025	10	50	80
Google	gemini-flash-lite-latest	50	100	150
Google	gemini-2.5-flash-lite	50	100	150
Google	gemini-2.5-flash-lite-preview-09-2025	50	100	150
Google	gemini-2.0-flash	50	100	150
Google	gemini-2.0-flash-lite	50	100	150
Google	gemini-2.5-flash-image-preview	3	6	20

Tokens per minute (TPM)

For TPM, both input and output tokens are counted towards the limit.

However, cached input tokens are excluded for Anthropic models, and included for other providers.

AI Provider	Model	Free plan	Personal plan	Pro plan
OpenAI	gpt-5	18,000	90,000	180,000
OpenAI	gpt-5-codex	18,000	90,000	180,000
OpenAI	gpt-5-mini	60,000	300,000	480,000
OpenAI	gpt-5-nano	300,000	600,000	900,000
OpenAI	gpt-4.1	18,000	90,000	180,000
OpenAI	gpt-4.1-mini	50,000	250,000	400,000
OpenAI	gpt-4.1-nano	250,000	500,000	750,000
OpenAI	gpt-4o	18,000	90,000	180,000
OpenAI	gpt-4o-mini	250,000	500,000	750,000
OpenAI	o4-mini	30,000	150,000	300,000
OpenAI	o3	90,000	180,000	600,000
OpenAI	o3-mini	30,000	150,000	300,000
OpenAI	codex-mini-latest	30,000	150,000	300,000
Anthropic	claude-opus-4-1-20250805	1,800	3,600	12,000
Anthropic	claude-opus-4-20250514	1,800	3,600	12,000
Anthropic	claude-sonnet-4-5-20250929	18,000	90,000	180,000
Anthropic	claude-sonnet-4-20250514	18,000	90,000	180,000
Anthropic	claude-3-7-sonnet-20250219	18,000	90,000	180,000
Anthropic	claude-3-7-sonnet-latest	18,000	90,000	180,000
Anthropic	claude-3-5-haiku-20241022	1,200	6,000	9,600
Anthropic	claude-3-5-haiku-latest	1,200	6,000	9,600
Anthropic	claude-3-haiku-20240307	6,000	12,000	18,000
Google	gemini-2.5-pro	24,000	120,000	240,000
Google	gemini-flash-latest	8,000	40,000	64,000
Google	gemini-2.5-flash	8,000	40,000	64,000
Google	gemini-2.5-flash-preview-09-2025	8,000	40,000	64,000
Google	gemini-flash-lite-latest	50,000	100,000	150,000
Google	gemini-2.5-flash-lite	50,000	100,000	150,000
Google	gemini-2.5-flash-lite-preview-09-2025	50,000	100,000	150,000
Google	gemini-2.0-flash	50,000	100,000	150,000
Google	gemini-2.0-flash-lite	50,000	100,000	150,000
Google	gemini-2.5-flash-image-preview	3,000	6,000	20,000

Limitations

The AI Gateway has the following limitations at this time:

1. Built-in tool usage (a.k.a server tools - tools that the provider manages and runs on their server, such as web search) is not currently supported.
   • Note: custom tools (a.k.a. client tools), which you run in your own code, are supported.
2. The context window (input prompt) is limited to 200k tokens.
3. Prompt caching:
   • Anthropic Claude: only the default 5-minute ephemeral cache duration is supported for Claude.
   • OpenAI: the AI Gateway sets a per-account prompt_cache_key.
   • Google Gemini: explicit context caching is not supported.
4. The AI Gateway does not pass through any request headers (and thus you cannot enable proprietary experimental features via headers).
5. Batch inference is not supported.
6. Priority processing (an OpenAI feature) is not supported.