Direct model provider

Use Gemini through Relays.

Use Gemini through Relays’ maintained OpenAI-compatible provider preset and a stable Relays model alias.

One alias in front of Gemini.

Your application calls a Relays alias. Relays holds the Gemini credential, applies the route policy, and hands back the provider response in the shape your SDK expects.

  1. CallerYour application

    Keeps the OpenAI-compatible request it already sends.

  2. EdgeRelays

    Holds the key, picks the candidate, writes the receipt.

  3. UpstreamGemini

    Receives the call on its own base URL.

Wire protocol
OpenAI-compatible
Relays endpoints
  • Chat Completions
Credential boundary
Bring your own Gemini API keyGEMINI_API_KEY
Upstream base URL
https://generativelanguage.googleapis.com/v1beta/openai
Connection
Maintained Relays preset
Source
Gemini OpenAI compatibility documentation

Relays’ Gemini preset declares the OpenAI-compatible Chat Completions edge. Keep the model ID behind a Relays alias so applications do not take a dependency on a provider string.

What is measured, and what is not.

Availability comes from Gemini. Latency, error rate, and cost per successful request come from your own traffic, so Relays leaves them empty until requests run.

Upstream status

Gemini
Not published to Relays
Gemini does not publish a status feed Relays can read, so no availability is reported here.

Relays measurements

Your traffic
No sample yet
Time to first token, error rate, and cost per successful request are read from requests that ran through Relays. This route has none, so there is nothing to plot.

Models at the edge.

Model IDs sit behind a Relays alias, so a catalogue change at Gemini never reaches your code.

Catalogue not connected
Relays has not published a Gemini model list on this page. Route candidates are still set by model ID in your route configuration.

Every route carries a policy.

A route is a list of candidates, a budget, and a record of what happened. You set all three before any traffic runs.

Fallback

Candidates stay inside the contract.

Gemini can be one candidate in an ordered Chat Completions route with other configured OpenAI-compatible providers. The route only attempts candidates declared for that endpoint.

See how a route is chosen
Budget

A ceiling on this route.

Set an alert threshold and a stop threshold for the route rather than for the whole application. Relays checks both before the call goes upstream.

Receipt

Each attempt is written down.

Every call records the alias, the candidates tried, the status each returned, tokens in and out, and the estimated cost of the attempt that served it.

Read a route receipt

One endpoint is enough to start.

Keep the client you already wrote. Bring us the workload and we will map the first Gemini route with you.

Start a conversation