> ## Documentation Index
> Fetch the complete documentation index at: https://dripart-codex-simplify-get-started.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# Use Gemini Omni 1.1 Flash with Comfy Router

> Call gemini-interactions/gemini-omni-1.1-flash through Comfy Router: endpoint, request shape and the response Router returns.

API Reference for `gemini-interactions/gemini-omni-1.1-flash`, served by Comfy Router from Gemini Interactions.

## Quick start

Create a key in [your Comfy workspace](https://platform.comfy.org/profile/api-keys) and export it as `COMFY_API_KEY`. The Python and TypeScript snippets use the Comfy SDKs (`pip install comfy-sdk`, `npm install @comfyorg/sdk`); the cURL snippet is the same call over raw HTTP.

**Model ID:** `gemini-interactions/gemini-omni-1.1-flash`

**Endpoint:** `POST https://api.comfy.org/v2/models/gemini-interactions/gemini-omni-1.1-flash`

<CodeGroup>
  ```python Python theme={null}
  from comfy_sdk import Comfy

  # Reads COMFY_API_KEY from the environment.
  # The SDK automatically creates an idempotency key and reuses it for automatic retries.
  with Comfy() as client:
      result = client.models.run(
          "gemini-interactions/gemini-omni-1.1-flash",
          {
              "input": "Reply with the single word: ok",
              "stream": False,
          },
      )

  print(result)
  ```

  ```typescript TypeScript theme={null}
  import { comfy } from "@comfyorg/sdk";

  // Reads COMFY_API_KEY from the environment.
  // The SDK automatically creates an idempotency key and reuses it for automatic retries.
  const { data } = await comfy.models.run("gemini-interactions/gemini-omni-1.1-flash", {
    input: "Reply with the single word: ok",
    stream: false,
  });

  console.log(data);
  ```

  ```bash cURL theme={null}
  curl https://api.comfy.org/v2/models/gemini-interactions/gemini-omni-1.1-flash \
    -H "X-API-Key: $COMFY_API_KEY" \
    -H "Idempotency-Key: $(uuidgen)" \
    -H "Content-Type: application/json" \
    -d "{\"input\": \"Reply with the single word: ok\", \"stream\": false}"
  ```
</CodeGroup>

## Schema

### Input

<ParamField body="input" type="object" required>
  Either a prompt string or an array of typed content parts (text, image, audio, video, document).
</ParamField>

<ParamField body="model" type="string">
  Gemini model identifier (e.g. `gemini-omni-flash-preview`). On the Comfy Router route `POST /v2/models/gemini-interactions/{model}` it is supplied from the path and may be omitted. The spellings this operation serves — the set Comfy Router addresses as `gemini-interactions/<model>` — are gemini-omni-flash-preview and gemini-omni-1.1-flash (supportedGeminiInteractionModels); they are written out here rather than constrained to an enum, because the proxy validates the model itself and answers its own 400 for a spelling it does not serve.
</ParamField>

<ParamField body="previous_interaction_id" type="string">
  ID of a prior stored interaction, enabling stateful multi-turn video editing.
</ParamField>

Generated from the schema Router serves at `GET /v2/models/gemini-interactions/gemini-omni-1.1-flash/openapi.json`, the same document it validates a call against before the request reaches the provider.

### Output

<ResponseField name="id" type="string" />

<ResponseField name="model" type="string" />

<ResponseField name="object" type="string" />

<ResponseField name="status" type="string" required>
  Always `completed` on a Router response. The provider's other statuses (`in_progress`, `requires_action`, `failed`, `cancelled`, `incomplete`, `budget_exceeded`) do not reach a caller through Router as a 200; they are returned as a Comfy Router error carrying the provider's body.

  Possible values: `completed`
</ResponseField>

<ResponseField name="steps" type="object[]" required>
  The interaction timeline, in order. Narrowed here from the untyped `steps` on `GeminiInteraction` so the output leaf is addressable; the provider keeps adding step types, so an item is `additionalProperties: true` and only the fields a Router caller reads are declared.
</ResponseField>

<ResponseField name="steps[].content" type="object[]">
  The typed content blocks of this step.
</ResponseField>

<ResponseField name="steps[].content[].data" type="string">
  Base64-encoded inline media, on a media block delivered inline. Google caps inline media at 4 MB and requires `delivery: uri` above it.
</ResponseField>

<ResponseField name="steps[].content[].mime_type" type="string">
  Media type of `data` or `uri`, on a media block.
</ResponseField>

<ResponseField name="steps[].content[].text" type="string">
  The generated text. Present on a `text` block, and this is the leaf the nightly Router SDK case asserts — on a `model_output` step specifically (`steps[type=model_output].content[].text`).
</ResponseField>

<ResponseField name="steps[].content[].type" type="string">
  Block kind — `text`, `image`, `audio`, `video` or `document`.
</ResponseField>

<ResponseField name="steps[].content[].uri" type="string">
  Reference to media delivered out of band, fetched by the caller from the URI it names.
</ResponseField>

<ResponseField name="steps[].type" type="string">
  Step kind. `model_output` is the generated answer; `user_input` is the caller's own turn echoed back by the retrieval route; `thought` is internal reasoning. The tool steps (`function_call`, `function_result`, `code_execution_call`, `google_search_call`, ...) are open-ended and Google adds to them.
</ResponseField>

<ResponseField name="usage" type="object">
  Token usage for a Gemini interaction.
</ResponseField>

<ResponseField name="usage.input_tokens_by_modality" type="object[]">
  Token count for one modality.
</ResponseField>

<ResponseField name="usage.input_tokens_by_modality[].modality" type="string">
  One of `text`, `image`, `audio`, `video`, `document`.
</ResponseField>

<ResponseField name="usage.input_tokens_by_modality[].tokens" type="integer" />

<ResponseField name="usage.output_tokens_by_modality" type="object[]">
  Token count for one modality.
</ResponseField>

<ResponseField name="usage.output_tokens_by_modality[].modality" type="string">
  One of `text`, `image`, `audio`, `video`, `document`.
</ResponseField>

<ResponseField name="usage.output_tokens_by_modality[].tokens" type="integer" />

<ResponseField name="usage.total_cached_tokens" type="integer" />

<ResponseField name="usage.total_input_tokens" type="integer" />

<ResponseField name="usage.total_output_tokens" type="integer" />

<ResponseField name="usage.total_thought_tokens" type="integer" />

<ResponseField name="usage.total_tokens" type="integer" />

## Examples

### Input

```json theme={null}
{
  "input": "Reply with the single word: ok",
  "stream": false
}
```

### Output

```json theme={null}
{
  "id": "interactions/3f6c1a90-2b47-4d18-9a55-7c0e8b21d4f3",
  "object": "interaction",
  "status": "completed",
  "steps": [
    {
      "content": [
        {
          "text": "ok",
          "type": "text"
        }
      ],
      "type": "model_output"
    }
  ],
  "usage": {
    "input_tokens_by_modality": [
      {
        "modality": "text",
        "tokens": 9
      }
    ],
    "output_tokens_by_modality": [
      {
        "modality": "text",
        "tokens": 2
      }
    ],
    "total_cached_tokens": 0,
    "total_input_tokens": 9,
    "total_output_tokens": 2,
    "total_thought_tokens": 0,
    "total_tokens": 11
  }
}
```

## Before you ship

The SDKs create an `Idempotency-Key` and reuse it for automatic retries. For manual retries, reuse the original key. Router can hold the connection for up to 10 minutes.

When a request fails, Router sends an `X-Comfy-Error-Type` response header explaining why. A `422` means Router rejected the input before calling the provider. Download generated assets promptly because [result URLs can expire](/development/comfy-router/reference#result-assets).

<CardGroup cols={3}>
  <Card title="Headers" icon="list" href="/development/comfy-router/headers">
    Authentication, idempotency, request IDs, error buckets, retry pacing, spend limits.
  </Card>

  <Card title="Using the Router API" icon="code" href="/development/comfy-router/api">
    Model discovery, validation errors, retries, and billing.
  </Card>

  <Card title="Limitations" icon="triangle-exclamation" href="/development/comfy-router/limitations">
    What Router does not do today, and what to use instead.
  </Card>
</CardGroup>