Use Gemini Omni 1.1 Flash with Comfy Router

Call gemini-interactions/gemini-omni-1.1-flash through Comfy Router: endpoint, request shape and the response Router returns.

API Reference for gemini-interactions/gemini-omni-1.1-flash, served by Comfy Router from Gemini Interactions.

Quick start

Create a key in your Comfy workspace and export it as COMFY_API_KEY. The Python and TypeScript snippets use the Comfy SDKs (pip install comfy-sdk, npm install @comfyorg/sdk); the cURL snippet is the same call over raw HTTP.

Model ID: gemini-interactions/gemini-omni-1.1-flash

Endpoint: POST https://api.comfy.org/v2/models/gemini-interactions/gemini-omni-1.1-flash

Python

from comfy_sdk import Comfy

# Reads COMFY_API_KEY from the environment.
# The SDK automatically creates an idempotency key and reuses it for automatic retries.
with Comfy() as client:
    result = client.models.run(
        "gemini-interactions/gemini-omni-1.1-flash",
        {
            "input": "Reply with the single word: ok",
            "stream": False,
        },
    )

print(result)

Schema

Input

input · object · required

Either a prompt string or an array of typed content parts (text, image, audio, video, document).

model · string

Gemini model identifier (e.g. gemini-omni-flash-preview). On the Comfy Router route POST /v2/models/gemini-interactions/{model} it is supplied from the path and may be omitted. The spellings this operation serves — the set Comfy Router addresses as gemini-interactions/<model> — are gemini-omni-flash-preview and gemini-omni-1.1-flash (supportedGeminiInteractionModels); they are written out here rather than constrained to an enum, because the proxy validates the model itself and answers its own 400 for a spelling it does not serve.

previous_interaction_id · string

ID of a prior stored interaction, enabling stateful multi-turn video editing.

Generated from the schema Router serves at GET /v2/models/gemini-interactions/gemini-omni-1.1-flash/openapi.json, the same document it validates a call against before the request reaches the provider.

Output

id · string

model · string

object · string

status · string · required

Always completed on a Router response. The provider’s other statuses (in_progress, requires_action, failed, cancelled, incomplete, budget_exceeded) do not reach a caller through Router as a 200; they are returned as a Comfy Router error carrying the provider’s body.

Possible values: completed

steps · object[] · required

The interaction timeline, in order. Narrowed here from the untyped steps on GeminiInteraction so the output leaf is addressable; the provider keeps adding step types, so an item is additionalProperties: true and only the fields a Router caller reads are declared.

steps[].content · object[]

The typed content blocks of this step.

steps[].content[].data · string

Base64-encoded inline media, on a media block delivered inline. Google caps inline media at 4 MB and requires delivery: uri above it.

steps[].content[].mime_type · string

Media type of data or uri, on a media block.

steps[].content[].text · string

The generated text. Present on a text block, and this is the leaf the nightly Router SDK case asserts — on a model_output step specifically (steps[type=model_output].content[].text).

steps[].content[].type · string

Block kind — text, image, audio, video or document.

steps[].content[].uri · string

Reference to media delivered out of band, fetched by the caller from the URI it names.

steps[].type · string

Step kind. model_output is the generated answer; user_input is the caller’s own turn echoed back by the retrieval route; thought is internal reasoning. The tool steps (function_call, function_result, code_execution_call, google_search_call, …) are open-ended and Google adds to them.

usage · object

Token usage for a Gemini interaction.

usage.input_tokens_by_modality · object[]

Token count for one modality.

usage.input_tokens_by_modality[].modality · string

One of text, image, audio, video, document.

usage.input_tokens_by_modality[].tokens · integer

usage.output_tokens_by_modality · object[]

Token count for one modality.

usage.output_tokens_by_modality[].modality · string

One of text, image, audio, video, document.

usage.output_tokens_by_modality[].tokens · integer

usage.total_cached_tokens · integer

usage.total_input_tokens · integer

usage.total_output_tokens · integer

usage.total_thought_tokens · integer

usage.total_tokens · integer

Examples

Input

{
  "input": "Reply with the single word: ok",
  "stream": false
}

Output

{
  "id": "interactions/3f6c1a90-2b47-4d18-9a55-7c0e8b21d4f3",
  "object": "interaction",
  "status": "completed",
  "steps": [
    {
      "content": [
        {
          "text": "ok",
          "type": "text"
        }
      ],
      "type": "model_output"
    }
  ],
  "usage": {
    "input_tokens_by_modality": [
      {
        "modality": "text",
        "tokens": 9
      }
    ],
    "output_tokens_by_modality": [
      {
        "modality": "text",
        "tokens": 2
      }
    ],
    "total_cached_tokens": 0,
    "total_input_tokens": 9,
    "total_output_tokens": 2,
    "total_thought_tokens": 0,
    "total_tokens": 11
  }
}

Before you ship

The SDKs create an Idempotency-Key and reuse it for automatic retries. For manual retries, reuse the original key. Router can hold the connection for up to 10 minutes.

When a request fails, Router sends an X-Comfy-Error-Type response header explaining why. A 422 means Router rejected the input before calling the provider. Download generated assets promptly because result URLs can expire.

Headers

Authentication, idempotency, request IDs, error buckets, retry pacing, spend limits.

Using the Router API

Model discovery, validation errors, retries, and billing.

Limitations

What Router does not do today, and what to use instead.