generateContent API while preserving tool calling, streaming, multimodal inputs, and Gemini-specific response metadata.
Prerequisites
- Google AI Studio API key — create one at aistudio.google.com/apikey
- Billing-enabled Google Cloud project — recommended for agent use. Gemini’s free tier is too small for long-running agent sessions because Mibyan may make several model calls per user turn.
- Mibyan installed — no extra Python package is required for the native Gemini provider.
Quick Start
Configuration
After runningmibyan model, your ~/.mibyan/config.yaml will contain:
~/.mibyan/.env:
Native Gemini API
The recommended endpoint is:messages[]→ Geminicontents[]- system prompts → Gemini
systemInstruction - tool schemas → Gemini
functionDeclarations - tool results → Gemini
functionResponseparts - streaming responses → OpenAI-shaped stream chunks for the Mibyan loop
"type": ["number", "null"] are translated
into Gemini’s scalar type plus nullable form. Multi-type unions keep every
alternative through anyOf, including nested properties and array items. This
happens automatically; no MCP server or provider configuration change is needed.
Gemini 3 thought signaturesFor Gemini 3 tool use, Mibyan preserves the
thoughtSignature values attached to function-call parts and replays them on the next tool turn. That covers the validation-critical path for multi-step agent workflows.Gemini 3 may also attach thought signatures to other response parts. Mibyan’ native adapter is optimized for agent tool loops today, so it does not yet replay every non-tool-call signature with full part-level fidelity.Prefer the Native Endpoint
Google also exposes an OpenAI-compatible endpoint:generateContent API. The OpenAI-compatible endpoint is still useful when you specifically need OpenAI API compatibility.
If you previously set GEMINI_BASE_URL to the /openai URL, remove it or change it:
v1beta, v1alpha, v1, …), Mibyan
appends /v1beta for you, so GEMINI_BASE_URL=https://generativelanguage.googleapis.com
works the same as spelling out the /v1beta suffix. The same normalization
applies to the Gemini TTS base URL (tts.gemini.base_url). Chat requests only
take the native Gemini path when the base URL points at
generativelanguage.googleapis.com or the Vertex AI express host below; a proxy on
another host is treated as an OpenAI-compatible endpoint, so configure it with its
/openai-style URL.
Vertex AI Express Mode Keys
Google now issuesAQ.…-prefixed keys for both Google AI Studio and Vertex AI
express mode (the legacy AIza… Studio format is being phased out), so a key’s
prefix no longer identifies its surface. Mibyan never reroutes by key shape: the
configured base URL decides the surface. Set GEMINI_API_KEY and leave
GEMINI_BASE_URL unset for the default AI Studio host; set GEMINI_BASE_URL to
https://aiplatform.googleapis.com (with or without /v1beta1) for a Vertex AI
express-mode key, and Mibyan completes it to the publishers/google form. Each
surface only accepts its own keys — a 403 PERMISSION_DENIED usually means the
key/host pairing is crossed, and Mibyan appends guidance naming the other surface.
A base URL on any other host (a proxy) is never rewritten. Express keys are
separate from the OAuth-based
Vertex AI provider, which needs no API key.
Available Models
Themibyan model picker shows Gemini models maintained in Mibyan’ provider registry. Common choices include:
Model availability changes over time. If a model disappears or is not enabled for your key, run
mibyan model again and pick one from the current list.
Model IDsUse Gemini’s native model IDs such as
gemini-3.7-flash, not OpenRouter-style IDs like google/gemini-3.7-flash, when provider: gemini.Latest Aliases
Google publishes moving aliases for the Pro and Flash Gemini families.gemini-pro-latest and gemini-flash-latest are useful when you want Google to advance the model automatically without changing your Mibyan config. Note that your usage charges may be affected if newer models introduce different rates.
gemini-3.1-pro-preview or gemini-3.7-flash.
Gemma via the Gemini API
Google also exposes Gemma models through the Gemini API. Mibyan recognizes these as Google models, but hides very low-throughput Gemma entries from the default model picker so new users do not accidentally select an evaluation-tier model for a long-running agent session. Useful evaluation IDs include:
These models are best treated as evaluation options on Gemini API keys. Google’s Gemma API pricing is free-tier-only and the usage caps are low compared with production Gemini models, so sustained Mibyan agent use should normally move to a paid Gemini model, a self-hosted deployment, or another provider with appropriate quota.
To use a Gemma model that is hidden from the picker, set it directly:
Switching Models Mid-Session
Use the/model command during a conversation:
mibyan model first. /model switches among already-configured providers and models; it does not collect new API keys.
Diagnostics
- Whether
GOOGLE_API_KEYorGEMINI_API_KEYis available - Whether configured provider credentials can be resolved
Gateway (Messaging Platforms)
Gemini works with all Mibyan gateway platforms (Telegram, Discord, Slack, WhatsApp, LINE, Feishu, etc.). Configure Gemini as your provider, then start the gateway normally:config.yaml and uses the same Gemini provider configuration.
Troubleshooting
”Gemini native client requires an API key”
Mibyan could not find a usable API key. Add one of these to~/.mibyan/.env:
mibyan model again.
”This Google API key is on the free tier”
Mibyan probes Gemini API keys during setup. Free-tier quotas can be exhausted after a handful of agent turns because tool use, retries, compression, and auxiliary tasks may require multiple model calls. Enable billing on the Google Cloud project attached to your key, regenerate the key if needed, then run:“404 model not found”
The selected model is not available for your account, region, or key. Runmibyan model again and pick another Gemini model from the current list.
Gemma model is not shown in mibyan model
Mibyan may hide low-throughput Gemma models from the picker by default. If you intentionally want to evaluate one, set the model ID directly in ~/.mibyan/config.yaml.
”429 quota exceeded” on Gemma
Gemma models exposed through the Gemini API are useful for evaluation, but their Gemini API free-tier caps are low. Use them for compatibility testing, then switch to a paid Gemini model or another provider for sustained agent sessions.OpenAI-compatible endpoint is configured
Check~/.mibyan/.env for:
Tool calling fails with schema errors
Upgrade Mibyan and rerunmibyan model. The native Gemini adapter sanitizes tool schemas for Gemini’s stricter function-declaration format; older builds or custom endpoints may not.
Related
- AI Providers
- Configuration
- Fallback Providers
- AWS Bedrock — native cloud-provider integration using AWS credentials

