· ai-devtools
Introducing Virtual Models on AI Gateway
Virtual Models are an abstraction of the model string and configurations your apps and developers use.
With a single virtual model ID, you can change and update models, configure fallbacks and priority, and enforce Zero Data Retention centrally. The virtual model configuration applies wherever the ID is used.
Assign a virtual model ID to an agent task, and pass it as the model string wherever that task is called. You can then change the model and settings behind the virtual model ID in AI Gateway, and your apps and agents will pick up the new configuration automatically, without code changes or redeploys.
New models use the same virtual model ID In the last 90 days, 125 new models from more than 10 labs became available on AI Gateway. That adds up to about 10 a week.
AI Gateway already makes switching a one-line change. You call any of those models by ID, and AI Gateway routes each request to a healthy provider and can fall back to others when one fails. That one line still lives in your code, so switching usually means a redeploy.
