An Interaction Is All You Need — Ivan Leo, Google DeepMind
by AI Engineer17:04 long8.1K views
Why watchIvan Leo of Google DeepMind explains the Gemini Interactions API and Managed Agents in 17 minutes, useful for developers building agents on Gemini.
What this video covers
Ivan Leo, a developer experience engineer at Google DeepMind, gave this talk at the AI Engineer World's Fair 2026 in San Francisco. It introduces two products, the Gemini Interactions API and Managed Agents (0:12).
He opens with history. From 0:27 he traces the move from single completions to agents, by way of function calling (1:02) and models that reason and act (1:32). At 2:02 he offers a definition of an agent, and at 3:02 he points viewers to Google AI Studio for trying the models.
The case for a new API starts at 4:07. The description puts it simply: models became agents and the APIs did not keep up. At 5:31 he explains server-side state, where interaction IDs replace the job of passing thought signatures back by hand. A demo at 6:21 chains image and video generation, and 7:01 walks through the code behind it. Three shorter chapters follow: strongly typed outputs (7:36), mixing built-in and custom tools (8:21) and the new steps data model (9:01).
Managed Agents take the second half, from 9:46. They run the Antigravity agent in a persistent remote sandbox. A demo at 10:36 analyzes a GitHub repo. Sandboxes persist through environment IDs (11:06), and sources can come from Google Cloud Storage, GitHub or inline files (11:41). The chapter at 12:16 is a 2M-token repo analysis, and 12:56 covers running the same agent locally and in the cloud. A proxy that injects credentials comes up at 13:36, then named agents at 14:26.
The last stretch covers the open-source Gemini API CLI (15:26) and a skill for migrating code to the Interactions API (15:56), with a wrap-up at 16:36.
Written by HuiaHub from the creator's title, description and chapters. All credit for the video goes to AI Engineer.
Key takeaways
- The Interactions API keeps agent state on the server behind interaction IDs.
- Server-side state removes hand-managed thought signatures.
- Image, video and audio generation can be chained with the same context.
- Built-in and custom tools can be mixed in one agent.
- Managed Agents run the Antigravity agent in a persistent remote sandbox.
- A skill exists for migrating code to the Interactions API.
Chapters
- 0:00Intro (opens YouTube at this moment)
- 0:12Interactions API and Managed Agents (opens YouTube at this moment)
- 0:27From single completions to agents (opens YouTube at this moment)
- 1:02Function calling (opens YouTube at this moment)
- 1:32Models that reason and act (opens YouTube at this moment)
- 2:02What is an agent? (opens YouTube at this moment)
- 3:02Try the models in AI Studio (opens YouTube at this moment)
- 4:07Why a new API (opens YouTube at this moment)
- 5:31Server-side state and thought signatures (opens YouTube at this moment)
- 6:21Demo: chaining image and video generation (opens YouTube at this moment)
- 7:01How the code works (opens YouTube at this moment)
- 7:36Strongly typed outputs (opens YouTube at this moment)
- 8:21Mixing built-in and custom tools (opens YouTube at this moment)
- 9:01The steps data model (opens YouTube at this moment)
- 9:46Managed Agents: Antigravity in the cloud (opens YouTube at this moment)
- 10:36Demo: analyzing a GitHub repo (opens YouTube at this moment)
- 11:06Persistent sandboxes with environment IDs (opens YouTube at this moment)
- 11:41Loading sources: GCS, GitHub, inline files (opens YouTube at this moment)
- 12:16A 2M-token repo analysis (opens YouTube at this moment)
- 12:56The same agent locally and in the cloud (opens YouTube at this moment)
- 13:36A credential-injecting proxy (opens YouTube at this moment)
- 14:26Named agents (opens YouTube at this moment)
- 15:26The Gemini API CLI (opens YouTube at this moment)
- 15:56Migrating with the Interactions API skill (opens YouTube at this moment)
- 16:36Wrap-up (opens YouTube at this moment)
More videos
22:46intermediateHow Inference Keeps Up with Our Insatiable Need for Tokens — Cerebras & Gimlet Labs
A 22-minute AI Engineer talk for inference engineers that covers runtime tricks like paged KV cache and chunked prefill, then system-level disaggregation and kernel-writing agents.
AI Engineer · 1.2K views ·
14:22intermediateSandboxes Aren't Optional: 4 Ways to Isolate Coding Agents — Robert Brennan, OpenHands
A 14-minute talk from the OpenHands CEO comparing four ways to sandbox coding agents, for developers who run agents with broad permissions.
AI Engineer · 3.9K views ·
19:17intermediateStop Renting Intelligence: The Train-to-Deploy Loop for Specialized AI — Fireworks AI
A 19-minute Fireworks AI talk on training open models on your own data and redeploying them in a continuous loop, for teams weighing closed-model costs.
AI Engineer · 6.1K views ·
14:07intermediateThree Questions Every Agent Engineer Should Be Able To Answer
A 14-minute LangChain talk on finding, reproducing and fixing agent failures using production traces, for engineers who run agents in production.
LangChain · 8.1K views ·