Agent Memory EXPLAINED - Complete Architecture
by Hugging Face28:34 long60K views
Why watchA 28-minute walk through how Mem0 stores, ingests and retrieves agent memories, for developers who want long-term memory that goes past a single vector search.
What this video covers
This Hugging Face video is a case study of persistent memory for AI agents, built around Mem0, an open-source project whose code is on GitHub. The description makes one argument up front: long-term memory for agents needs more than a vector search. The chapters then follow a single system from storage to retrieval.
After the introduction (0:00), the video defines agent memory at 0:55. At 3:28 it turns to memory that persists across agents. The chapter at 4:26 covers the databases Mem0 uses as its memory stores. The chapter list does not name them, so check the video or the Mem0 documentation linked in the description for the specifics.
Memory ingestion starts at 8:06 and runs for more than seven minutes, the longest section of the video. It covers Mem0's ingestion pipeline, the path a new memory takes before it is stored.
Retrieval gets two chapters. From 15:30 the topic is queries and semantic search. At 19:19 the video adds BM25 keyword ranking and entity boosting. The description groups these three methods together as hybrid retrieval, and this second retrieval chapter is the place to start if you already know semantic search and want the rest.
The final chapter (25:38) looks at open models for running the system locally, covering both the LLM and the embedding model, and closes the video. For choosing those models, the description links the Hugging Face model hub, its filter for embedding models and the MTEB leaderboard.
Written by HuiaHub from the creator's title, description and chapters. All credit for the video goes to Hugging Face.
Key takeaways
- Long-term agent memory needs more than one vector search.
- Mem0 keeps memories in several database stores.
- Ingestion is its own pipeline, separate from retrieval.
- Hybrid retrieval combines semantic search, BM25 and entity boosting.
- Open LLMs and embedding models can run the memory system locally.
Chapters
- 0:00Introduction (opens YouTube at this moment)
- 0:55What agent memory is (opens YouTube at this moment)
- 3:28Persistent memory across agents (opens YouTube at this moment)
- 4:26Databases used by Mem0 (opens YouTube at this moment)
- 8:06Memory ingestion (opens YouTube at this moment)
- 15:30Retrieval: queries and semantic search (opens YouTube at this moment)
- 19:19Retrieval: BM25 and entity boosting (opens YouTube at this moment)
- 25:38Open models and conclusion (opens YouTube at this moment)
More videos
22:46intermediateHow Inference Keeps Up with Our Insatiable Need for Tokens — Cerebras & Gimlet Labs
A 22-minute AI Engineer talk for inference engineers that covers runtime tricks like paged KV cache and chunked prefill, then system-level disaggregation and kernel-writing agents.
AI Engineer · 1.2K views ·
14:22intermediateSandboxes Aren't Optional: 4 Ways to Isolate Coding Agents — Robert Brennan, OpenHands
A 14-minute talk from the OpenHands CEO comparing four ways to sandbox coding agents, for developers who run agents with broad permissions.
AI Engineer · 3.9K views ·
19:17intermediateStop Renting Intelligence: The Train-to-Deploy Loop for Specialized AI — Fireworks AI
A 19-minute Fireworks AI talk on training open models on your own data and redeploying them in a continuous loop, for teams weighing closed-model costs.
AI Engineer · 6.1K views ·
14:07intermediateThree Questions Every Agent Engineer Should Be Able To Answer
A 14-minute LangChain talk on finding, reproducing and fixing agent failures using production traces, for engineers who run agents in production.
LangChain · 8.1K views ·