Nemotron 3 Diarization - Who Said That?
by Sam Witteveen13:10 long52K views
Why watchSam Witteveen explains speaker diarization and runs NVIDIA's Nemotron 3 Diarization on a full podcast, a 13-minute look for anyone building multi-speaker transcription.
What this video covers
Speaker diarization answers the question of who spoke when in a recording. In this 13-minute video, Sam Witteveen looks at NVIDIA's Nemotron 3 Diarization, a new model that handles both batch processing and streaming. The description links the Hugging Face blog post and the model card.
The model is introduced at 1:27, and at 2:30 he places it within the Nemotron Speech family. A short definition of diarization follows at 4:09. At 4:26 he connects it to agents and voice, then at 5:41 explains how these models are scored with diarization error rate (DER). The description says the model beats many others at telling speakers apart. The chapter list has no separate benchmark section, so check that claim against the DER figures on the model card.
From 6:26 he breaks down how Nemotron 3 Diarization works. The demo starts at 6:58 on a DGX Spark with NVIDIA NeMo and runs close to four minutes. At 10:52 he processes a full podcast. The final chapter, from 11:38, exports the result as plain text or as an SRT subtitle file.
The model card fills in the specs. It is a 100M-parameter Transformer encoder that handles up to eight speakers. A single checkpoint covers every latency setting, from streaming to offline. Training data spans English, Mandarin, Hindi, Kannada, Telugu and Bengali, and the license is the OpenMDW License Agreement 1.1, which the card describes as ready for commercial or non-commercial use.
Written by HuiaHub from the creator's title, description and chapters. All credit for the video goes to Sam Witteveen.
Key takeaways
- Diarization labels who spoke when in a recording.
- Diarization models are scored with diarization error rate (DER).
- Nemotron 3 Diarization supports both batch and streaming use.
- The demo runs the model with NVIDIA NeMo on a DGX Spark.
- Results can be exported as plain text or SRT.
Chapters
- 0:00Intro (opens YouTube at this moment)
- 1:27NVIDIA Nemotron 3 Diarization (opens YouTube at this moment)
- 2:30The Nemotron Speech family (opens YouTube at this moment)
- 4:09So what is diarization? (opens YouTube at this moment)
- 4:26Agents & Voice (opens YouTube at this moment)
- 5:41How these models get scored (DER) (opens YouTube at this moment)
- 6:26Breaking Down Nemotron 3 Diarization (opens YouTube at this moment)
- 6:58Demo: DGX Spark and NeMo (opens YouTube at this moment)
- 10:52Demo of a full podcast (opens YouTube at this moment)
- 11:38Exporting as text or SRT (opens YouTube at this moment)
More videos
22:46intermediateHow Inference Keeps Up with Our Insatiable Need for Tokens — Cerebras & Gimlet Labs
A 22-minute AI Engineer talk for inference engineers that covers runtime tricks like paged KV cache and chunked prefill, then system-level disaggregation and kernel-writing agents.
AI Engineer · 1.2K views ·
14:22intermediateSandboxes Aren't Optional: 4 Ways to Isolate Coding Agents — Robert Brennan, OpenHands
A 14-minute talk from the OpenHands CEO comparing four ways to sandbox coding agents, for developers who run agents with broad permissions.
AI Engineer · 3.9K views ·
19:17intermediateStop Renting Intelligence: The Train-to-Deploy Loop for Specialized AI — Fireworks AI
A 19-minute Fireworks AI talk on training open models on your own data and redeploying them in a continuous loop, for teams weighing closed-model costs.
AI Engineer · 6.1K views ·
14:07intermediateThree Questions Every Agent Engineer Should Be Able To Answer
A 14-minute LangChain talk on finding, reproducing and fixing agent failures using production traces, for engineers who run agents in production.
LangChain · 8.1K views ·