Skip to content
HUIAHUB

Topic

Multimodal AI

Models that combine text, image, audio and video, with the tools, open projects and guides for using them beyond plain text.

Multimodal AI refers to models and tools that work with more than one type of data, such as text, images, audio and video, in a single system. To start with multimodal AI, pick the media you work with and open the matching tool page, since most listings here focus on audio, video or images.

ElevenLabs covers text to speech, voice cloning, dubbing and music. Suno generates songs with vocals from a prompt, and Descript edits audio and video through the transcript. Runway generates and edits video, images and audio. Clef, from Cloudflare, is a set of open-weight decision models that return typed answers with probabilities.

The guide walks through Ultralytics YOLO object detection, from prediction to training and exporting a custom model. One video is a Google DeepMind talk on the Gemini Interactions API and Managed Agents, and another tests image decision models on forms and screenshots for robotic process automation. Tool cards show pricing labels and whether an API is offered.