RAG, search & data
Scrape Anything
Context.dev's scraping API that turns any URL into Markdown, HTML, JSON or screenshots for AI agents and apps.
What Scrape Anything does
Scrape Anything is the scraping endpoint of Context.dev, a web data API for AI agents. You send a URL to POST /v1/web/scrape and choose the outputs you want in a formats object. The docs list html, markdown, screenshot, images, bytes, parse, highlights, json and product, and several can come back from one request.
Context.dev says rendering, proxies and retries run on every request: blocked requests escalate to stronger proxies and retry with a different strategy before anything comes back. The homepage quotes a 99.96% scrape success rate. The same API key also covers related products: Map URLs, Crawl Website, Search Web, Answers, Parse File and page monitors that send changes to a webhook.
Access is through a REST API with a Bearer token, and Context.dev publishes official SDKs for TypeScript, Python, Ruby, Go and PHP. An MCP server is documented for connecting coding agents. Billing is by credits, and the pricing page counts one credit per scrape at the base rate.
It suits developers who need clean page content for retrieval pipelines, agents that read the live web, or jobs that scrape thousands of URLs in batches. The free plan gives 1,000 credits a month without a credit card.
- Turning web pages and PDFs into Markdown for a retrieval index
- Giving an AI agent live web content through a REST API or MCP server
- Scraping thousands of URLs or a whole site in one batch job
- Watching pages on a schedule and sending changes to a webhook
Who should use it
- Developers building AI agents or RAG pipelines that need clean page content
- Teams that want rendering, proxies and retries handled by the API
Who should look elsewhere
- People who want a no-code desktop scraper rather than an API
- Workloads that must run fully offline or self-hosted, since the API is hosted
Strengths
- One request can return several formats, including Markdown, HTML, JSON and screenshots
- JavaScript rendering and proxies are included on every plan
- Official SDKs in five languages plus a documented MCP server
- A free plan with 1,000 credits a month and no card
Limitations
- The free plan allows 1 concurrent request and has no overage, so usage stops when credits run out
- The docs do not publish numeric rate limits
- SSO / SAML starts at the Scale plan at $499/month
Sources
- Context.dev: Web Data API for AI Agents (Scrape, Search, Crawl)Official sitePrimarycontext.dev
- Web Scraping API Pricing: Plans from $0 | Context.devPricing pagePrimarycontext.dev
- Context.dev: the web data API - Context.devOfficial docsPrimarydocs.context.dev
- docs.context.dev/scrape/overviewOfficial docsPrimary
- docs.context.devOfficial docsPrimary
- docs.context.dev/install-mcpOfficial docsPrimary
Related open-source projects
TencentDB Agent Memory is a self-hosted memory service from Tencent Cloud that stores what AI agents learn and shares it across agents and team members. It turns past work into four kinds of memory asset. Chat Memory keeps preferences, facts and decisions, distilled from raw conversation through layers named L0 Conversation, L1 Atom, L2 Scenario and L3 Persona. Skills capture reusable procedures with versions and validation rules. LLM-Wiki builds linked pages from documents, and CodeGraph indexes symbols, files and call relationships so an agent can check what a change might affect. A web panel called Memory Hub tracks ownership, versions and access, with private, team and ACL-based visibility. Agents connect through a proxy. You point the agent's base URL at it, and the README says no plugin, hook or MCP server is needed. Listed clients include Claude Code, Codex, CodeBuddy, WorkBuddy, Hermes and OpenClaw. Setup starts three services (memory-core, memory-hub and proxy) with Docker and a start script, and asks for two sets of LLM settings. The README reports a PersonaMem score of 76% with the system against 48% without it, which is the project's own figure. Team Memory is labeled beta.
- Stars
- 28K
- Language
- TypeScript
- Momentum
- Established
VoiceStudio is a desktop app that runs speech AI on your own computer: it clones and designs voices, generates speech from text, dubs videos, transcribes audio and has a dictation widget. The app is built on Electron with a Python backend. Its default speech engine is k2-fsa's OmniVoice, and the feature catalog lists more than a dozen alternatives, among them CosyVoice 3, KittenTTS, MLX-Audio and IndexTTS 2.5. Transcription defaults to WhisperX, with Faster-Whisper, Parakeet, Moonshine and others available. Models are downloaded when a workspace first needs them. The project says its tools cover 646 languages, a figure that also appears in the transcription tool of its MCP docs. Beyond the desktop workspaces, VoiceStudio exposes a local API and an MCP server on port 3900, so coding agents can generate speech, clone a voice or transcribe a file. The README states that local workflows stay on your hardware, remote workers are optional and usage analytics only run with consent. Version 0.5.3 was the last release built on Tauri; current releases are Electron only, and Tauri users have to install the new app separately.
- Stars
- 61K
- Language
- Python
- License
- AGPL-3.0
- Momentum
- +16.0% 7dTrending
qwen-audio-agent is a realtime voice runtime that sits in front of a coding or task agent. You talk to a voice model, longer jobs go to a backend agent while the conversation continues, and when a task finishes its result comes back into the same conversation. The voice side is swappable. Cloud options listed in the README include Qwen Audio 3.0 Realtime, GPT-Live / OpenAI Realtime, Google Gemini Live and Doubao Seeduplex 3.0 Realtime, each needing that provider's API key. Hugging Face Speech-to-Speech and MiniCPM-o 4.5 can run locally. Backend agents connect mostly over ACP: the list covers Qwen Code, OpenCode, OpenClaw and Kimi Code, with Codex and Claude Code joining through an external ACP adapter. You can use it from a WebUI, a terminal TUI or a desktop floating orb on macOS, Windows and Linux. The README also lists parallel background tasks you can query or cancel, cross-session memory, and scheduled reminders. The package is published on npm under Apache-2.0, a technical report is on arXiv, and the repository sits in the QwenAudio GitHub organization.
- Stars
- 2.9K
- Language
- JavaScript
- License
- Apache-2.0
- Momentum
- Emerging
AI Engineering from Scratch is a free, MIT-licensed course on GitHub that teaches how AI systems work by having you write each piece yourself, starting with linear algebra and ending with multi-agent systems and production infrastructure. The material is split into 20 phases and 523 lessons, with code in Python, TypeScript, Rust and Julia. Each lesson folder holds a written explanation, runnable code and an outputs directory. The pattern is to build an algorithm such as backpropagation, a tokenizer, attention or an agent loop from plain math first, and only then run the same idea through a library like PyTorch or scikit-learn. Lessons end with something you keep: a prompt, a SKILL.md file, an agent or an MCP server. The repository holds 396 skills and 99 prompts produced this way, plus a script that copies them into an agent's skills folder. There are three ways to follow it. You can read lessons on the website with no setup, clone the repository and run the code locally, or install the course's tutor skills into a coding agent such as Claude Code or Codex. Those skills run a placement quiz, write a study plan to LEARNING.md and teach one lesson per session. Separate tracks prepare for the four Claude certification exams and the MCP Associate exam; the README says these are independent and not affiliated with the exam bodies.
- Stars
- 68K
- Language
- Python
- License
- MIT
- Momentum
- +8.2% 7dEstablished
Related guides
- Weekly digest
The week on HuiaHub: sandboxed agents, RAG tooling and local models
41 new HuiaHub pages this week: sandboxing coding agents, RAG retrieval, local models on Macs and phones, Claude Haiku 5.5 and six how-to guides.
4 min read