# XCrawl

> Live web data for AI agents, RAG and automations

**Website:** https://www.xcrawl.ai/

## Overview

XCrawl is a web data API for AI builders: scrape, crawl, map and search the web and get clean JSON or Markdown back, with proxies and JS rendering handled for you.

## Features

- Scrape, crawl, map and search the web
- Markdown, JSON, HTML or screenshot output
- Proxies, JS rendering and retries handled

## Best For

- Developers
- Startups

## Details

XCrawl gives developers API for getting web data into AI apps. Scrape a single URL into Markdown, JSON, HTML or a screenshot; crawl a whole site with depth and scope rules; map every URL on a domain; or pull structured results from Google, Bing, DuckDuckGo and other search engines. Rendering, proxy rotation and retries run on XCrawl's side. Python and Node.js SDKs, a CLI, an MCP server for Claude Code and other MCP clients, and an n8n node are available. New accounts start with 1,000 free credits, no credit card required.