README

---

 🔥 Firecrawl

The API to search, scrape, and interact with the web at scale. Firecrawl is the context API for AI agents. 🔥 Open source and available as a hosted service.

_Pst. Hey, you, join our stargazers :)_


  


---

 Why Firecrawl?

- Industry-leading reliability: Covers 96% of the web, including JS-heavy pages — no proxy headaches, just clean data (see benchmarks)
- Blazingly fast: P95 latency of 3.4s across millions of pages, built for real-time agents and dynamic apps
- LLM-ready output: Clean markdown, structured JSON, screenshots, and more — spend fewer tokens, build better AI apps
- We handle the hard stuff: Rotating proxies, orchestration, rate limits, JS-blocked content, and more — zero configuration
- Agent ready: Connect Firecrawl to any AI agent or MCP client with a single command
- Document parsing: Turn PDFs, DOCX, and other documents into clean Markdown or structured JSON
- Actions: Click, scroll, write, wait, and press before extracting content
- Open source: Developed transparently and collaboratively — join our community

---

 Feature Overview

Core Endpoints

| Feature | Description |
|---------|-------------|
| Search | Search the web and get full page content from results |
| Scrape | Convert any URL to markdown, HTML, screenshots, or structured JSON |
| Interact | Scrape a page, then interact with it using AI prompts or code |

More

| Feature | Description |
|---------|-------------|
| Parse | Turn PDFs, DOCX, and other documents into clean Markdown or structured JSON |
| Agent | Automated data gathering, just describe what you need |
| Crawl | Scrape all URLs of a website with a single request |
| Map | Discover all URLs on a website instantly |
| Batch Scrape | Scrape thousands of URLs asynchronously |
| Monitor | Get notified when content on a website changes |

---

 Quick Start

Sign up at firecrawl.dev to get your API key. Try the playground to test it out.

 Search

Search the web and get full content from results.

python
from firecrawl import Firecrawl

app = Firecrawl(api_key="fc-YOUR_API_KEY")

search_result = app.search("firecrawl", limit=5)



Node.js / cURL / CLI

Node.js
javascript
import { Firecrawl } from 'firecrawl';

const app = new Firecrawl({apiKey: "fc-YOUR_API_KEY"});

app.search("firecrawl", { limit: 5 })


cURL
bash
curl -X POST 'https://api.firecrawl.dev/v2/search' \
-H 'Authorization: Bearer fc-YOUR_API_KEY' \
-H 'Content-Type: application/json' \
-d '{
  "query": "firecrawl",
  "limit": 5
}'


CLI
bash
firecrawl search "firecrawl" --limit 5



Output:
json
[
  {
    "url": "https://firecrawl.dev",
    "title": "Firecrawl",
    "markdown": "Turn websites into..."
  },
  {
    "url": "https://docs.firecrawl.dev",
    "title": "Firecrawl Docs",
    "markdown": " Getting Started..."
  }
]


 Scrape

Get LLM-ready context from any website — markdown, JSON, screenshots, and more.

python
from firecrawl import Firecrawl

app = Firecrawl(api_key="fc-YOUR_API_KEY")

result = app.scrape('firecr

Top issues

Discussions

Latest release

Firecrawl v2.11.0
 
 Improvements
 
- Firecrawl Research Index — Added a specialized index for agentic AI/ML research: search across 3M+ arXiv papers and the GitHub code behind them (issues, merged PRs, and READMEs, refreshed daily), fetch a paper's details or related work, and check claims against full text. It has state-of-the-art recall on arXivQA, outperforming the next best provider by 18% at comparable cost. Available via the API, SDKs, MCP, and CLI.
- Keyless access for core endpoints — Use /scrape, /search, /interact, and /parse without an API key from official MCP, CLI, and SDK c