Skip to content
IndexDesign corpus
Utilities & NamingServiceAGPLFreemium

Firecrawl

Open-source web data API that searches, scrapes, and crawls sites into clean data for AI

Aboutfirecrawl.dev

Firecrawl is a web data API for AI agents and builders. It searches, scrapes, maps, and crawls websites and returns clean, structured data. It is open source under the AGPL-3.0 license, with about 190,000 GitHub stars, and has SDKs and a CLI.

Install
npx -y firecrawl-cli@latest
For an agent

Use it to collect reference sites or docs for an agent as clean text. Respect each site's terms and robots rules.

Why it is here. It is a standard tool for turning websites into agent input.

Install command, framework, licence and component list.
Notable for
  • Search
  • scrape
  • and crawl
  • Open source
  • 190
  • 000 GitHub stars
Provenance

Verified 2026-10-09. HTTP 200. https://www.firecrawl.dev/ (HTTP 200, page fetched 2026-10-09), https://github.com/firecrawl/firecrawl (GitHub API, 189616 stars), depo.zip listing https://www.depo.zip/tools/j571rareykg7vghxzskq4d8ted7xcggg

Related resourcesUtilities & Naming