Firecrawl

Turn entire websites into LLM-ready markdown or structured data

This is an exact mirror of the Firecrawl project, hosted at https://github.com/mendableai/firecrawl. SourceForge is not affiliated with Firecrawl.

Add a Review

Downloads: 9 This Week

Last Update: 4 days ago

Download

Get an email when there's a new version of Firecrawl

Linux Mac Windows

Crawl and convert any website into LLM-ready markdown or structured data. Built by Mendable.ai and the Firecrawl community. Includes powerful scraping, crawling, and data extraction capabilities. Firecrawl is an API service that takes a URL, crawls it, and converts it into clean markdown or structured data. We crawl all accessible subpages and give you clean data for each. No sitemap is required.

Features

Check Crawl Job
Used to crawl a URL and all accessible subpages
Documentation available
LLM Extraction
Documentation available
Examples included

Project Samples

Project Activity

See All Activity >

License

Affero GNU Public License

Follow Firecrawl

Firecrawl Web Site

Other Useful Business Software

The full-stack observability platform that protects your dataLayer, tags and conversion data

Stop losing revenue to bad data today. and protect your marketing data with Code-Cube.io.

Code-Cube.io detects issues instantly, alerts you in real time and helps you resolve them fast. No manual QA. No unreliable data. Just data you can trust and act on.

Learn More

Rate This Project

User Reviews

Be the first to post a review of Firecrawl!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

TypeScript

Related Categories

TypeScript Web Scrapers

Registered

2024-09-02

Similar Business Software

Gaffa

Gaffa is a REST API for browser automation that enables developers to control real, full browsers at scale with a single API call, eliminating the need to manage headless-browser frameworks, proxies, scaling, or infrastructure. It handles JavaScript rendering by default, ensuring that pages load...

See Software
Oxylabs

Oxylabs is a market leader in web intelligence with enterprise-grade, ethical, and compliant solutions. Its proxy infrastructure spans one of the largest global networks, offering residential, ISP, mobile, datacenter, & dedicated datacenter proxies, along with Web Unblocker – an AI-driven...

See Software
Crawler.sh

Crawler.sh is a fast, local-first web crawling and SEO analysis tool that enables users to crawl entire websites, extract clean content, and export structured data in seconds. It is available as both a command-line interface and a native desktop application, giving developers and SEO...

See Software
Firecrawl

Firecrawl is a web data platform that enables developers and AI applications to search, scrape, and interact with websites at scale through a unified API. The platform extracts clean, structured content from web pages and delivers it in formats such as Markdown, JSON, screenshots, and other...

See Software
Crawl4AI

Crawl4AI is an open source web crawler and scraper designed for large language models, AI agents, and data pipelines. It generates clean Markdown suitable for retrieval-augmented generation (RAG) pipelines or direct ingestion into LLMs, performs structured extraction using CSS, XPath, or...

See Software
Apify

Apify is a full-stack web scraping and automation platform helping anyone get value from the web. At its core is Apify Store, a marketplace with over 10,000 Actors where developers build, publish, and monetize automation tools. Actors are serverless cloud programs that extract data, automate...

See Software

Report inappropriate content

The full-stack observability platform that protects your dataLayer, tags and conversion data

Stop losing revenue to bad data today. and protect your marketing data with Code-Cube.io.

Code-Cube.io detects issues instantly, alerts you in real time and helps you resolve them fast. No manual QA. No unreliable data. Just data you can trust and act on.

Learn More

Recommended Projects

watercrawl
AI-ready web crawler that extracts and structures website content
Spider
High-performance Rust web crawler and scraper for large-scale data
Abot
Fast and flexible C# framework for building customizable web crawlers
Crawl4AI
Open-source LLM Friendly Web Crawler & Scraper
news-please
Python tool for crawling and extracting structured data from news site