Firecrawl MCP Server

Firecrawl MCP Server

A Model Context Protocol (MCP) server implementation that integrates with Firecrawl for web scraping capabilities.

Big thanks to @vrknetha, @knacklabs for the initial implementation!

What is Firecrawl MCP Server?

Firecrawl MCP Server is a powerful tool designed for web scraping, crawling, and data extraction. It leverages the Model Context Protocol to facilitate seamless integration with various applications, enabling users to gather and analyze web data efficiently. With its robust features, it caters to both developers and researchers looking to automate data collection from the web.

Features

• Web Scraping, Crawling, and Discovery: Efficiently gather data from websites.
• Search and Content Extraction: Find and extract relevant information from various sources.
• Deep Research and Batch Scraping: Conduct extensive research and scrape multiple pages simultaneously.
• Automatic Retries and Rate Limiting: Ensure reliable data collection with built-in error handling.
• Cloud and Self-Hosted Support: Flexibility to run on cloud or self-hosted environments.
• SSE Support: Utilize Server-Sent Events for real-time data streaming.

Play around with our MCP Server on MCP.so's playground or on Klavis AI.

How to Install Firecrawl MCP Server

Running with npx

env FIRECRAWL_API_KEY=fc-YOUR_API_KEY npx -y firecrawl-mcp

Manual Installation

npm install -g firecrawl-mcp

Running on Cursor

For Cursor version 0.45.6+, follow the Cursor MCP Server Configuration Guide for detailed instructions.

1. Open Cursor Settings
2. Go to Features > MCP Servers
3. Click "+ Add new global MCP server"
4. Enter the configuration code as specified.

Running on Windsurf

Add the following configuration to your ./codeium/windsurf/model_config.json:

{
  "mcpServers": {
    "mcp-server-firecrawl": {
      "command": "npx",
      "args": ["-y", "firecrawl-mcp"],
      "env": {
        "FIRECRAWL_API_KEY": "YOUR_API_KEY"
      }
    }
  }
}

Pricing

Firecrawl MCP Server offers various pricing tiers based on usage and features. For detailed pricing information, please visit the Firecrawl pricing page.

Helpful Tips

• API Key Management: Always keep your Firecrawl API key secure and do not expose it in public repositories.
• Rate Limits: Be mindful of the rate limits imposed by the Firecrawl API to avoid service interruptions.
• Batch Processing: Utilize batch scraping for efficiency when dealing with multiple URLs.
• Error Handling: Implement robust error handling in your scripts to manage retries and failures gracefully.

Frequently Asked Questions

What is the Firecrawl MCP Server used for?

The Firecrawl MCP Server is primarily used for web scraping, allowing users to extract data from websites efficiently.

How do I obtain my Firecrawl API key?

You can create an account on the Firecrawl website to obtain your API key.

Can I run Firecrawl MCP Server locally?

Yes, Firecrawl MCP Server can be run locally or in a cloud environment, depending on your needs.

What programming languages can I use with Firecrawl MCP Server?

Firecrawl MCP Server can be integrated with any programming language that supports HTTP requests, making it versatile for various applications.

Is there support for troubleshooting?

Yes, Firecrawl provides documentation and community support for troubleshooting common issues. You can also reach out to their support team for assistance.