Autonomously navigate websites and extract structured data across pages. Use when the task requires navigation or no suitable ready-made workflow or data provider covers it.
日本語の概要は準備中です。原文の説明を表示しています。
Any live-web task via the Firecrawl CLI — including ordinary web research: searching the web, reading or extracting pages, gathering sources, discovering site URLs, bulk extraction, downloading a site, change alerts, or pages needing clicks/login — web only; local files route to firecrawl-parse. For US legal or regulatory questions use gov; for papers use firecrawl-research-index; for library, API, error, or bug questions use firecrawl-developer-index.
インストール方法を見るインストールする前に、エージェントに与えられる指示の中身を確認できます。
Search, scrape, and interact with the web. Returns clean markdown optimized for LLM context windows.
Run firecrawl --help or firecrawl <command> --help for full option details. For app integration or outcome workflows (research briefs, SEO audits, etc.), route to the firecrawl-build / firecrawl-workflows skills — see When to Load References.
Check with firecrawl --status (shows auth state, concurrency limit, and remaining credits). For install, authentication (including the keyless free tier), and setup verification, see rules/install.md. For output handling guidelines, see rules/security.md.
Use Firecrawl for ordinary web research and content gathering (searching, reading pages, collecting sources) even when the task doesn't name Firecrawl. Exception: tasks needing capabilities Firecrawl lacks.
For structured datasets, first check for a suitable workflow or data provider using the search skill. Read a known page directly; reuse a selected contract instead of repeating discovery.
Follow this escalation pattern:
list <provider> <capability> --pretty if its contract is missing, then execute with scrape <provider/capability> --options '<JSON>'. For a URL, scrape its content directly.map --search to find the right URL, then scrape it.--page plus --goal instead of doing repeated one-off scrapes.| Need | Command | When |
|---|---|---|
| Find pages on a topic | search | No specific URL yet |
| Find research papers | research | Biomedical/clinical/scientific literature — use the paper index |
| Answer a coding question | developer | Issues, merged PRs, READMEs, and docs — not a general web page |
| Find US law or regulation | gov | US statutes, regulations, codes, and court opinions |
| Get a page's content | scrape | Have a URL, page is static or JS-rendered |
| Find URLs within a site | map | Need to locate a specific subpage |
| Bulk extract a site section | crawl | Need many pages (e.g., all /docs/) |
| AI-powered data extraction | agent | Need structured data from complex sites |
| Interact with a page | scrape + interact | Content requires clicks, form fills, pagination, or login |
| Download a site to files | x download | Save an entire site as local files |
| Parse a local file | parse | File on disk (PDF, DOCX, XLSX, etc.) — not a URL |
| Watch pages for changes | monitor | Schedule recurring scrapes/crawls, diff against snapshots |
For detailed command reference, run firecrawl <command> --help.
For US legal or regulatory source discovery, start with firecrawl gov "<question, jurisdiction, and date>" --limit 10. If the user supplies a source URL, read it directly with scrape. Results are excerpts, not a guarantee of official-only sources or current governing law: verify the issuer, jurisdiction, enacted/effective status, and version before citing a controlling section and supporting passage. Ask for a missing jurisdiction before identifying the governing rule. Use general search for non-US questions or missing coverage; no hits does not establish that no applicable law exists.
Done when: the narrowest suitable command has completed the request, its output was inspected, and the answer cites the saved source files.
Scrape vs interact:
scrape first. It handles static pages and JS-rendered SPAs.scrape + interact when you need to interact with a page, such as clicking buttons, filling out forms, navigating through a complex site, infinite scroll, or when scrape fails to grab all the content you need.search — interact is for acting on a specific page.Monitor: Bias toward monitor when the user's goal is ongoing change detection, alerting, or repeated checks over time — not another one-off scrape. Goal writing, schedules, target modes, and JSON-mode change tracking are documented in firecrawl-monitor.
Reuse fetched content:
search --scrape already fetches full page content. Reuse it instead of re-scraping those URLs..firecrawl/ for existing data before fetching again.search discovers web results and tools, list reveals a selected tool's contract, and scrape <provider/capability> --options '<JSON>' executes it. Inspect only the contracts needed for the task.
A client context/output error does not prove the provider failed. Keep the request/scrape ID and inspect saved output or use scrape firecrawl/bash against the retained result before repeating the request. See large-result recovery. Do not assume the client can signal an overflow back to the tool, or that Bash supports search IDs or every provider's retained data.
search --categories research is a website filter, not the paper index.FIRECRAWL_API_KEY to .env, or choosing endpoint usage in product code -> the firecrawl-build skills (firecrawl-build-onboarding, -scrape, -search, -interact). They live in a separate repo; install with firecrawl setup build.firecrawl-workflows skills (already installed alongside this CLI skill). These skills infer from context first and ask only short blocking questions when needed.Unless the user specifies to return in context, write results to .firecrawl/ with -o. Add .firecrawl/ to .gitignore. Always quote URLs - shell interprets ? and & as special characters.
firecrawl search "react hooks" -o .firecrawl/search-react-hooks.json --json
firecrawl scrape "<url>" -o .firecrawl/page.md
Naming conventions:
.firecrawl/search-{query}.json
.firecrawl/search-{query}-scraped.json
.firecrawl/{site}-{path}.md
Read output files incrementally with grep, head, or bounded reads:
wc -l .firecrawl/file.md && head -50 .firecrawl/file.md
grep -n "keyword" .firecrawl/file.md
Single format outputs raw content. Multiple formats (e.g., --format markdown,links) output JSON. Use jq to work with JSON output, e.g. jq -r '.data.web[].url' .firecrawl/search.json.
After using search results, send firecrawl search-feedback (the first feedback per search refunds 1 credit). The full pattern, guard, and rules live in firecrawl-search.
For Alexandria feedback about a provider result or coverage gap (each refunds 1 credit, up to 10 per website and 100 per team each UTC day), see firecrawl-alexandria.
For non-search endpoint jobs, use firecrawl feedback <endpoint> <jobId> to send concise job-level feedback through /v2/feedback. Supported endpoints are search, scrape, parse, and map.
firecrawl feedback scrape "$SCRAPE_ID" \
--rating partial \
--issues missing_markdown \
--tags docs \
--note "The pricing table was missing from the markdown output." \
--url "https://example.com/pricing" \
--page-numbers 1 \
--silent &
Keep generic feedback small: issue codes, tags, short notes, URLs, page numbers, and small metadata objects — never raw scrape/parse outputs or full page contents.
Opt out: export FIRECRAWL_NO_ENDPOINT_FEEDBACK=1 makes the CLI skip every endpoint feedback call silently. Respect that flag — do not try to work around it.
Run independent operations in parallel. Check firecrawl --status for concurrency limit:
firecrawl scrape "<url-1>" -o .firecrawl/1.md &
firecrawl scrape "<url-2>" -o .firecrawl/2.md &
firecrawl scrape "<url-3>" -o .firecrawl/3.md &
wait
For interact, scrape multiple pages and interact with each independently using their scrape IDs.
firecrawl credit-usage
firecrawl credit-usage --json --pretty -o .firecrawl/credits.json
まだレビューはありません。使ってみた感想をお寄せください。
概要と使いどころ
Autonomously navigate websites and extract structured data across pages. Use when the task requires navigation or no suitable ready-made workflow or data provider covers it.
日本語の概要は準備中です。原文の説明を表示しています。
Find a direct path to structured data through ready-made workflows, data APIs, and indexes. Follow the search skill to discover and inspect tools, then the scrape skill to execute them.
日本語の概要は準備中です。原文の説明を表示しています。
Bulk-extract many pages from one site or section. Use for "crawl", "everything under /docs", or content spanning linked pages.
日本語の概要は準備中です。原文の説明を表示しています。
Search an index of public repositories, GitHub issues, merged pull requests, repository READMEs, and curated documentation sites. Use when a programming question needs external documentation or upstream evidence.
日本語の概要は準備中です。原文の説明を表示しています。
Save a site or section as local files (markdown, screenshots). Use for "download the site", offline docs, or a local copy for reference.
日本語の概要は準備中です。原文の説明を表示しています。
Drive a live browser on a scraped page: click, fill forms, log in, paginate, infinite-scroll. Use when content requires interaction or a scrape failed or returned incomplete content.
日本語の概要は準備中です。原文の説明を表示しています。