Use Firecrawl to scrape pages, search the web, crawl or map sites, and extract structured content. Configure a Firecrawl API key and the inputs for the selected operation. Status actions let a workflow follow asynchronous scrape, crawl, or extraction jobs.
Scrape pages, search the web, crawl entire sites, map URL structures, and extract structured data with AI.
Convert web pages to Markdown or HTML, including SEO metadata, Open Graph tags, and page information.
Inputs and outputsParameter Type Required Description urlstring Yes The URL to scrape content from (e.g., "https://example.com/page ") formatsjson No Output formats supplied by existing Firecrawl block configurations apiKeystring Yes Firecrawl API key
Parameter Type Description markdownstring Page content in markdown format htmlstring Raw HTML content of the page metadataobject Page metadata including SEO and Open Graph information ↳ title string Page title ↳ description string Page meta description ↳ language string Page language code (e.g., "en") ↳ sourceURL string Original source URL that was scraped ↳ statusCode number HTTP status code of the response ↳ keywords string Page meta keywords ↳ robots string Robots meta directive (e.g., "follow, index") ↳ ogTitle string Open Graph title ↳ ogDescription string Open Graph description ↳ ogUrl string Open Graph URL ↳ ogImage string Open Graph image URL ↳ ogLocaleAlternate array Alternate locale versions for Open Graph ↳ ogSiteName string Open Graph site name ↳ error string Error message if scrape failed
Scrape multiple URLs in a single batch job and retrieve structured content from each page.
Inputs and outputsParameter Type Required Description urlsjson Yes Array of URLs to scrape (e.g., ["https://example.com/page1 ", "https://example.com/page2 "]) formatsjson No Output formats for scraped content (e.g., ["markdown"], ["markdown", "html"]) onlyMainContentboolean No Extract only main content from pages maxConcurrencynumber No Maximum number of concurrent scrapes ignoreInvalidURLsboolean No Skip invalid URLs instead of failing the batch (default: true) zeroDataRetentionboolean No Enable zero data retention apiKeystring Yes Firecrawl API key
Parameter Type Description pagesarray Array of scraped pages with their content and metadata ↳ markdown string Page content in markdown format ↳ html string Processed HTML content of the page ↳ rawHtml string Unprocessed raw HTML content ↳ links array Array of links found on the page ↳ screenshot string Screenshot URL (expires after 24 hours) ↳ metadata object Page metadata from crawl operation ↳ title string Page title ↳ description string Page meta description ↳ language string Page language code ↳ sourceURL string Original source URL ↳ statusCode number HTTP status code ↳ ogLocaleAlternate array Alternate locale versions totalnumber Total number of pages attempted completednumber Number of pages successfully scraped invalidURLsarray URLs that were skipped because they were invalid
Check the status and retrieve results of a previously started Firecrawl batch scrape job by its job ID.
Inputs and outputsParameter Type Required Description jobIdstring Yes The ID of the batch scrape job to check apiKeystring Yes Firecrawl API key
Parameter Type Description statusstring Current batch scrape status (scraping, completed, or failed) totalnumber Total number of pages attempted completednumber Number of pages successfully scraped creditsUsednumber Credits consumed by the batch scrape expiresAtstring ISO timestamp when the batch scrape results expire nextstring URL to retrieve the next page of results when present pagesarray Array of scraped pages with their content and metadata ↳ markdown string Page content in markdown format ↳ html string Processed HTML content of the page ↳ rawHtml string Unprocessed raw HTML content ↳ links array Array of links found on the page ↳ screenshot string Screenshot URL (expires after 24 hours) ↳ metadata object Page metadata from crawl operation ↳ title string Page title ↳ description string Page meta description ↳ language string Page language code ↳ sourceURL string Original source URL ↳ statusCode number HTTP status code ↳ ogLocaleAlternate array Alternate locale versions
Search for information on the web using Firecrawl
Inputs and outputsParameter Type Required Description querystring Yes The search query to use apiKeystring Yes Firecrawl API key
Parameter Type Description dataarray Search results data with scraped content and metadata ↳ title string Search result title from search engine ↳ description string Search result description/snippet from search engine ↳ url string URL of the search result ↳ markdown string Page content in markdown; returned only when scraping was requested via the hidden scrapeOptions input ↳ html string Processed HTML content; returned only when "html" is among the scrape formats requested via the hidden scrapeOptions input ↳ rawHtml string Unprocessed raw HTML; returned only when "rawHtml" is among the scrape formats requested via the hidden scrapeOptions input ↳ links array Links found on the page; returned only when "links" is among the scrape formats requested via the hidden scrapeOptions input ↳ screenshot string Screenshot URL (expires after 24 hours); returned only when "screenshot" is among the scrape formats requested via the hidden scrapeOptions input ↳ metadata object Metadata about the search result page ↳ title string Page title ↳ description string Page meta description ↳ sourceURL string Original source URL ↳ statusCode number HTTP status code ↳ error string Error message if scrape failed
Crawl entire websites and extract structured content from all accessible pages
Inputs and outputsParameter Type Required Description urlstring Yes The website URL to crawl (e.g., "https://example.com " or "https://docs.example.com/guide ") limitnumber No Maximum number of pages to crawl (e.g., 50, 100, 500). Default: 100 maxDepthnumber No Maximum depth to crawl from the starting URL (e.g., 1, 2, 3). Controls how many levels deep to follow links formatsjson No Output formats for scraped content (e.g., ["markdown"], ["markdown", "html"], ["markdown", "links"]) promptstring No Natural-language crawl guidance supplied by existing configurations excludePathsjson No URL paths to exclude from crawling (e.g., ["/blog/", "/admin/ ", "/*.pdf"]) includePathsjson No URL paths to include in crawling (e.g., ["/docs/", "/api/ "]). Only these paths will be crawled onlyMainContentboolean No Extract only main content from pages apiKeystring Yes Firecrawl API Key
Parameter Type Description pagesarray Array of crawled pages with their content and metadata ↳ markdown string Page content in markdown format ↳ html string Processed HTML content of the page ↳ rawHtml string Unprocessed raw HTML content ↳ links array Array of links found on the page ↳ screenshot string Screenshot URL (expires after 24 hours) ↳ metadata object Page metadata from crawl operation ↳ title string Page title ↳ description string Page meta description ↳ language string Page language code ↳ sourceURL string Original source URL ↳ statusCode number HTTP status code ↳ ogLocaleAlternate array Alternate locale versions totalnumber Total number of pages found during crawl
Check the status and retrieve results of a previously started Firecrawl crawl job by its job ID.
Inputs and outputsParameter Type Required Description jobIdstring Yes The ID of the crawl job to check apiKeystring Yes Firecrawl API key
Parameter Type Description statusstring Current crawl status (scraping, completed, or failed) totalnumber Total number of pages attempted completednumber Number of pages successfully crawled creditsUsednumber Credits consumed by the crawl expiresAtstring ISO timestamp when the crawl results expire nextstring URL to retrieve the next page of results when present pagesarray Array of crawled pages with their content and metadata ↳ markdown string Page content in markdown format ↳ html string Processed HTML content of the page ↳ rawHtml string Unprocessed raw HTML content ↳ links array Array of links found on the page ↳ screenshot string Screenshot URL (expires after 24 hours) ↳ metadata object Page metadata from crawl operation ↳ title string Page title ↳ description string Page meta description ↳ language string Page language code ↳ sourceURL string Original source URL ↳ statusCode number HTTP status code ↳ ogLocaleAlternate array Alternate locale versions
Cancel an in-progress Firecrawl crawl job by its job ID.
Inputs and outputsParameter Type Required Description jobIdstring Yes The ID of the crawl job to cancel apiKeystring Yes Firecrawl API key
Parameter Type Description statusstring Status of the cancelled crawl job (e.g., "cancelled")
Get a complete list of URLs from any website quickly and reliably. Useful for discovering all pages on a site without crawling them.
Inputs and outputsParameter Type Required Description urlstring Yes The base URL to map and discover links from (e.g., "https://example.com ") searchstring No Filter results by relevance to a search term (e.g., "blog") sitemapstring No Controls sitemap usage: "skip", "include" (default), or "only" includeSubdomainsboolean No Whether to include URLs from subdomains (default: true) ignoreQueryParametersboolean No Exclude URLs containing query strings (default: true) limitnumber No Maximum number of links to return (e.g., 100, 1000, 5000). Max: 100,000, default: 5,000 timeoutnumber No Request timeout in milliseconds apiKeystring Yes Firecrawl API key
Parameter Type Description successboolean Whether the mapping operation was successful linksarray Array of discovered URLs from the website
Extract structured data from web pages using natural language prompts and JSON Schema.
Inputs and outputsParameter Type Required Description urlsjson Yes Array of URLs to extract data from (e.g., ["https://example.com/page1 ", "https://example.com/page2 "] or ["https://example.com/ *"]) promptstring No Natural language guidance for the extraction process schemajson No JSON Schema defining the structure of data to extract enableWebSearchboolean No Enable web search to find supplementary information (default: false) ignoreSitemapboolean No Ignore sitemap.xml files during scanning (default: false) includeSubdomainsboolean No Extend scanning to subdomains (default: true) showSourcesboolean No Return data sources in the response (default: false) ignoreInvalidURLsboolean No Skip invalid URLs in the array (default: true) apiKeystring Yes Firecrawl API key
Parameter Type Description successboolean Whether the extraction operation was successful dataobject Extracted structured data according to the schema or prompt
Check the status and retrieve results of a previously started Firecrawl extract job by its job ID.
Inputs and outputsParameter Type Required Description jobIdstring Yes The ID of the extract job to check apiKeystring Yes Firecrawl API key
Parameter Type Description statusstring Current extract status (processing, completed, failed, or cancelled) datajson Extracted structured data according to the schema or prompt expiresAtstring ISO timestamp when the extract results expire creditsUsednumber Number of credits used by the extract job tokensUsednumber Number of tokens used by the extract job
Autonomous web data extraction agent. Searches and gathers information based on natural language prompts without requiring specific URLs.
Inputs and outputsParameter Type Required Description promptstring Yes Natural language description of the data to extract (max 10,000 characters) urlsjson No Optional array of URLs to focus the agent on (e.g., ["https://example.com ", "https://docs.example.com "]) schemajson No JSON Schema defining the structure of data to extract maxCreditsnumber No Maximum credits to spend on this agent task strictConstrainToURLsboolean No If true, agent will only visit URLs provided in the urls array apiKeystring Yes Firecrawl API key
Parameter Type Description successboolean Whether the agent operation was successful statusstring Current status of the agent job (processing, completed, failed) dataobject Extracted data from the agent expiresAtstring Timestamp when the results expire (24 hours) sourcesobject Array of source URLs used by the agent
Parse uploaded documents (PDF, DOCX, HTML, etc.) into clean markdown using Firecrawl. Supports .html, .htm, .pdf, .docx, .doc, .odt, .rtf, .xlsx, .xls.
Inputs and outputsParameter Type Required Description filefile Yes Document file to be parsed formatsarray No Output formats to return (e.g., ["markdown"]). Defaults to markdown. onlyMainContentboolean No Exclude headers, navs, footers. Defaults to true. includeTagsarray No HTML tags to include excludeTagsarray No HTML tags to exclude timeoutnumber No Timeout in milliseconds (max 300000). Defaults to 30000. parsersarray No Parser configuration (e.g., [{ "type": "pdf" }]) removeBase64Imagesboolean No Remove base64 images, keep alt text. Defaults to true. blockAdsboolean No Block ads and popups. Defaults to true. proxystring No Proxy mode: "basic" or "auto" zeroDataRetentionboolean No Enable zero data retention. Defaults to false. apiKeystring Yes Firecrawl API key
Parameter Type Description markdownstring Parsed document content in markdown format summarystring Generated summary of the document htmlstring Processed HTML content rawHtmlstring Unprocessed raw HTML content screenshotstring Screenshot URL or base64 (when requested) linksarray URLs discovered in the document metadataobject Document metadata ↳ title string Document title ↳ description string Document description ↳ language string Document language code ↳ sourceURL string Source URL ↳ url string Final URL ↳ keywords string Document keywords ↳ statusCode number HTTP status code ↳ contentType string Document content type ↳ error string Error message if parse failed warningstring Warning message from the parse operation
Retrieve the remaining and allocated Firecrawl credits for the team.
Inputs and outputsParameter Type Required Description apiKeystring Yes Firecrawl API key
Parameter Type Description remainingCreditsnumber Number of credits remaining for the team planCreditsnumber Credits allocated in the current plan billingPeriodStartstring Start of the current billing period billingPeriodEndstring End of the current billing period