Firecrawl icon

Firecrawl

Get data from Firecrawl API

Overview

The node "Firecrawl" is designed to interact with the Firecrawl API, specifically to retrieve the status of a crawl job. This is useful in scenarios where users need to monitor or check the progress and results of web crawling tasks initiated through Firecrawl. For example, after starting a crawl job on a website, a user can use this node to fetch the current status by providing the unique Crawl ID.

Properties

Name Meaning
Crawl ID The unique identifier of the crawl job for which the status is requested.
Use Custom Body A boolean option indicating whether to send a custom request body (true) or not (false).
  • Crawl ID is required and must be provided to specify which crawl job's status to retrieve.
  • Use Custom Body defaults to false; typically, no custom body is needed for this GET operation.

Output

The node outputs JSON data representing the status of the specified crawl job. This JSON will include details such as the current state of the crawl, any errors encountered, progress metrics, or results summary depending on the Firecrawl API response structure.

No binary data output is indicated or expected from this operation.

Dependencies

  • Requires an active connection to the Firecrawl API.
  • An API authentication token or key credential must be configured in n8n to authorize requests.
  • The base URL used for requests is https://api.firecrawl.dev/v1.

Troubleshooting

  • Missing or invalid Crawl ID: The node requires a valid Crawl ID. Ensure the ID is correctly copied and corresponds to an existing crawl job.
  • Authentication errors: If the API key or token is missing or invalid, the node will fail to authenticate. Verify that the API credentials are properly set up in n8n.
  • Network issues: Connectivity problems may cause request failures. Check network access to the Firecrawl API endpoint.
  • Unexpected API responses: If the API changes or returns errors, verify the API documentation and ensure the node’s version is compatible.

Links and References

Discussion