Firecrawl icon

Firecrawl

Get data from Firecrawl API

Overview

The Firecrawl node is designed to interact with the Firecrawl API, allowing users to perform search operations and optionally scrape the results. This node is particularly useful for scenarios where users need to gather data from web searches, such as retrieving information about products, articles, or any other content available online. For example, a user might want to search for "latest technology news" and retrieve a list of relevant articles along with their publication dates.

Properties

Name Meaning
Query The search query that specifies what to look for.
Limit The maximum number of results to return (default is 50).
Time Based Search A parameter to filter search results based on time (e.g., past hour, past week).
Language The language code for the search results (default is English).
Country The country code to filter search results (default is US).
Additional Fields A collection of additional fields to send in the request body, including custom JSON properties.
Use Custom Body A boolean indicating whether to use a custom body for the request.

Output

The output of the Firecrawl node will be structured in JSON format, containing the search results based on the specified query and parameters. Each result typically includes details such as titles, URLs, snippets, and possibly other metadata related to the search. If the node can output binary data, it would likely represent files or images associated with the search results.

Dependencies

  • An API key credential is required to authenticate requests to the Firecrawl API.
  • Users must ensure that the base URL for the Firecrawl API is correctly configured, either through credentials or environment variables.

Troubleshooting

  • Common Issues: Users may encounter issues related to authentication if the API key is missing or incorrect. Additionally, if the query does not return results, it could be due to overly restrictive parameters.
  • Error Messages:
    • "Authentication failed": Ensure that the API key is valid and properly configured.
    • "No results found": Check the search query and parameters for accuracy and adjust them as necessary.

Links and References

Discussion