Overview
This node integrates with Decodo's Scraper API to fetch and scrape data from a specified URL. It is useful for scenarios where users want to extract web page content or structured data from websites without manually handling HTTP requests or parsing HTML. For example, it can be used to gather product information from e-commerce sites, collect news articles, or retrieve any publicly available web content for further processing in an automation workflow.
Properties
| Name | Meaning |
|---|---|
| URL | Target URL to scrape. The node sends this URL to the scraper service to retrieve its content. |
Output
The node outputs a JSON array where each item contains a data field holding the scraped content returned by the Decodo Scraper API. The structure of data depends on the response from the external scraping service and typically includes the extracted webpage data in a parsed format.
Example output JSON structure:
[
{
"data": { /* scraped content from the target URL */ }
}
]
No binary data output is produced by this node.
Dependencies
- Requires an active account with Decodo's Scraper API.
- Needs credentials consisting of a username and password (used as basic authentication).
- The node uses these credentials to authenticate API requests.
- No additional environment variables are required beyond the configured credentials.
Troubleshooting
- Authentication errors: If the node fails due to invalid credentials, verify that the username and password for the Decodo API are correct and have sufficient permissions.
- Invalid URL or unreachable site: Ensure the provided URL is valid and accessible from the network where n8n runs.
- API rate limits or service downtime: The external scraping service may impose rate limits or experience outages; check the service status if scraping fails unexpectedly.
- Unexpected response format: If the output data is empty or malformed, confirm that the target URL returns content compatible with the scraper API.
Links and References
- Decodo Scraper API Documentation (example placeholder link)
- n8n documentation on Using Credentials