ScrapingDog icon

ScrapingDog

Get data from ScrapingDog API
Join our community

Actions6

Overview

This node integrates with the ScrapingDog API to perform Google Search queries programmatically. It allows users to search Google for a specified keyword and retrieve structured search results, optionally including advanced featured snippets such as Ads, People Also Ask (PAA), Knowledge Graphs, and more.

Common scenarios where this node is beneficial include:

  • Automating market research by extracting search result data.
  • Monitoring SEO rankings or competitor presence on Google.
  • Gathering data for content creation or analysis.
  • Integrating Google search results into workflows without manual browsing.

For example, a user can input a keyword like "best laptops 2024", specify the number of results and page number, and receive a JSON array of search results that can be further processed or stored.

Properties

Name Meaning
Keyword The search term or phrase to query on Google.
Advance Search Boolean option to include advanced featured snippets in the results (Ads, PAA, Knowledge Graphs, etc).
Page The page number of search results to retrieve (1 to 10).
Location Geographic location to tailor the search results (e.g., Australia, Brazil, United States, United Kingdom, etc.).
Results Number of search results to return (options from 10 up to 100).

Output

The node outputs a JSON object containing the search results returned by the ScrapingDog API's Google Search endpoint. This typically includes an array of search result items with details such as titles, URLs, snippets, and possibly additional metadata depending on whether advanced search is enabled.

If advanced search is enabled, the output may also contain featured snippets like advertisements, People Also Ask questions, and knowledge graph information.

No binary data output is produced by this node.

Dependencies

  • Requires an active API key credential for the ScrapingDog API.
  • The node makes HTTP GET requests to https://api.scrapingdog.com/google with appropriate query parameters.
  • No additional environment variables are needed beyond the API key configuration.

Troubleshooting

  • Missing or invalid API key: The node requires a valid API key credential. Ensure the API key is correctly configured in n8n credentials.
  • Empty or incomplete results: If the keyword is empty or invalid, no results will be returned. Make sure the "Keyword" property is set and valid.
  • Rate limiting or quota exceeded: The ScrapingDog API may limit the number of requests. Check your API plan and usage limits.
  • Invalid page or results number: Only pages 1 to 10 and results between 10 and 100 are supported. Using values outside these ranges may cause errors or unexpected behavior.
  • Location not supported: Selecting an unsupported location code might lead to default or no location-based filtering.

Links and References

Discussion