ScrapingDog icon

ScrapingDog

Get data from ScrapingDog API

Actions6

Overview

This node integrates with the ScrapingDog API to perform web data extraction tasks. Specifically, for the Bing Search resource and the Search operation, it allows users to programmatically query Bing's search engine and retrieve search results.

Typical use cases include:

  • Automating market research by gathering search result data.
  • Monitoring brand mentions or competitor information via Bing search.
  • Integrating Bing search results into workflows for content curation or analysis.

For example, a user can input a keyword like "latest smartphones," specify the country as "United States," choose how many results to return, and get structured search results from Bing without manual browsing.

Properties

Name Meaning
Keyword The search term or phrase to query on Bing.
Page The page number of search results to retrieve (options: 1 to 10).
Country The country context for the search, affecting localized results. Options include Australia, Brazil, Canada, China, France, Germany, India, Mexico, Italy, Japan, Russia, United States, United Kingdom.
Results Number of search results to return. Options range from 10 up to 100 in increments of 10.
Filters Advanced filtering options as a string, e.g., to filter by date ranges or other criteria.

Output

The node outputs JSON data containing the search results returned by the Bing Search API via ScrapingDog. The structure typically includes an array of search result items with details such as titles, URLs, snippets, and possibly metadata depending on the API response.

No binary data output is indicated for this operation.

Dependencies

  • Requires an active API key credential for the ScrapingDog service.
  • The node sends HTTP GET requests to the ScrapingDog API endpoint bing/search.
  • Network connectivity to the ScrapingDog API is necessary.
  • No additional environment variables are specified beyond the API key credential.

Troubleshooting

  • Empty or no results: Ensure the keyword is correctly specified and that the country and filters parameters are valid. Some combinations may yield no results.
  • API authentication errors: Verify that the API key credential is correctly configured and has sufficient permissions.
  • Rate limiting or quota exceeded: The ScrapingDog API may limit request rates; check your plan limits.
  • Invalid parameter values: Using unsupported page numbers, countries, or results counts may cause errors. Stick to the provided options.
  • Network issues: Confirm network access to the ScrapingDog API endpoint.

Links and References

Discussion