Apify icon

Apify

Apify API

Overview

This node interacts with the Apify API to retrieve a list of datasets. It is useful for scenarios where you need to fetch datasets stored in Apify, such as for data analysis, reporting, or further processing in an automation workflow. For example, you can use it to get datasets with pagination support, control the number of datasets returned, and sort them by their start time.

Use Case Examples

  1. Fetching the first 100 datasets sorted by start time in descending order.
  2. Retrieving all datasets including unnamed ones for comprehensive data processing.

Properties

Name Meaning
Offset Number of array elements to skip at the start, used for pagination.
Limit Maximum number of datasets to return, with a default and maximum of 1000.
Desc Boolean flag to sort datasets by the 'startedAt' field in descending order if true; ascending order if false.
Unnamed Boolean flag to include all datasets if true; otherwise, only named datasets are returned.
Use Custom Body Flag to indicate whether to use a custom request body instead of default query parameters.

Output

JSON

  • datasets - Array of dataset objects returned from the Apify API.

Dependencies

  • Requires Apify API credentials for authentication.

Troubleshooting

  • Ensure the Apify API credentials are correctly configured to avoid authentication errors.
  • Check that the 'limit' parameter does not exceed the maximum allowed value (1000) to prevent request failures.
  • If no datasets are returned, verify the 'unnamed' flag and sorting parameters to ensure they match the expected dataset filtering criteria.

Links

Discussion