Dataiku DSS icon

Dataiku DSS

Use the Dataiku DSS API

Actions364

Overview

This node integrates with the Dataiku DSS API, allowing users to perform various operations on Dataiku DSS resources. Specifically for the Dataset resource and the List Datasets operation, it enables listing datasets within a specified project in Dataiku DSS.

Common scenarios where this node is beneficial include:

  • Automating retrieval of dataset lists from a Dataiku DSS project.
  • Integrating Dataiku DSS datasets into workflows for further processing or analysis.
  • Monitoring or auditing datasets available in a project programmatically.

Practical example:

  • A user wants to fetch all datasets from a particular project to trigger downstream data quality checks or reporting workflows.

Properties

Name Meaning
Project Key The unique identifier of the Dataiku DSS project from which to list datasets.
Query Parameters Optional additional parameters to filter or paginate the dataset list. Includes options such as:
- Active (boolean)
- Limit (number): Max number of results to return
- Page (number): Pagination page number
- Filter (string)
- Name (string)
- Only Monitored (boolean)
...and many others for fine-grained control over the query.

Output

The output is a JSON array where each item corresponds to a dataset retrieved from the specified project. The structure of each dataset object depends on the Dataiku DSS API response but typically includes metadata about each dataset such as its name, type, schema, and other relevant details.

No binary data output is associated with the "List Datasets" operation.

Dependencies

  • Requires an active connection to a Dataiku DSS instance.
  • Requires valid API credentials (an API key) for authentication with the Dataiku DSS API.
  • The node expects the Dataiku DSS server URL and user API key to be configured in the credentials.

Troubleshooting

  • Missing Credentials Error: If the API credentials are not provided or invalid, the node will throw an error indicating missing credentials.
  • Project Key Required: The operation requires a valid project key; omitting this will cause an error.
  • API Request Errors: Network issues, incorrect project keys, or insufficient permissions can cause API request failures. The node surfaces these errors with messages prefixed by "Error calling Dataiku DSS API".
  • Invalid Query Parameters: Providing unsupported or malformed query parameters may result in API errors.

To resolve common errors:

  • Ensure that the API key credential is correctly set up and has sufficient permissions.
  • Verify the project key is correct and accessible.
  • Check network connectivity to the Dataiku DSS server.
  • Review and validate any query parameters used.

Links and References

Discussion