Dataiku DSS icon

Dataiku DSS

Use the Dataiku DSS API

Actions364

Overview

This node integrates with the Dataiku DSS API, enabling users to interact programmatically with various Dataiku DSS resources and operations. Specifically, for the Data Quality resource and the Get Last Outcome on Specific Partition operation, the node retrieves the most recent status of computed data quality rules on a specified dataset partition within a project.

This functionality is beneficial in scenarios where you want to monitor or audit the latest data quality results for specific partitions of datasets, such as checking if recent data ingestions meet quality standards or triggering alerts based on the last validation outcomes.

Practical example:
You have a large dataset partitioned by date, and after each daily ingestion, you want to fetch the last data quality check results for that day's partition to ensure data integrity before downstream processing.

Properties

Name Meaning
Project Key The unique identifier of the Dataiku DSS project containing the dataset.
Dataset Name The name of the dataset within the project for which to retrieve the last outcome.
Request Body A JSON object representing additional parameters or filters for the request (if applicable).

These properties are required to specify the exact dataset and project context for the data quality query.

Output

The node outputs the response from the Dataiku DSS API call related to the last outcome of computed data quality rules on a specific partition. The output is provided in the json field of the returned item.

  • The JSON structure contains detailed information about the status of data quality rules applied to the specified partition.
  • If the operation involves downloading files or binary content (not typical for this operation), the node would provide binary data accordingly, but for this operation, the output is JSON.

Dependencies

  • Requires an active connection to a Dataiku DSS instance.
  • Requires valid API credentials (an API key) for authentication with the Dataiku DSS API.
  • The node expects the Dataiku DSS server URL and user API key to be configured in the credentials.

Troubleshooting

  • Missing Credentials Error: If the API credentials are not set or invalid, the node will throw an error indicating missing credentials. Ensure that the API key credential is properly configured.
  • Required Parameter Missing: The node validates required parameters like Project Key and Dataset Name. Omitting these will cause errors specifying which parameter is missing.
  • API Errors: If the Dataiku DSS API returns an error (e.g., due to incorrect project or dataset names, or network issues), the node will throw an error with the message from the API. Check the correctness of input parameters and network connectivity.
  • Parsing Errors: If the API response is not valid JSON when expected, the node attempts to handle it gracefully but may return raw text. Verify the API endpoint and response format.

Links and References


Note: This summary focuses on the "Data Quality" resource and the "Get Last Outcome on Specific Partition" operation as requested, extracted from the provided source code and property definitions.

Discussion