Databricks icon

Databricks

Interact with Databricks API
Join our community

Actions42

Overview

This node integrates with the Databricks platform, specifically supporting multiple resources including Unity Catalog. The "List Functions" operation under the Unity Catalog resource allows users to retrieve a list of functions defined within a specified schema of a Unity Catalog. This is useful for workflows that need to dynamically discover or audit available functions in a data catalog, automate metadata management, or integrate function metadata into other systems.

Practical examples:

  • Automatically fetching all functions in a schema to generate documentation.
  • Triggering downstream processes based on available functions in a catalog.
  • Auditing and compliance checks by listing functions and their details.

Properties

Name Meaning
Catalog Select a Unity Catalog to work with. The list is automatically populated from your Databricks workspace.
Schema Select a schema from the chosen catalog. The list is dynamically loaded based on the selected catalog.

Output

The output JSON contains an array of function objects retrieved from the specified schema within the Unity Catalog. Each item represents a function's metadata as returned by the Databricks Unity Catalog API. The exact structure depends on the API response but typically includes function names, definitions, and possibly comments or descriptions.

No binary data output is produced by this operation.

Dependencies

  • Requires an active Databricks account with access to Unity Catalog.
  • Needs an API authentication token (API key or bearer token) configured in n8n credentials to authorize requests.
  • The node uses the Databricks REST API endpoints under /api/2.1/unity-catalog/ to fetch catalogs, schemas, and functions.
  • Network connectivity to the Databricks workspace host URL is required.

Troubleshooting

  • Common issues:

    • Authentication failures due to invalid or expired API tokens.
    • Insufficient permissions to access Unity Catalog resources.
    • Network errors if the Databricks host URL is unreachable.
    • Empty results if the selected catalog or schema has no functions.

  • Error messages:

    • API Error: <status> <statusText>: Indicates the API responded with an error status code. Check credentials and permissions.
    • Network Error: No response received from server: Suggests connectivity issues or incorrect host URL.
    • Unsupported Genie operation: Not relevant here but indicates an unsupported operation if mistakenly used.

  • Resolutions:

    • Verify and update API credentials in n8n.
    • Confirm user permissions in Databricks for Unity Catalog access.
    • Ensure the correct workspace URL is set.
    • Validate that the catalog and schema selections are correct and contain functions.

Links and References

Discussion