Databricks icon

Databricks

Interact with Databricks API

Overview

The node provides integration with a vector search service within the Databricks platform. Specifically, the "Query Index" operation under the "Vector Search" resource allows users to perform similarity searches by querying a vector index with a given query vector. This is useful in scenarios such as semantic search, recommendation systems, or any application requiring nearest neighbor search in high-dimensional vector spaces.

For example, a user can input a vector representing a piece of text or an image and retrieve similar items from a pre-built vector index, enabling advanced search capabilities beyond keyword matching.

Properties

Name Meaning
Index Name The name of the vector search index to query. This identifies which index to search in.
Query Vector The vector (as a string) used to search for similar vectors within the specified index.

Output

The output contains a json field that holds the results of the vector similarity query. This typically includes matched vectors or items along with their similarity scores or distances. The exact structure depends on the API response but generally provides information about the closest matches found in the index.

If the node supports binary data output (not explicitly shown here), it would represent any associated binary content related to the search results, such as images or files linked to the matched vectors.

Dependencies

  • Requires an active connection to the Databricks platform.
  • Needs an API authentication token credential configured in n8n to authorize requests.
  • The base URL for API requests is derived from the user's Databricks host configuration.

Troubleshooting

  • Common Issues:

    • Incorrect or missing index name will cause the query to fail.
    • Malformed or invalid query vector format may result in errors or no results.
    • Authentication failures if the API token is invalid or expired.
    • Network connectivity issues to the Databricks API endpoint.
  • Error Messages:

    • Authorization errors indicate problems with the API token; re-authenticate or update credentials.
    • "Index not found" errors suggest the specified index name does not exist; verify the index name.
    • Validation errors on the query vector imply incorrect formatting; ensure the vector is properly serialized as expected by the API.

Links and References

Discussion