Google BigQuery IK icon

Google BigQuery IK

Consume Google BigQuery API (added support for query operation)

Actions3

Overview

The Google BigQuery IK node for n8n allows you to interact with Google BigQuery tables. Specifically, the Record → Get Many operation retrieves multiple rows from a specified table within a dataset and project. This is useful for automating data extraction workflows, reporting, analytics, or integrating BigQuery data into other systems.

Practical examples:

  • Fetching all user records from a BigQuery table for further processing in n8n.
  • Extracting a subset of fields from a large dataset for reporting.
  • Automating periodic exports of table data to another service.

Properties

Name Type Meaning
Authentication options Selects the authentication method: OAuth2 (Recommended) or Service Account. Determines which credentials are used to access BigQuery.
Project Name or ID options The ID or name of the Google Cloud project containing the dataset. Required to specify the source of the data.
Dataset Name or ID options The ID or name of the dataset within the selected project. Required to locate the table.
Table Name or ID options The ID or name of the table within the selected dataset. Required to identify which table's records to retrieve.
Return All boolean If true, returns all available results; if false, limits the number of results based on the "Limit" property.
Limit number Maximum number of results to return when "Return All" is false. Must be at least 1.
Simplify boolean If true, returns a simplified version of the response (just the row data); if false, returns the raw API response structure.
Options: Fields string Comma-separated list of specific fields to return from each record. Supports selecting subfields (e.g., a,e.d.f).

Output

  • If Simplify is enabled:
    • The output is an array of JSON objects, each representing a row from the table.
    • Only the selected fields (if specified) are included in each object.
    • Example:
      [
        { "id": 1, "name": "Alice", "email": "alice@example.com" },
        { "id": 2, "name": "Bob", "email": "bob@example.com" }
      ]
      
  • If Simplify is disabled:
    • The output contains the raw structure as returned by the BigQuery API, which may include metadata and nested structures.
  • In case of errors (and if "Continue On Fail" is enabled), the output will include an object with an error field describing the issue.

Dependencies

  • Google BigQuery API: Requires access to the Google Cloud project and BigQuery datasets/tables.
  • Authentication: Either OAuth2 credentials or a Service Account key must be configured in n8n.
  • n8n Credentials: You must set up either "Google BigQuery OAuth2 API" or "Google API" credentials in your n8n instance.

Troubleshooting

Common Issues:

  • Invalid Credentials: Errors related to authentication usually mean the credentials are missing, expired, or lack required permissions.
  • Resource Not Found: If the project, dataset, or table IDs are incorrect, you'll receive errors indicating the resource cannot be found.
  • Insufficient Permissions: The authenticated user/service account must have permission to read from the specified table.
  • API Quotas: Exceeding Google BigQuery API quotas can result in rate limit errors.

Error Messages:

  • "error": "Request had insufficient authentication scopes."
    • Ensure your credentials have the correct scopes for BigQuery access.
  • "error": "Not found: Table ..."
    • Double-check the project, dataset, and table IDs.
  • "error": "Quota exceeded ..."
    • Review your Google Cloud quota usage and adjust as needed.

Links and References

Discussion