Overview
The Google BigQuery IK node for n8n allows you to interact with Google BigQuery tables. Specifically, the Record → Get Many operation retrieves multiple rows from a specified table within a dataset and project. This is useful for automating data extraction workflows, reporting, analytics, or integrating BigQuery data into other systems.
Practical examples:
- Fetching all user records from a BigQuery table for further processing in n8n.
- Extracting a subset of fields from a large dataset for reporting.
- Automating periodic exports of table data to another service.
Properties
| Name | Type | Meaning |
|---|---|---|
| Authentication | options | Selects the authentication method: OAuth2 (Recommended) or Service Account. Determines which credentials are used to access BigQuery. |
| Project Name or ID | options | The ID or name of the Google Cloud project containing the dataset. Required to specify the source of the data. |
| Dataset Name or ID | options | The ID or name of the dataset within the selected project. Required to locate the table. |
| Table Name or ID | options | The ID or name of the table within the selected dataset. Required to identify which table's records to retrieve. |
| Return All | boolean | If true, returns all available results; if false, limits the number of results based on the "Limit" property. |
| Limit | number | Maximum number of results to return when "Return All" is false. Must be at least 1. |
| Simplify | boolean | If true, returns a simplified version of the response (just the row data); if false, returns the raw API response structure. |
| Options: Fields | string | Comma-separated list of specific fields to return from each record. Supports selecting subfields (e.g., a,e.d.f). |
Output
- If Simplify is enabled:
- The output is an array of JSON objects, each representing a row from the table.
- Only the selected fields (if specified) are included in each object.
- Example:
[ { "id": 1, "name": "Alice", "email": "alice@example.com" }, { "id": 2, "name": "Bob", "email": "bob@example.com" } ]
- If Simplify is disabled:
- The output contains the raw structure as returned by the BigQuery API, which may include metadata and nested structures.
- In case of errors (and if "Continue On Fail" is enabled), the output will include an object with an
errorfield describing the issue.
Dependencies
- Google BigQuery API: Requires access to the Google Cloud project and BigQuery datasets/tables.
- Authentication: Either OAuth2 credentials or a Service Account key must be configured in n8n.
- n8n Credentials: You must set up either "Google BigQuery OAuth2 API" or "Google API" credentials in your n8n instance.
Troubleshooting
Common Issues:
- Invalid Credentials: Errors related to authentication usually mean the credentials are missing, expired, or lack required permissions.
- Resource Not Found: If the project, dataset, or table IDs are incorrect, you'll receive errors indicating the resource cannot be found.
- Insufficient Permissions: The authenticated user/service account must have permission to read from the specified table.
- API Quotas: Exceeding Google BigQuery API quotas can result in rate limit errors.
Error Messages:
"error": "Request had insufficient authentication scopes."- Ensure your credentials have the correct scopes for BigQuery access.
"error": "Not found: Table ..."- Double-check the project, dataset, and table IDs.
"error": "Quota exceeded ..."- Review your Google Cloud quota usage and adjust as needed.