Overview
The Local Data Extract node reads and extracts data from local files of various types including CSV, TXT, Excel (XLS/XLSX), and JSON. It supports automatic file type detection or manual specification, and offers configuration options tailored to each file type, such as delimiter and encoding for CSV/TXT, sheet and header row settings for Excel, and key path extraction for JSON. The node can limit the number of records read, include or exclude headers, add custom fields to the output, and format the output as either an array or an object. This node is useful for workflows that require importing and processing local data files for further automation or analysis.
Use Case Examples
- Extract data from a CSV file with custom delimiter and encoding to feed into a data transformation workflow.
- Read an Excel file specifying a particular sheet and header row to import structured data into a database.
- Parse a JSON file extracting nested data using a key path and flattening objects for easier processing.
Properties
| Name | Meaning |
|---|---|
| Basic Configuration | Core settings for file path, file type, header inclusion, and record limits. |
| CSV/TXT Configuration | Settings specific to CSV or TXT files including delimiter, encoding, quote and escape characters, and delimiter auto-detection. |
| Excel Configuration | Settings for reading Excel files including sheet name, header row, data start row, multi-header rows, and how to handle multiple sheets. |
| JSON Configuration | Settings for JSON files including key path extraction and whether to flatten nested objects. |
| Advanced Configuration | Advanced options including adding custom fields with specified names, values, and types, and choosing the output format as an array or object. |
Output
JSON
json- Extracted data records from the local file, formatted as an array or object depending on configuration.
Dependencies
- Local file system access to read files.
Troubleshooting
- File not found error if the specified file path does not exist or is incorrect. Verify the file path and permissions.
- Unsupported file type error if the file extension is not recognized or supported. Ensure the file is one of CSV, TXT, XLS, XLSX, or JSON.
- Parsing errors due to incorrect configuration such as wrong delimiter, encoding, or sheet name. Adjust the configuration parameters accordingly.
- Errors when custom fields are misconfigured or incompatible with the data. Validate custom field definitions and types.