Back to Workflows

CSV Data Processing

Data ProcessingAdvancedv2.1
Compare

Process CSV files from Google Drive, clean data, perform calculations, and save results to database with error handling.

Use Case

Automated daily processing of sales data from CSV files with validation and storage

Workflow Structure
This workflow consists of 5 nodes working together
1

Daily Schedule

Type: cron

Key Parameters:

rule
2

Get CSV Files

Type: googleDrive

Key Parameters:

operationfolderIdfilters
3

Parse CSV

Type: spreadsheetFile

Key Parameters:

operationoptions
4

Transform Data

Type: function

Key Parameters:

functionCode
5

Save to Database

Type: postgres

Key Parameters:

operationtablecolumns
Tags
csvgoogle-drivedatabasedata-cleaning
Workflow Details

Trigger Type

Schedule

Estimated Runtime

2-5 minutes

Node Count

5 nodes

Author

Data Team

Last Updated

1/20/2024

Actions
Add to Comparison