Whats ETL process?

ETL stand for Extract Transform Load. Sometimes we might need to load data from various sources like as API Databases and files during processing time ETL help make sure smooth process.

ETL Process

Imagine need to import 50 GB excel data to database. Through ETL we can done this operation smoothly. Lets explore how can possible.

• First need to load data on excel or prepare excel data. 
• Then filter data like as remove duplicate empty unnecessary data and sort data its optional. 
• Finally convert excel file into suitable like as CSV JSON etc and load data.

Since here huge data will be load so data uploading process should be asynchronous. Here cron job or queue will be helpful.

Tags:

Authors:

Category: