using Python, Pandas, and SQLite

What is a ETL data pipeline?

Typical ETL data Pipeline/Process

An ETL (Data Extraction, Transformation, Loading) pipeline is a set of processes used to Extract, Transform, and Load data from a source to a target.

The source of the data can be from one or many sources, such as from an API call, CSV files, information within a database, and many more.

We take these sources of information then transform it in a way where it can be used immediately by another client, user or developer within some target storage.

In practice, an ETL pipeline is run infrequently. Generally there are large amounts of information…

Anthony Inthavong

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store