Data Engineer Project: An end-to-end Airflow data pipeline with BigQuery, dbt Soda, and more!
🏆 BECOME A PRO WITH AIRFLOW: [ Ссылка ]
In the Retail data pipeline project, you will learn:
➡️ How to create a data pipeline in Airflow from scratch
➡️ How to set up your Airflow local environment with the Astro CLI
➡️ How to run data quality checks in your pipeline with Soda
➡️ How to integrate dbt and run your models with Airflow and Comos
➡️ How to isolate tasks to avoid dependency conflicts
➡️ How to upload a CSV file into Google Cloud Storage
➡️ How to ingest data into a BigQuery table using the Astro SDK
and more!
This a complete 1hr project just for you ❤️
Here are the steps with the code snippets:
[ Ссылка ]
Fasten your seatbelt, take a deep breath, and.... let's go!
