Data Engineer Project: An end-to-end Airflow data pipeline with BigQuery, dbt Soda, and more!
🏆 BECOME A PRO WITH AIRFLOW: www.udemy.com/course/the-comp...
In the Retail data pipeline project, you will learn:
➡️ How to create a data pipeline in Airflow from scratch
➡️ How to set up your Airflow local environment with the Astro CLI
➡️ How to run data quality checks in your pipeline with Soda
➡️ How to integrate dbt and run your models with Airflow and Comos
➡️ How to isolate tasks to avoid dependency conflicts
➡️ How to upload a CSV file into Google Cloud Storage
➡️ How to ingest data into a BigQuery table using the Astro SDK
and more!
This a complete 1hr project just for you ❤️
Here are the steps with the code snippets:
robust-dinosaur-2ef.notion.si...
Fasten your seatbelt, take a deep breath, and.... let's go!
Негізгі бет Ғылым және технология Data Engineer Project: An end-to-end Airflow data pipeline with BigQuery, dbt Soda, and more!
Пікірлер: 183