Udemy – Data Engineering – Apache Airflow 2024-4

Data Engineering – Apache Airflow is a course on how to orchestrate complex data workflows using Apache Airflow published by Udemy Online Academy. This is a practical, project-based course designed to teach you how to orchestrate complex data workflows using Apache Airflow. Whether you are a new data engineer or an experienced data engineer, this course will guide you through the core concepts, architecture, and real-world implementations of Airflow. You will gain hands-on experience building, planning, and managing workflows while learning how to troubleshoot, monitor, and scale data pipelines efficiently. By the end, you will be well-equipped to implement Airflow in professional data engineering environments.

You will learn the basics of workflow synchronization, how Apache Airflow DAGs work, how to schedule and automate data pipelines, how to install and configure Airflow in different environments, best practices for managing dependencies and operators, how to monitor task execution and handle failures, how to effectively use Airflow’s UI and CLI tools, and how to apply Airflow to real-world data engineering scenarios including ETL and data warehouse pipelines.

What you will learn in Data Engineering – Apache Airflow:

• For a basic understanding of workflows, basic features of Apache Airflow, core concepts, familiarity with the Airflow UI, XComs, variables, connection hooks
•  You will also learn how to install Apache Airflow on Linux/Ubuntu, in two different variants, Docker container installation and regular installation.
•  This course will help you increase your knowledge of ETL pipelines and how to set up these ETL pipelines in Airflow Dags.
•  Dags in this course also include practical examples from Apache Spark, Elasticsearch, Snowflake and Ecommerce Dags.
•  And…

Course specifications

Publisher: Udemy
Instructors: Eman Ali Mughal
Language: English
Level: Introductory
Number of Lessons: 34
Duration: 4 hours and 6 minutes

Course topics

Data Engineering – Apache Airflow Prerequisites

You should be familiar with Python, Scala Languages, Little bit of knowledge about concepts of Big Data, Some understanding about Apache Spark will be help full in understanding of this course.

Pictures

Data Engineering – Apache Airflow introduction video

Installation guide

After Extract, watch with your favorite Player.

Subtitle: None

Quality: 720p

Download link

Download Part 1 – 1 GB

Download Part 2 – 331 MB

Size

1.3 GB