Apache Airflow Architecture & Key Components
2️⃣ Executor
Handles how and where tasks are executed (e.g., Local, Celery, Kubernetes).
Works closely with the scheduler.
Workers3️ 3️⃣
Execute individual tasks as directed by the executor.
Scalable depending on the execution environment.
4️ 4️⃣ Web Server
Provides a user-friendly UI to monitor DAGs, tasks, logs, and execution status.
Supports real-time interaction and control.
5️⃣ Metadata Database
Stores DAGs, task states, schedules, and logs.
Central to Airflow's state management using SQLAlchemy ORM.