OSS TanbouOverview
Apache Airflow is a platform for authoring, scheduling, and monitoring workflows as code. DAGs express tasks and dependencies, a scheduler and workers execute them, and the UI and CLI support progress monitoring and failure investigation.
Features and best fit
Based on official documentation; not hands-on tested · Content checked:
Manage workflow execution through DAGs, a scheduler, workers, and UI
Defining DAGs in Python makes workflows versionable, testable, and collaborative. The scheduler sends tasks to workers according to dependencies, while UI views cover DAG listings, asset dependencies, grids, and graphs. Operators and providers extend the platform to external services.
Sources: [1]
For orchestrating mostly stable batch, data, and ML workflows
It fits data pipelines, machine-learning workflows, and LLM processing sequences whose structure remains reasonably stable between runs. Airflow coordinates steps such as data preparation, tool calls, model invocation, and evaluation rather than acting as the agent itself.
Sources: [1]
Treat it as batch orchestration and use constrained installations
Airflow is not a streaming solution; even real-time data is commonly pulled from streams in batches. Large payloads should be delegated to specialized external services instead of passed directly between tasks. For repeatable PyPI installs, select a constraints file matching both Airflow and Python versions, and use Linux-based environments for production.
Sources: [1]
Official sources
- [1]Apache Airflow README(2026-09-13)
Supplemental curator note
Selected for preserving old URLs and versioned documentation through its move from Airbnb to an Apache TLP while expanding toward AI and ML orchestration.
Growth
Growth trends · Last 30 days
46,839 Stars
Trend data is still being collected.
Development activity
Last 90 days · weekly
- Commits (last 30 days)
- 582
- Open PRs
- 1,032
Development activity is still being collected.
Built with
Categories and tags
Categories
GitHub data
GitHub dataView detailed GitHub data
GitHub Topics
- airflow
- apache
- apache-airflow
- python
- scheduler
- workflow
- automation
- dag
- data-engineering
- data-integration
- data-orchestrator
- data-pipelines
- Stars
- 46,839
- Forks
- 17,821
- Watchers
- 794
- Open issues
- 1,103
- Primary language
- Python
- License
- Apache-2.0
- Repository last updated
- Sep 13, 2026
Explore next
- n8n204,140 Stars
A fair-code platform combining a visual canvas and code for service integrations, workflows, and AI agents.
TypeScript - Dify155,569 Stars
A visual LLM application platform combining AI workflows, RAG, agents, model management, and observability.
TypeScript - Home Assistant Core90,400 Stars
A Python home-automation backend connecting devices and services through integrations with local control and privacy first.
Python - Ansible70,666 Stars
An agentless SSH-based platform for configuration, deployment, cloud, and network automation using human-readable descriptions.
Python - Terraform49,648 Stars
An infrastructure-as-code tool using declarative configuration, execution plans, and dependency graphs to manage cloud and in-house systems.
Go
Report incorrect information
Tell us if any listing information is incorrect or outdated.