Overview
Apache Hadoop develops Hadoop Common, the HDFS distributed-storage layer, YARN resource management, MapReduce batch processing, and related tools in one source tree. These components support long-running clusters and existing Hadoop ecosystems.
Features and best fit
Based on official documentation; not hands-on tested · Content checked:
Compose distributed storage, resource management, and batch processing from modules
The repository's BUILDING.txt lists Hadoop Common, Hadoop HDFS, Hadoop YARN, Hadoop MapReduce, and supporting tools as major modules. A Maven reactor builds the source tree, with module tests and native components making it a large multi-module project.
Sources: [2]
For maintaining and extending established Hadoop data platforms
It fits organizations maintaining environments where large datasets live in HDFS and jobs run through YARN, pipelines depend on Hadoop APIs and tools, or an on-premises data platform has a long operating life. For a new deployment, compare the staffing and compatibility value against smaller architectures, object storage, and alternative query engines.
Sources: [2]
Start with release-specific official docs, not the eight-line README
The root README.txt only links the official website and wiki; it does not contain installation, configuration, or upgrade guidance. Building trunk requires Java, Maven, native toolchains, and other dependencies, while production operation should follow component-specific documentation and compatibility guidance for the selected release. The repository uses Apache-2.0.
Official sources
- [1]Apache Hadoop README.txt(2026-09-13)
- [2]Apache Hadoop BUILDING.txt(2026-09-13)
- [3]Apache Hadoop license(2026-09-13)
Supplemental curator note
Selected for a low-noise coined name with long-lived discovery, while its exceptionally sparse root README and topics shift authority to external official docs.
Growth
Growth trends · Last 30 days
15,658 Stars
Trend data is still being collected.
Development activity
Last 90 days · weekly
- Commits (last 30 days)
- 22
- Open PRs
- 226
Development activity is still being collected.
Built with
Categories and tags
Categories
GitHub data
GitHub dataView detailed GitHub data
GitHub Topics
- hadoop
- Stars
- 15,658
- Forks
- 9,242
- Watchers
- 954
- Open issues
- 0
- Primary language
- Java
- License
- Apache-2.0
- Repository last updated
- Sep 13, 2026
Explore next
- Apache Airflow46,842 Stars
A platform for defining DAGs in Python and scheduling, running, and monitoring batch, data, and ML workflows.
Python - Apache Spark43,989 Stars
A large-scale data-processing engine unifying SQL, DataFrames, batch, streaming, and machine learning.
Scala - Apache Kafka33,715 Stars
A distributed event-streaming platform for data pipelines, streaming analytics, and system integration.
Java - Apache Flink26,336 Stars
A stateful data framework for stream and batch processing with event time, windows, exactly-once guarantees, and back-pressure.
Java - RabbitMQ13,849 Stars
A broker server delivering asynchronous messages through queues and streams over AMQP, MQTT, STOMP, and other protocols.
JavaScript
Report incorrect information
Tell us if any listing information is incorrect or outdated.