Apache Spark vs MapReduce: When to Use Which
· 2 min read
Apache Spark has largely replaced MapReduce for new Hadoop workloads. But MapReduce is not dead — understanding when each is appropriate will help you build more efficient data pipelines.
2 posts tagged with "Performance"
Performance tuning and benchmarks
View All TagsYARN Containers Deep Dive: How Resource Allocation Really Works
· 6 min read
YARN (Yet Another Resource Negotiator) is Hadoop's cluster resource management layer. Understanding how YARN allocates containers — the fundamental unit of computation — is essential for getting good utilization and avoiding the frustrating "application is waiting for resources" message that plagues many clusters.