Technology · Ebook

Armada: Multi-Cluster Batch Scheduling at Scale

by Shriira Press

A practical, in-depth guide to Armada, the CNCF multi-cluster batch job scheduler from G-Research. Learn how Armada pools many Kubernetes clusters into one fair, high-throughput batch system: the global scheduler and pool-wide view, per-cluster executors, queues and weighted fair-sharing, priorities and preemption, multi-cluster placement, the event-driven Pulsar-backed architecture for massive scale, and operating Armada in production — for quantitative, scientific, ML, and large-scale data batch workloads.

Contents

1. 1Preface
2. 2Chapter 1 — What Armada Is
3. 3Chapter 2 — Batch Scheduling and Multi-Cluster
4. 4Chapter 3 — Armada Architecture
5. 5Chapter 4 — Jobs and Submission
6. 6Chapter 5 — Queues and Fair Sharing
7. 7Chapter 6 — Multi-Cluster Scheduling
8. 8Chapter 7 — The Executors
9. 9Chapter 8 — High Throughput and Scale
10. 10Chapter 9 — Operations and Observability
11. 11Chapter 10 — Armada in Practice