Optimise large scheduled and ad hoc jobs through partitioning, locality, incremental work, shuffle reduction, checkpointing, and resource scheduling.
