public class DAGSchedulerNaturalOrderControlled
extends DAGScheduler
Schedules task attempts belonging to downstream vertices only after all attempts belonging to
upstream vertices have been scheduled. If there's a slow start or delayed start of a particular
vertex, this ensures that downstream tasks are not started before this
Some future enhancements
- consider cluster capacity - and be more aggressive about scheduling downstream tasks before
upstream tasks have completed.
- generic slow start mechanism across all vertices - independent of the type of edges.