org.apache.hadoop.mapreduce.v2.app.speculate

Class DefaultSpeculator

java.lang.Object

org.apache.hadoop.yarn.service.AbstractService

org.apache.hadoop.mapreduce.v2.app.speculate.DefaultSpeculator

All Implemented Interfaces:

Speculator, org.apache.hadoop.yarn.event.EventHandler<SpeculatorEvent>, org.apache.hadoop.yarn.service.Service

public class DefaultSpeculator
extends org.apache.hadoop.yarn.service.AbstractService
implements Speculator

Nested Class Summary

Nested classes/interfaces inherited from interface org.apache.hadoop.mapreduce.v2.app.speculate.Speculator

Speculator.EventType

Nested classes/interfaces inherited from interface org.apache.hadoop.yarn.service.Service

org.apache.hadoop.yarn.service.Service.STATE

Constructor Summary

Constructors

Constructor and Description
DefaultSpeculator(org.apache.hadoop.conf.Configuration conf, AppContext context)
DefaultSpeculator(org.apache.hadoop.conf.Configuration conf, AppContext context, org.apache.hadoop.yarn.Clock clock)
DefaultSpeculator(org.apache.hadoop.conf.Configuration conf, AppContext context, TaskRuntimeEstimator estimator, org.apache.hadoop.yarn.Clock clock)

Method Summary

Methods

Modifier and Type	Method and Description
protected void	addSpeculativeAttempt(org.apache.hadoop.mapreduce.v2.api.records.TaskId taskID)
boolean	eventQueueEmpty()
void	handle(SpeculatorEvent event)
void	handleAttempt(TaskAttemptStatusUpdateEvent.TaskAttemptStatus status)
void	scanForSpeculations()
void	start()
protected void	statusUpdate(TaskAttemptStatusUpdateEvent.TaskAttemptStatus reportedStatus, long timestamp) Absorbs one TaskAttemptStatus
void	stop()

Methods inherited from class org.apache.hadoop.yarn.service.AbstractService

getConfig, getName, getServiceState, getStartTime, init, register, unregister

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DefaultSpeculator

public DefaultSpeculator(org.apache.hadoop.conf.Configuration conf,
                 AppContext context)

DefaultSpeculator

public DefaultSpeculator(org.apache.hadoop.conf.Configuration conf,
                 AppContext context,
                 org.apache.hadoop.yarn.Clock clock)

DefaultSpeculator

public DefaultSpeculator(org.apache.hadoop.conf.Configuration conf,
                 AppContext context,
                 TaskRuntimeEstimator estimator,
                 org.apache.hadoop.yarn.Clock clock)

Method Detail

start

public void start()

Specified by:

start in interface org.apache.hadoop.yarn.service.Service

Overrides:

start in class org.apache.hadoop.yarn.service.AbstractService

stop

public void stop()

Specified by:

stop in interface org.apache.hadoop.yarn.service.Service

Overrides:

stop in class org.apache.hadoop.yarn.service.AbstractService

handleAttempt

public void handleAttempt(TaskAttemptStatusUpdateEvent.TaskAttemptStatus status)

Specified by:

handleAttempt in interface Speculator

eventQueueEmpty

public boolean eventQueueEmpty()

scanForSpeculations

public void scanForSpeculations()

statusUpdate

protected void statusUpdate(TaskAttemptStatusUpdateEvent.TaskAttemptStatus reportedStatus,
                long timestamp)

Absorbs one TaskAttemptStatus

Parameters:

reportedStatus - the status report that we got from a task attempt that we want to fold into the speculation data for this job

timestamp - the time this status corresponds to. This matters because statuses contain progress.

addSpeculativeAttempt

protected void addSpeculativeAttempt(org.apache.hadoop.mapreduce.v2.api.records.TaskId taskID)

handle

public void handle(SpeculatorEvent event)

Specified by:

handle in interface org.apache.hadoop.yarn.event.EventHandler<SpeculatorEvent>