org.apache.tez.dag.app.dag.impl

Class TaskImpl

java.lang.Object

org.apache.tez.dag.app.dag.impl.TaskImpl

All Implemented Interfaces:

org.apache.hadoop.yarn.event.EventHandler<TaskEvent>, Task

public class TaskImpl
extends Object
implements Task, org.apache.hadoop.yarn.event.EventHandler<TaskEvent>

Implementation of Task interface.

Field Summary

Fields

Modifier and Type	Field and Description
protected AppContext	appContext
protected org.apache.hadoop.yarn.util.Clock	clock
protected org.apache.hadoop.conf.Configuration	conf
protected org.apache.hadoop.yarn.event.EventHandler	eventHandler
protected int	maxFailedAttempts
protected TaskCommunicatorManagerInterface	taskCommunicatorManagerInterface
protected TaskHeartbeatHandler	taskHeartbeatHandler

Constructor Summary

Constructors

Constructor and Description

TaskImpl(org.apache.tez.dag.records.TezVertexID vertexId, int taskIndex, org.apache.hadoop.yarn.event.EventHandler eventHandler, org.apache.hadoop.conf.Configuration conf, TaskCommunicatorManagerInterface taskCommunicatorManagerInterface, org.apache.hadoop.yarn.util.Clock clock, TaskHeartbeatHandler thh, AppContext appContext, boolean leafVertex, org.apache.hadoop.yarn.api.records.Resource resource, ContainerContext containerContext, StateChangeNotifier stateChangeNotifier, Vertex vertex)

Method Summary

Modifier and Type	Method and Description
boolean	canCommit(org.apache.tez.dag.records.TezTaskAttemptID taskAttemptID) Can the output of the taskAttempt be committed.
TaskAttempt	getAttempt(org.apache.tez.dag.records.TezTaskAttemptID attemptID)
Map<org.apache.tez.dag.records.TezTaskAttemptID,TaskAttempt>	getAttempts()
org.apache.tez.runtime.api.impl.TaskSpec	getBaseTaskSpec()
org.apache.tez.common.counters.TezCounters	getCounters()
List<String>	getDiagnostics()
long	getFinishTime()
long	getFirstAttemptStartTime()
TaskStateInternal	getInternalState()
float	getProgress()
TaskReport	getReport()
protected String	getSplitsAsString()
TaskState	getState()
TaskAttempt	getSuccessfulAttempt()
ArrayList<org.apache.tez.runtime.api.impl.TezEvent>	getTaskAttemptTezEvents(org.apache.tez.dag.records.TezTaskAttemptID attemptID, int fromEventId, int maxEvents)
org.apache.tez.dag.records.TezTaskID	getTaskId()
org.apache.tez.dag.api.TaskLocationHint	getTaskLocationHint()
Vertex	getVertex()
void	handle(TaskEvent event)
protected void	internalError(TaskEventType type)
protected void	internalErrorUncaughtException(TaskEventType type, Exception e)
boolean	isFinished() Has Task reached the final state or not.
protected void	logJobHistoryTaskFailedEvent(TaskState finalState)
protected void	logJobHistoryTaskFinishedEvent()
protected void	logJobHistoryTaskStartedEvent()
void	registerTezEvent(org.apache.tez.runtime.api.impl.TezEvent tezEvent)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

conf

protected final org.apache.hadoop.conf.Configuration conf

taskCommunicatorManagerInterface

protected final TaskCommunicatorManagerInterface taskCommunicatorManagerInterface

taskHeartbeatHandler

protected final TaskHeartbeatHandler taskHeartbeatHandler

eventHandler

protected final org.apache.hadoop.yarn.event.EventHandler eventHandler

maxFailedAttempts

protected final int maxFailedAttempts

clock

protected final org.apache.hadoop.yarn.util.Clock clock

appContext

protected final AppContext appContext

Constructor Detail

TaskImpl

public TaskImpl(org.apache.tez.dag.records.TezVertexID vertexId,
                int taskIndex,
                org.apache.hadoop.yarn.event.EventHandler eventHandler,
                org.apache.hadoop.conf.Configuration conf,
                TaskCommunicatorManagerInterface taskCommunicatorManagerInterface,
                org.apache.hadoop.yarn.util.Clock clock,
                TaskHeartbeatHandler thh,
                AppContext appContext,
                boolean leafVertex,
                org.apache.hadoop.yarn.api.records.Resource resource,
                ContainerContext containerContext,
                StateChangeNotifier stateChangeNotifier,
                Vertex vertex)

Method Detail

getState

public TaskState getState()

Specified by:

getState in interface Task

getAttempts

public Map<org.apache.tez.dag.records.TezTaskAttemptID,TaskAttempt> getAttempts()

Specified by:

getAttempts in interface Task

getAttempt

public TaskAttempt getAttempt(org.apache.tez.dag.records.TezTaskAttemptID attemptID)

Specified by:

getAttempt in interface Task

getVertex

public Vertex getVertex()

Specified by:

getVertex in interface Task

getTaskId

public org.apache.tez.dag.records.TezTaskID getTaskId()

Specified by:

getTaskId in interface Task

isFinished

public boolean isFinished()

Description copied from interface: Task

Has Task reached the final state or not.

Specified by:

isFinished in interface Task

getReport

public TaskReport getReport()

Specified by:

getReport in interface Task

getCounters

public org.apache.tez.common.counters.TezCounters getCounters()

Specified by:

getCounters in interface Task

getProgress

public float getProgress()

Specified by:

getProgress in interface Task

getTaskAttemptTezEvents

public ArrayList<org.apache.tez.runtime.api.impl.TezEvent> getTaskAttemptTezEvents(org.apache.tez.dag.records.TezTaskAttemptID attemptID,
                                                                                   int fromEventId,
                                                                                   int maxEvents)

Specified by:

getTaskAttemptTezEvents in interface Task

getBaseTaskSpec

public org.apache.tez.runtime.api.impl.TaskSpec getBaseTaskSpec()

Specified by:

getBaseTaskSpec in interface Task

getTaskLocationHint

public org.apache.tez.dag.api.TaskLocationHint getTaskLocationHint()

Specified by:

getTaskLocationHint in interface Task

getDiagnostics

public List<String> getDiagnostics()

Specified by:

getDiagnostics in interface Task

getFinishTime

public long getFinishTime()

Specified by:

getFinishTime in interface Task

getInternalState

public TaskStateInternal getInternalState()

canCommit

public boolean canCommit(org.apache.tez.dag.records.TezTaskAttemptID taskAttemptID)

Description copied from interface: Task

Can the output of the taskAttempt be committed. Note that once the task gives a go for a commit, further canCommit requests from any other attempts should return false.

Specified by:

canCommit in interface Task

Returns:

whether the attempt's output can be committed or not.

getSuccessfulAttempt

public TaskAttempt getSuccessfulAttempt()

Specified by:

getSuccessfulAttempt in interface Task

handle

public void handle(TaskEvent event)

Specified by:

handle in interface org.apache.hadoop.yarn.event.EventHandler<TaskEvent>

internalError

protected void internalError(TaskEventType type)

internalErrorUncaughtException

protected void internalErrorUncaughtException(TaskEventType type,
                                              Exception e)

getSplitsAsString

protected String getSplitsAsString()

Returns:

a String representation of the splits. Subclasses can override this method to provide their own representations of splits (if any).

logJobHistoryTaskStartedEvent

protected void logJobHistoryTaskStartedEvent()

logJobHistoryTaskFinishedEvent

protected void logJobHistoryTaskFinishedEvent()

logJobHistoryTaskFailedEvent

protected void logJobHistoryTaskFailedEvent(TaskState finalState)

registerTezEvent

public void registerTezEvent(org.apache.tez.runtime.api.impl.TezEvent tezEvent)

Specified by:

registerTezEvent in interface Task

getFirstAttemptStartTime

public long getFirstAttemptStartTime()

Specified by:

getFirstAttemptStartTime in interface Task