org.apache.tez.mapreduce.examples

Class CartesianProduct

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.tez.examples.TezExampleBase

org.apache.tez.mapreduce.examples.CartesianProduct

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool

public class CartesianProduct
extends TezExampleBase

This job has three vertices: two Tokenizers and one JoinProcessor. Each Tokenizer handles one input directory and generates tokens. CustomPartitioner separates tokens into 2 partitions according to the parity of token's first char. Then JoinProcessor does cartesian product of partitioned token sets.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	CartesianProduct.FakeInput
static class	CartesianProduct.FakeInputInitializer
static class	CartesianProduct.FakeOutput
static class	CartesianProduct.FakeOutputCommitter
static class	CartesianProduct.JoinProcessor
static class	CartesianProduct.TokenProcessor

Field Summary

Fields inherited from class org.apache.tez.examples.TezExampleBase

COUNTER_LOG, DISABLE_SPLIT_GROUPING, GENERATE_SPLIT_IN_CLIENT, LEAVE_AM_RUNNING, LOCAL_MODE, RECONNECT_APP_ID

Constructor Summary

Constructors

Constructor and Description
CartesianProduct()

Method Summary

Modifier and Type	Method and Description
static void	main(String[] args)
protected void	printUsage()
protected int	runJob(String[] args, TezConfiguration tezConf, TezClient tezClient)
protected int	validateArgs(String[] otherArgs)

Methods inherited from class org.apache.tez.examples.TezExampleBase

getAppId, isCountersLog, isDisableSplitGrouping, isGenerateSplitInClient, printExtraOptionsUsage, run, run, runDag

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hadoop.conf.Configurable

getConf, setConf

Constructor Detail

CartesianProduct

public CartesianProduct()

Method Detail

printUsage

protected void printUsage()

Specified by:

printUsage in class TezExampleBase

validateArgs

protected int validateArgs(String[] otherArgs)

Specified by:

validateArgs in class TezExampleBase

runJob

protected int runJob(String[] args,
                     TezConfiguration tezConf,
                     TezClient tezClient)
              throws Exception

Specified by:

runJob in class TezExampleBase

Throws:

Exception

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception