co.cask.cdap.examples.fileset

Class WordCount

java.lang.Object

co.cask.cdap.internal.api.AbstractProgramDatasetConfigurable

co.cask.cdap.internal.api.AbstractPluginConfigurable<MapReduceConfigurer>

co.cask.cdap.api.mapreduce.AbstractMapReduce

co.cask.cdap.examples.fileset.WordCount

All Implemented Interfaces:

MapReduce, ProgramLifecycle<MapReduceContext>

public class WordCount
extends AbstractMapReduce

A simple word counter. It reads inputs from the "lines" FileSet and writes its output to the "counts" FileSet. The input and output path can be configured as runtime arguments:

• "dataset.lines.input.paths" for the input. Multiple paths can be given, separated by commas.
• "dataset.counts.output.path" for the output.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	WordCount.Counter A reducer that sums up the counts for each key.
static class	WordCount.Tokenizer A mapper that tokenizes each input line and emits each token with a value of 1.

Constructor Summary

Constructors

Constructor and Description
WordCount()

Method Summary

Modifier and Type	Method and Description
void	configure()
void	initialize()

Methods inherited from class co.cask.cdap.api.mapreduce.AbstractMapReduce

beforeSubmit, configure, destroy, getConfigurer, getContext, initialize, onFinish, setDescription, setDriverResources, setMapperResources, setName, setProperties, setReducerResources

Methods inherited from class co.cask.cdap.internal.api.AbstractPluginConfigurable

usePlugin, usePlugin, usePluginClass, usePluginClass

Methods inherited from class co.cask.cdap.internal.api.AbstractProgramDatasetConfigurable

addDatasetModule, addDatasetType, addStream, addStream, createDataset, createDataset, createDataset, createDataset

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WordCount

public WordCount()

Method Detail

configure

public void configure()

Overrides:

configure in class AbstractMapReduce

initialize

public void initialize()
                throws Exception

Overrides:

initialize in class AbstractMapReduce

Throws:

Exception