org.apache.samza.job.yarn

Class YarnContainerRunner

java.lang.Object

org.apache.samza.job.yarn.YarnContainerRunner

public class YarnContainerRunner
extends java.lang.Object

A Helper class to run container processes on Yarn. This encapsulates quite a bit of YarnContainer boiler plate.

Constructor Summary

Constructors

Constructor and Description
YarnContainerRunner(org.apache.samza.config.Config config, org.apache.hadoop.yarn.conf.YarnConfiguration yarnConfiguration) Create a new Runner from a Config.

Method Summary

Modifier and Type	Method and Description
void	runContainer(java.lang.String samzaContainerId, org.apache.hadoop.yarn.api.records.Container container, org.apache.samza.job.CommandBuilder cmdBuilder) Runs a process as specified by the command builder on the container.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

YarnContainerRunner

public YarnContainerRunner(org.apache.samza.config.Config config,
                           org.apache.hadoop.yarn.conf.YarnConfiguration yarnConfiguration)

Create a new Runner from a Config.

Parameters:

config - to instantiate the runner with

yarnConfiguration - the yarn config for the cluster to connect to.

Method Detail

runContainer

public void runContainer(java.lang.String samzaContainerId,
                         org.apache.hadoop.yarn.api.records.Container container,
                         org.apache.samza.job.CommandBuilder cmdBuilder)
                  throws org.apache.samza.clustermanager.SamzaContainerLaunchException

Runs a process as specified by the command builder on the container.

Parameters:

samzaContainerId - id of the samza Container to run (passed as a command line parameter to the process)

container - the samza container to run.

cmdBuilder - the command builder that encapsulates the command, and the context

Throws:

SamzaContainerLaunchException - when there's an exception in submitting the request to the RM.

org.apache.samza.clustermanager.SamzaContainerLaunchException