co.cask.cdap.data.stream

Class StreamInputSplitFinder<T>

java.lang.Object

co.cask.cdap.data.stream.StreamInputSplitFinder<T>

Type Parameters:

T - Type of input split to find. Expected to be either mapred.InputSplit or mapreduce.InputSplit.

public class StreamInputSplitFinder<T>
extends Object

Finds input splits for a stream given several stream configuration settings and the location of the stream. TODO: support multiple time ranges instead of just a single start and end.

See Also:

for details on stream file layout.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	StreamInputSplitFinder.Builder Builder for creating a split finder.

Method Summary

Methods

Modifier and Type	Method and Description
static StreamInputSplitFinder.Builder	builder(URI path) Get a builder for creating an input split finder for a stream.
List<T>	getSplits(Configuration conf) Get the input splits for a stream.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

getSplits

public List<T> getSplits(Configuration conf)
                  throws IOException

Get the input splits for a stream.

Parameters:

conf - Configuration of the filesystem the stream resides on.

Returns:

List of input splits for the stream.

Throws:

IOException

builder

public static StreamInputSplitFinder.Builder builder(URI path)

Get a builder for creating an input split finder for a stream.

Parameters:

path - path of the stream

Returns:

builder to create an input split finder for a stream.