co.cask.cdap.data2.dataset2.lib.partitioned

Class PartitionedFileSetDefinition

java.lang.Object

co.cask.cdap.api.dataset.lib.AbstractDatasetDefinition<co.cask.cdap.api.dataset.lib.PartitionedFileSet,co.cask.cdap.api.dataset.DatasetAdmin>

co.cask.cdap.data2.dataset2.lib.partitioned.PartitionedFileSetDefinition

All Implemented Interfaces:

co.cask.cdap.api.dataset.DatasetDefinition<co.cask.cdap.api.dataset.lib.PartitionedFileSet,co.cask.cdap.api.dataset.DatasetAdmin>

Direct Known Subclasses:

TimePartitionedFileSetDefinition

public class PartitionedFileSetDefinition
extends co.cask.cdap.api.dataset.lib.AbstractDatasetDefinition<co.cask.cdap.api.dataset.lib.PartitionedFileSet,co.cask.cdap.api.dataset.DatasetAdmin>

Defines the partitioned dataset type. At this time, the partitions are not managed by the partitioned dataset, so all admin is simply on the partition table. TODO rethink this

Field Summary

Fields

Modifier and Type	Field and Description
protected static String	FILESET_NAME
protected co.cask.cdap.api.dataset.DatasetDefinition<? extends co.cask.cdap.api.dataset.lib.FileSet,?>	filesetDef
protected co.cask.cdap.api.dataset.DatasetDefinition<? extends co.cask.cdap.api.dataset.lib.IndexedTable,?>	indexedTableDef
protected static String	PARTITION_TABLE_NAME

Fields inherited from interface co.cask.cdap.api.dataset.DatasetDefinition

NO_ARGUMENTS

Constructor Summary

Constructors

Constructor and Description
PartitionedFileSetDefinition(String name, co.cask.cdap.api.dataset.DatasetDefinition<? extends co.cask.cdap.api.dataset.lib.FileSet,?> filesetDef, co.cask.cdap.api.dataset.DatasetDefinition<? extends co.cask.cdap.api.dataset.lib.IndexedTable,?> indexedTableDef)

Method Summary

Methods

Modifier and Type	Method and Description
co.cask.cdap.api.dataset.DatasetSpecification	configure(String instanceName, co.cask.cdap.api.dataset.DatasetProperties properties)
co.cask.cdap.api.dataset.DatasetAdmin	getAdmin(co.cask.cdap.api.dataset.DatasetContext datasetContext, co.cask.cdap.api.dataset.DatasetSpecification spec, ClassLoader classLoader)
co.cask.cdap.api.dataset.lib.PartitionedFileSet	getDataset(co.cask.cdap.api.dataset.DatasetContext datasetContext, co.cask.cdap.api.dataset.DatasetSpecification spec, Map<String,String> arguments, ClassLoader classLoader)
protected com.google.inject.Provider<ExploreFacade>	getExploreProvider()
protected static Map<String,String>	updateArgumentsIfNeeded(Map<String,String> arguments, co.cask.cdap.api.dataset.lib.Partitioning partitioning)

Methods inherited from class co.cask.cdap.api.dataset.lib.AbstractDatasetDefinition

getName

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PARTITION_TABLE_NAME

protected static final String PARTITION_TABLE_NAME

See Also:

Constant Field Values

FILESET_NAME

protected static final String FILESET_NAME

See Also:

Constant Field Values

indexedTableDef

protected final co.cask.cdap.api.dataset.DatasetDefinition<? extends co.cask.cdap.api.dataset.lib.IndexedTable,?> indexedTableDef

filesetDef

protected final co.cask.cdap.api.dataset.DatasetDefinition<? extends co.cask.cdap.api.dataset.lib.FileSet,?> filesetDef

Constructor Detail

PartitionedFileSetDefinition

public PartitionedFileSetDefinition(String name,
                            co.cask.cdap.api.dataset.DatasetDefinition<? extends co.cask.cdap.api.dataset.lib.FileSet,?> filesetDef,
                            co.cask.cdap.api.dataset.DatasetDefinition<? extends co.cask.cdap.api.dataset.lib.IndexedTable,?> indexedTableDef)

Method Detail

configure

public co.cask.cdap.api.dataset.DatasetSpecification configure(String instanceName,
                                                      co.cask.cdap.api.dataset.DatasetProperties properties)

getAdmin

public co.cask.cdap.api.dataset.DatasetAdmin getAdmin(co.cask.cdap.api.dataset.DatasetContext datasetContext,
                                             co.cask.cdap.api.dataset.DatasetSpecification spec,
                                             ClassLoader classLoader)
                                               throws IOException

Throws:

IOException

getDataset

public co.cask.cdap.api.dataset.lib.PartitionedFileSet getDataset(co.cask.cdap.api.dataset.DatasetContext datasetContext,
                                                         co.cask.cdap.api.dataset.DatasetSpecification spec,
                                                         Map<String,String> arguments,
                                                         ClassLoader classLoader)
                                                           throws IOException

Throws:

IOException

updateArgumentsIfNeeded

protected static Map<String,String> updateArgumentsIfNeeded(Map<String,String> arguments,
                                         co.cask.cdap.api.dataset.lib.Partitioning partitioning)

getExploreProvider

protected com.google.inject.Provider<ExploreFacade> getExploreProvider()