| Package | Description |
|---|---|
| co.cask.cdap.data.dataset |
This package contains implementations of the data set framework and built-in data sets.
|
| co.cask.cdap.data2.datafabric.dataset | |
| co.cask.cdap.data2.datafabric.dataset.service.mds | |
| co.cask.cdap.data2.dataset2 |
This package contains implementations of the dataset system v2.
|
| co.cask.cdap.data2.dataset2.lib.table | |
| co.cask.cdap.data2.dataset2.tx | |
| co.cask.cdap.data2.metadata.lineage | |
| co.cask.cdap.data2.metadata.store | |
| co.cask.cdap.data2.metadata.writer | |
| co.cask.cdap.data2.registry |
| Modifier and Type | Method and Description |
|---|---|
<T extends co.cask.cdap.api.dataset.DatasetAdmin> |
SystemDatasetInstantiator.getDatasetAdmin(Id.DatasetInstance datasetId) |
| Modifier and Type | Method and Description |
|---|---|
void |
RemoteDatasetFramework.addInstance(String datasetType,
Id.DatasetInstance datasetInstanceId,
co.cask.cdap.api.dataset.DatasetProperties props) |
void |
RemoteDatasetFramework.addModule(Id.DatasetModule moduleId,
co.cask.cdap.api.dataset.module.DatasetModule module) |
void |
RemoteDatasetFramework.addModule(Id.DatasetModule moduleId,
co.cask.cdap.api.dataset.module.DatasetModule module,
Location jarLocation) |
static void |
DatasetsUtil.createIfNotExists(DatasetFramework datasetFramework,
Id.DatasetInstance datasetInstanceId,
String typeName,
co.cask.cdap.api.dataset.DatasetProperties props)
Creates instance of the data set if not exists
|
void |
RemoteDatasetFramework.createNamespace(Id.Namespace namespaceId) |
void |
RemoteDatasetFramework.deleteAllInstances(Id.Namespace namespaceId) |
void |
RemoteDatasetFramework.deleteAllModules(Id.Namespace namespaceId) |
void |
RemoteDatasetFramework.deleteInstance(Id.DatasetInstance datasetInstanceId) |
void |
RemoteDatasetFramework.deleteModule(Id.DatasetModule moduleId) |
void |
RemoteDatasetFramework.deleteNamespace(Id.Namespace namespaceId) |
<T extends co.cask.cdap.api.dataset.DatasetAdmin> |
RemoteDatasetFramework.getAdmin(Id.DatasetInstance datasetInstanceId,
ClassLoader classLoader) |
<T extends co.cask.cdap.api.dataset.DatasetAdmin> |
RemoteDatasetFramework.getAdmin(Id.DatasetInstance datasetInstanceId,
ClassLoader parentClassLoader,
DatasetClassLoaderProvider classLoaderProvider) |
<T extends co.cask.cdap.api.dataset.Dataset> |
RemoteDatasetFramework.getDataset(Id.DatasetInstance datasetInstanceId,
Map<String,String> arguments,
ClassLoader classLoader) |
<T extends co.cask.cdap.api.dataset.Dataset> |
RemoteDatasetFramework.getDataset(Id.DatasetInstance datasetInstanceId,
Map<String,String> arguments,
ClassLoader classLoader,
DatasetClassLoaderProvider classLoaderProvider,
Iterable<? extends Id> owners) |
<T extends co.cask.cdap.api.dataset.Dataset> |
RemoteDatasetFramework.getDataset(Id.DatasetInstance datasetInstanceId,
Map<String,String> arguments,
ClassLoader classLoader,
Iterable<? extends Id> owners) |
co.cask.cdap.api.dataset.DatasetSpecification |
RemoteDatasetFramework.getDatasetSpec(Id.DatasetInstance datasetInstanceId) |
DatasetInstanceMDS |
DatasetMetaTableUtil.getInstanceMetaTable() |
Collection<DatasetSpecificationSummary> |
RemoteDatasetFramework.getInstances(Id.Namespace namespaceId) |
static <T extends co.cask.cdap.api.dataset.Dataset> |
DatasetsUtil.getOrCreateDataset(DatasetFramework datasetFramework,
Id.DatasetInstance datasetInstanceId,
String typeName,
co.cask.cdap.api.dataset.DatasetProperties props,
Map<String,String> arguments,
ClassLoader cl)
Gets instance of
Dataset, while add instance to
DatasetFramework and creating the physical data set
if that one doesn't exist. |
DatasetTypeMDS |
DatasetMetaTableUtil.getTypeMetaTable() |
boolean |
RemoteDatasetFramework.hasInstance(Id.DatasetInstance datasetInstanceId) |
boolean |
RemoteDatasetFramework.hasSystemType(String typeName) |
boolean |
RemoteDatasetFramework.hasType(Id.DatasetType datasetTypeId) |
static void |
DatasetMetaTableUtil.setupDatasets(DatasetFramework datasetFramework)
Adds datasets and types to the given
DatasetFramework used by dataset service mds. |
void |
RemoteDatasetFramework.updateInstance(Id.DatasetInstance datasetInstanceId,
co.cask.cdap.api.dataset.DatasetProperties props) |
| Modifier and Type | Method and Description |
|---|---|
protected MDSDatasets |
MDSDatasetsRegistry.createContext() |
| Modifier and Type | Class and Description |
|---|---|
class |
InstanceConflictException
Thrown when operation conflicts with existing dataset instances available in the system.
|
class |
ModuleConflictException
Thrown when operation conflicts with existing
DatasetModules
in the system. |
| Modifier and Type | Method and Description |
|---|---|
void |
DatasetFramework.addInstance(String datasetTypeName,
Id.DatasetInstance datasetInstanceId,
co.cask.cdap.api.dataset.DatasetProperties props)
Adds information about dataset instance to the system.
|
void |
InMemoryDatasetFramework.addInstance(String datasetType,
Id.DatasetInstance datasetInstanceId,
co.cask.cdap.api.dataset.DatasetProperties props) |
void |
DatasetFramework.addModule(Id.DatasetModule moduleId,
co.cask.cdap.api.dataset.module.DatasetModule module)
Adds dataset types by adding dataset module to the system.
|
void |
StaticDatasetFramework.addModule(Id.DatasetModule moduleId,
co.cask.cdap.api.dataset.module.DatasetModule module,
Location jarLocation) |
void |
DatasetFramework.addModule(Id.DatasetModule moduleId,
co.cask.cdap.api.dataset.module.DatasetModule module,
Location jarLocation)
Adds dataset types by adding dataset module to the system with a jar location containing all dataset classes
needed by the module.
|
void |
InMemoryDatasetFramework.addModule(Id.DatasetModule moduleId,
co.cask.cdap.api.dataset.module.DatasetModule module,
Location jarLocation) |
void |
StaticDatasetFramework.createNamespace(Id.Namespace namespaceId) |
void |
DatasetFramework.createNamespace(Id.Namespace namespaceId)
Creates a namespace in the Storage Providers - HBase/LevelDB, Hive and HDFS/Local File System.
|
void |
InMemoryDatasetFramework.createNamespace(Id.Namespace namespaceId) |
void |
DatasetFramework.deleteAllInstances(Id.Namespace namespaceId)
Deletes all dataset instances in the specified namespace.
|
void |
InMemoryDatasetFramework.deleteAllInstances(Id.Namespace namespaceId) |
void |
DatasetFramework.deleteAllModules(Id.Namespace namespaceId)
Deletes dataset modules and its types in the specified namespace.
|
void |
DatasetFramework.deleteInstance(Id.DatasetInstance datasetInstanceId)
Deletes dataset instance from the system.
|
void |
InMemoryDatasetFramework.deleteInstance(Id.DatasetInstance datasetInstanceId) |
void |
DatasetFramework.deleteModule(Id.DatasetModule moduleId)
Deletes dataset module and its types from the system.
|
void |
StaticDatasetFramework.deleteNamespace(Id.Namespace namespaceId) |
void |
DatasetFramework.deleteNamespace(Id.Namespace namespaceId)
Deletes a namespace in the Storage Providers - HBase/LevelDB, Hive and HDFS/Local File System.
|
void |
InMemoryDatasetFramework.deleteNamespace(Id.Namespace namespaceId) |
<T extends co.cask.cdap.api.dataset.DatasetAdmin> |
DatasetFramework.getAdmin(Id.DatasetInstance datasetInstanceId,
ClassLoader classLoader)
Gets dataset instance admin to be used to perform administrative operations.
|
<T extends co.cask.cdap.api.dataset.DatasetAdmin> |
DatasetFramework.getAdmin(Id.DatasetInstance datasetInstanceId,
ClassLoader classLoader,
DatasetClassLoaderProvider classLoaderProvider)
Gets dataset instance admin to be used to perform administrative operations.
|
<T extends co.cask.cdap.api.dataset.Dataset> |
DatasetFramework.getDataset(Id.DatasetInstance datasetInstanceId,
Map<String,String> arguments,
ClassLoader classLoader)
Gets dataset to be used to perform data operations.
|
<T extends co.cask.cdap.api.dataset.Dataset> |
DatasetFramework.getDataset(Id.DatasetInstance datasetInstanceId,
Map<String,String> arguments,
ClassLoader classLoader,
DatasetClassLoaderProvider classLoaderProvider,
Iterable<? extends Id> owners)
Gets dataset to be used to perform data operations.
|
<T extends co.cask.cdap.api.dataset.Dataset> |
DatasetFramework.getDataset(Id.DatasetInstance datasetInstanceId,
Map<String,String> arguments,
ClassLoader classLoader,
Iterable<? extends Id> owners)
Gets dataset to be used to perform data operations.
|
co.cask.cdap.api.dataset.DatasetSpecification |
DatasetFramework.getDatasetSpec(Id.DatasetInstance datasetInstanceId)
Gets the
DatasetSpecification for the specified dataset instance id |
Collection<DatasetSpecificationSummary> |
DatasetFramework.getInstances(Id.Namespace namespaceId)
Get all dataset instances in the specified namespace
|
boolean |
DatasetFramework.hasInstance(Id.DatasetInstance datasetInstanceId) |
boolean |
DatasetFramework.hasSystemType(String typeName)
Checks if the specified type exists in the 'system' namespace
|
boolean |
DatasetFramework.hasType(Id.DatasetType datasetTypeId)
Checks if the specified type exists in the specified namespace
|
void |
DatasetFramework.updateInstance(Id.DatasetInstance datasetInstanceId,
co.cask.cdap.api.dataset.DatasetProperties props)
Updates the existing dataset instance in the system.
|
void |
InMemoryDatasetFramework.updateInstance(Id.DatasetInstance datasetInstanceId,
co.cask.cdap.api.dataset.DatasetProperties props) |
| Modifier and Type | Method and Description |
|---|---|
co.cask.cdap.api.dataset.table.Table |
MetaTableUtil.getMetaTable() |
void |
MetaTableUtil.upgrade() |
| Modifier and Type | Method and Description |
|---|---|
protected abstract CONTEXT_TYPE |
TransactionalDatasetRegistry.createContext() |
<RETURN_TYPE> |
TransactionalDatasetRegistry.execute(TxCallable<CONTEXT_TYPE,RETURN_TYPE> tx) |
| Modifier and Type | Method and Description |
|---|---|
static void |
LineageStore.setupDatasets(DatasetFramework framework)
Adds datasets and types to the given
DatasetFramework. |
| Modifier and Type | Method and Description |
|---|---|
static void |
DefaultMetadataStore.setupDatasets(DatasetFramework framework)
Adds datasets and types to the given
DatasetFramework. |
| Modifier and Type | Method and Description |
|---|---|
void |
LineageWriterDatasetFramework.addInstance(String datasetTypeName,
Id.DatasetInstance datasetInstanceId,
co.cask.cdap.api.dataset.DatasetProperties props) |
void |
LineageWriterDatasetFramework.addModule(Id.DatasetModule moduleId,
co.cask.cdap.api.dataset.module.DatasetModule module) |
void |
LineageWriterDatasetFramework.addModule(Id.DatasetModule moduleId,
co.cask.cdap.api.dataset.module.DatasetModule module,
Location jarLocation) |
void |
LineageWriterDatasetFramework.createNamespace(Id.Namespace namespaceId) |
void |
LineageWriterDatasetFramework.deleteAllInstances(Id.Namespace namespaceId) |
void |
LineageWriterDatasetFramework.deleteAllModules(Id.Namespace namespaceId) |
void |
LineageWriterDatasetFramework.deleteInstance(Id.DatasetInstance datasetInstanceId) |
void |
LineageWriterDatasetFramework.deleteModule(Id.DatasetModule moduleId) |
void |
LineageWriterDatasetFramework.deleteNamespace(Id.Namespace namespaceId) |
<T extends co.cask.cdap.api.dataset.DatasetAdmin> |
LineageWriterDatasetFramework.getAdmin(Id.DatasetInstance datasetInstanceId,
ClassLoader classLoader) |
<T extends co.cask.cdap.api.dataset.DatasetAdmin> |
LineageWriterDatasetFramework.getAdmin(Id.DatasetInstance datasetInstanceId,
ClassLoader classLoader,
DatasetClassLoaderProvider classLoaderProvider) |
<T extends co.cask.cdap.api.dataset.Dataset> |
LineageWriterDatasetFramework.getDataset(Id.DatasetInstance datasetInstanceId,
Map<String,String> arguments,
ClassLoader classLoader) |
<T extends co.cask.cdap.api.dataset.Dataset> |
LineageWriterDatasetFramework.getDataset(Id.DatasetInstance datasetInstanceId,
Map<String,String> arguments,
ClassLoader classLoader,
DatasetClassLoaderProvider classLoaderProvider,
Iterable<? extends Id> owners) |
<T extends co.cask.cdap.api.dataset.Dataset> |
LineageWriterDatasetFramework.getDataset(Id.DatasetInstance datasetInstanceId,
Map<String,String> arguments,
ClassLoader classLoader,
Iterable<? extends Id> owners) |
co.cask.cdap.api.dataset.DatasetSpecification |
LineageWriterDatasetFramework.getDatasetSpec(Id.DatasetInstance datasetInstanceId) |
Collection<DatasetSpecificationSummary> |
LineageWriterDatasetFramework.getInstances(Id.Namespace namespaceId) |
boolean |
LineageWriterDatasetFramework.hasInstance(Id.DatasetInstance datasetInstanceId) |
boolean |
LineageWriterDatasetFramework.hasSystemType(String typeName) |
boolean |
LineageWriterDatasetFramework.hasType(Id.DatasetType datasetTypeId) |
void |
LineageWriterDatasetFramework.updateInstance(Id.DatasetInstance datasetInstanceId,
co.cask.cdap.api.dataset.DatasetProperties props) |
| Modifier and Type | Method and Description |
|---|---|
static void |
UsageRegistry.setupDatasets(DatasetFramework datasetFramework)
Adds datasets and types to the given
DatasetFramework used by usage registry. |
Copyright © 2016 Cask Data, Inc. Licensed under the Apache License, Version 2.0.