GenericDeepJobConfig (deep core 0.2.9 API)

java.lang.Object
- com.stratio.deep.config.GenericDeepJobConfig<T>

All Implemented Interfaces:

IDeepJobConfig<T>, Serializable, AutoCloseable

Direct Known Subclasses:

CellDeepJobConfig, EntityDeepJobConfig
```
public abstract class GenericDeepJobConfig<T>
extends Object
implements IDeepJobConfig<T>, AutoCloseable
```
Base class for all config implementations providing default implementations for methods defined in IDeepJobConfig.

See Also:
Serialized Form

Field Summary

Fields
Modifier and Type Field and Description

protected Boolean isWriteConfig

Fields
Modifier and Type	Field and Description
`protected Boolean`	`isWriteConfig`

Constructor Summary

Constructors
Constructor and Description

GenericDeepJobConfig()

Constructors
Constructor and Description
`GenericDeepJobConfig()`

Method Summary

Methods
Modifier and Type	Method and Description
`IDeepJobConfig<T>`	`batchSize(int batchSize)`
`IDeepJobConfig<T>`	`bisectFactor(int bisectFactor)`
`protected void`	`checkInitialized()` Checks if this configuration object has been initialized or not.
`void`	`close()`
`Map<String,Cell>`	`columnDefinitions()`
`IDeepJobConfig<T>`	`columnFamily(String columnFamily)`
`IDeepJobConfig<T>`	`cqlPort(Integer port)`
`void`	`createOutputTableIfNeeded(org.apache.spark.rdd.RDD<scala.Tuple2<Cells,Cells>> tupleRDD)` Creates the output column family if not exists.
`IDeepJobConfig<T>`	`createTableOnWrite(Boolean createTableOnWrite)`
`com.datastax.driver.core.TableMetadata`	`fetchTableMetadata()` Fetches table metadata from the underlying datastore, using DataStax java driver.
`IDeepJobConfig<T>`	`filterByField(String filterColumnName, Serializable filterValue)`
`Map<String,Serializable>`	`getAdditionalFilters()`
`int`	`getBatchSize()`
`int`	`getBisectFactor()`
`String`	`getColumnFamily()`
`Integer`	`getCqlPort()`
`String`	`getHost()`
`String[]`	`getInputColumns()`
`Boolean`	`getIsWriteConfig()`
`String`	`getKeyspace()`
`int`	`getPageSize()`
`String`	`getPartitionerClassName()`
`String`	`getPassword()`
`String`	`getReadConsistencyLevel()`
`Integer`	`getRpcPort()`
`com.datastax.driver.core.Session`	`getSession()`
`String`	`getTable()`
`String`	`getUsername()`
`String`	`getWriteConsistencyLevel()`
`IDeepJobConfig<T>`	`host(String hostname)`
`IDeepJobConfig<T>`	`initialize()`
`IDeepJobConfig<T>`	`inputColumns(String... columns)`
`Boolean`	`isCreateTableOnWrite()`
`IDeepJobConfig<T>`	`keyspace(String keyspace)`
`IDeepJobConfig<T>`	`pageSize(int pageSize)`
`IDeepJobConfig<T>`	`partitioner(String partitionerClassName)`
`IDeepJobConfig<T>`	`password(String password)`
`IDeepJobConfig<T>`	`readConsistencyLevel(String level)`
`IDeepJobConfig<T>`	`rpcPort(Integer port)`
`IDeepJobConfig<T>`	`session(com.datastax.driver.core.Session session)`
`IDeepJobConfig<T>`	`table(String table)`
`IDeepJobConfig<T>`	`username(String username)`
`IDeepJobConfig<T>`	`writeConsistencyLevel(String level)`

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.stratio.deep.config.IDeepJobConfig
getEntityClass

- Field Detail
  - isWriteConfig
```
protected Boolean isWriteConfig
```
- Constructor Detail
  - GenericDeepJobConfig
```
public GenericDeepJobConfig()
```
- Method Detail
  - session
```
public IDeepJobConfig<T> session(com.datastax.driver.core.Session session)
```
    Specified by:
    
    session in interface IDeepJobConfig<T>
  - getSession
```
public com.datastax.driver.core.Session getSession()
```
    Specified by:
    
    getSession in interface IDeepJobConfig<T>
  - close
```
public void close()
```
    Specified by:
    
    close in interface AutoCloseable
  - checkInitialized
```
protected void checkInitialized()
```
    Checks if this configuration object has been initialized or not.
    
    Throws:
    
    DeepIllegalAccessException - if not initialized
  - fetchTableMetadata
```
public com.datastax.driver.core.TableMetadata fetchTableMetadata()
```
    Fetches table metadata from the underlying datastore, using DataStax java driver.
    
    Returns:
    the table metadata as returned by the driver.
  - createOutputTableIfNeeded
```
public void createOutputTableIfNeeded(org.apache.spark.rdd.RDD<scala.Tuple2<Cells,Cells>> tupleRDD)
```
    Creates the output column family if not exists.
    We first check if the column family exists.
    If not, we get the first element from tupleRDD and we use it as a template to get columns metadata.
    This is a very heavy operation since to obtain the schema we need to get at least one element of the output RDD.
    
    Parameters:
    tupleRDD - the pair RDD.
  - columnDefinitions
```
public Map<String,Cell> columnDefinitions()
```
    Specified by:
    
    columnDefinitions in interface IDeepJobConfig<T>
  - columnFamily
```
public IDeepJobConfig<T> columnFamily(String columnFamily)
```
    Specified by:
    
    columnFamily in interface IDeepJobConfig<T>
  - table
```
public IDeepJobConfig<T> table(String table)
```
    Specified by:
    
    table in interface IDeepJobConfig<T>
  - getColumnFamily
```
public String getColumnFamily()
```
    Specified by:
    
    getColumnFamily in interface IDeepJobConfig<T>
  - getTable
```
public String getTable()
```
    Specified by:
    
    getTable in interface IDeepJobConfig<T>
  - getHost
```
public String getHost()
```
    Specified by:
    
    getHost in interface IDeepJobConfig<T>
  - getInputColumns
```
public String[] getInputColumns()
```
    Specified by:
    
    getInputColumns in interface IDeepJobConfig<T>
  - getKeyspace
```
public String getKeyspace()
```
    Specified by:
    
    getKeyspace in interface IDeepJobConfig<T>
  - getPartitionerClassName
```
public String getPartitionerClassName()
```
    Specified by:
    
    getPartitionerClassName in interface IDeepJobConfig<T>
  - getPassword
```
public String getPassword()
```
    Specified by:
    
    getPassword in interface IDeepJobConfig<T>
  - getRpcPort
```
public Integer getRpcPort()
```
    Specified by:
    
    getRpcPort in interface IDeepJobConfig<T>
  - getCqlPort
```
public Integer getCqlPort()
```
    Specified by:
    
    getCqlPort in interface IDeepJobConfig<T>
  - getUsername
```
public String getUsername()
```
    Specified by:
    
    getUsername in interface IDeepJobConfig<T>
  - host
```
public IDeepJobConfig<T> host(String hostname)
```
    Specified by:
    
    host in interface IDeepJobConfig<T>
  - initialize
```
public IDeepJobConfig<T> initialize()
```
    Specified by:
    
    initialize in interface IDeepJobConfig<T>
  - inputColumns
```
public IDeepJobConfig<T> inputColumns(String... columns)
```
    Specified by:
    
    inputColumns in interface IDeepJobConfig<T>
  - keyspace
```
public IDeepJobConfig<T> keyspace(String keyspace)
```
    Specified by:
    
    keyspace in interface IDeepJobConfig<T>
  - bisectFactor
```
public IDeepJobConfig<T> bisectFactor(int bisectFactor)
```
    Specified by:
    
    bisectFactor in interface IDeepJobConfig<T>
  - partitioner
```
public IDeepJobConfig<T> partitioner(String partitionerClassName)
```
    Specified by:
    
    partitioner in interface IDeepJobConfig<T>
  - password
```
public IDeepJobConfig<T> password(String password)
```
    Specified by:
    
    password in interface IDeepJobConfig<T>
  - rpcPort
```
public IDeepJobConfig<T> rpcPort(Integer port)
```
    Specified by:
    
    rpcPort in interface IDeepJobConfig<T>
  - cqlPort
```
public IDeepJobConfig<T> cqlPort(Integer port)
```
    Specified by:
    
    cqlPort in interface IDeepJobConfig<T>
  - username
```
public IDeepJobConfig<T> username(String username)
```
    Specified by:
    
    username in interface IDeepJobConfig<T>
  - batchSize
```
public IDeepJobConfig<T> batchSize(int batchSize)
```
    Specified by:
    
    batchSize in interface IDeepJobConfig<T>
  - isCreateTableOnWrite
```
public Boolean isCreateTableOnWrite()
```
    Specified by:
    
    isCreateTableOnWrite in interface IDeepJobConfig<T>
  - createTableOnWrite
```
public IDeepJobConfig<T> createTableOnWrite(Boolean createTableOnWrite)
```
    Specified by:
    
    createTableOnWrite in interface IDeepJobConfig<T>
  - getAdditionalFilters
```
public Map<String,Serializable> getAdditionalFilters()
```
    Specified by:
    
    getAdditionalFilters in interface IDeepJobConfig<T>
  - getPageSize
```
public int getPageSize()
```
    Specified by:
    
    getPageSize in interface IDeepJobConfig<T>
  - filterByField
```
public IDeepJobConfig<T> filterByField(String filterColumnName,
                              Serializable filterValue)
```
    Specified by:
    
    filterByField in interface IDeepJobConfig<T>
  - pageSize
```
public IDeepJobConfig<T> pageSize(int pageSize)
```
    Specified by:
    
    pageSize in interface IDeepJobConfig<T>
  - getReadConsistencyLevel
```
public String getReadConsistencyLevel()
```
    Specified by:
    
    getReadConsistencyLevel in interface IDeepJobConfig<T>
  - getWriteConsistencyLevel
```
public String getWriteConsistencyLevel()
```
    Specified by:
    
    getWriteConsistencyLevel in interface IDeepJobConfig<T>
  - readConsistencyLevel
```
public IDeepJobConfig<T> readConsistencyLevel(String level)
```
    Specified by:
    
    readConsistencyLevel in interface IDeepJobConfig<T>
  - writeConsistencyLevel
```
public IDeepJobConfig<T> writeConsistencyLevel(String level)
```
    Specified by:
    
    writeConsistencyLevel in interface IDeepJobConfig<T>
  - getBatchSize
```
public int getBatchSize()
```
    Specified by:
    
    getBatchSize in interface IDeepJobConfig<T>
  - getIsWriteConfig
```
public Boolean getIsWriteConfig()
```
    Specified by:
    
    getIsWriteConfig in interface IDeepJobConfig<T>
  - getBisectFactor
```
public int getBisectFactor()
```
    Specified by:
    
    getBisectFactor in interface IDeepJobConfig<T>

Class GenericDeepJobConfig<T>

Field Summary

Constructor Summary

Method Summary

Methods inherited from class java.lang.Object

Methods inherited from interface com.stratio.deep.config.IDeepJobConfig

Field Detail

isWriteConfig

Constructor Detail

GenericDeepJobConfig

Method Detail

session

getSession

close

checkInitialized

fetchTableMetadata

createOutputTableIfNeeded

columnDefinitions

columnFamily

table

getColumnFamily

getTable

getHost

getInputColumns

getKeyspace

getPartitionerClassName

getPassword

getRpcPort

getCqlPort

getUsername

host

initialize

inputColumns

keyspace

bisectFactor

partitioner

password

rpcPort

cqlPort

username

batchSize

isCreateTableOnWrite

createTableOnWrite

getAdditionalFilters

getPageSize

filterByField

pageSize

getReadConsistencyLevel

getWriteConsistencyLevel

readConsistencyLevel

writeConsistencyLevel

getBatchSize

getIsWriteConfig

getBisectFactor