GenericDeepJobConfig (deep core 0.3.2 API)

java.lang.Object
- com.stratio.deep.config.GenericDeepJobConfig<T>

All Implemented Interfaces:

ICassandraDeepJobConfig<T>, IDeepJobConfig<T,ICassandraDeepJobConfig<T>>, Serializable, AutoCloseable

Direct Known Subclasses:

CellDeepJobConfig, EntityDeepJobConfig
```
public abstract class GenericDeepJobConfig<T>
extends Object
implements ICassandraDeepJobConfig<T>, AutoCloseable
```
Base class for all config implementations providing default implementations for methods defined in IDeepJobConfig.

See Also:
Serialized Form

Field Summary

Fields
Modifier and Type Field and Description

protected Boolean isWriteConfig

Fields
Modifier and Type	Field and Description
`protected Boolean`	`isWriteConfig`

Constructor Summary

Constructors
Constructor and Description

GenericDeepJobConfig()

Constructors
Constructor and Description
`GenericDeepJobConfig()`

Method Summary

Methods
Modifier and Type	Method and Description
`ICassandraDeepJobConfig<T>`	`batchSize(int batchSize)`
`ICassandraDeepJobConfig<T>`	`bisectFactor(int bisectFactor)`
`protected void`	`checkInitialized()` Checks if this configuration object has been initialized or not.
`void`	`close()`
`Map<String,Cell>`	`columnDefinitions()`
`ICassandraDeepJobConfig<T>`	`columnFamily(String columnFamily)`
`ICassandraDeepJobConfig<T>`	`cqlPort(Integer port)`
`void`	`createOutputTableIfNeeded(org.apache.spark.rdd.RDD<scala.Tuple2<Cells,Cells>> tupleRDD)` Creates the output column family if not exists.
`ICassandraDeepJobConfig<T>`	`createTableOnWrite(Boolean createTableOnWrite)`
`com.datastax.driver.core.TableMetadata`	`fetchTableMetadata()` Fetches table metadata from the underlying datastore, using DataStax java driver.
`ICassandraDeepJobConfig<T>`	`filterByField(String filterColumnName, Serializable filterValue)`
`Map<String,Serializable>`	`getAdditionalFilters()`
`int`	`getBatchSize()`
`int`	`getBisectFactor()`
`String`	`getColumnFamily()`
`Integer`	`getCqlPort()`
`String`	`getHost()`
`String[]`	`getInputColumns()`
`Boolean`	`getIsWriteConfig()`
`String`	`getKeyspace()`
`int`	`getPageSize()`
`String`	`getPartitionerClassName()`
`String`	`getPassword()`
`String`	`getReadConsistencyLevel()`
`Integer`	`getRpcPort()`
`com.datastax.driver.core.Session`	`getSession()`
`String`	`getTable()`
`String`	`getUsername()`
`String`	`getWriteConsistencyLevel()`
`ICassandraDeepJobConfig<T>`	`host(String hostname)`
`ICassandraDeepJobConfig<T>`	`initialize()`
`ICassandraDeepJobConfig<T>`	`inputColumns(String... columns)`
`Boolean`	`isCreateTableOnWrite()`
`ICassandraDeepJobConfig<T>`	`keyspace(String keyspace)`
`ICassandraDeepJobConfig<T>`	`pageSize(int pageSize)`
`ICassandraDeepJobConfig<T>`	`partitioner(String partitionerClassName)`
`ICassandraDeepJobConfig<T>`	`password(String password)`
`ICassandraDeepJobConfig<T>`	`readConsistencyLevel(String level)`
`ICassandraDeepJobConfig<T>`	`rpcPort(Integer port)`
`ICassandraDeepJobConfig<T>`	`session(com.datastax.driver.core.Session session)`
`ICassandraDeepJobConfig<T>`	`table(String table)`
`ICassandraDeepJobConfig<T>`	`username(String username)`
`ICassandraDeepJobConfig<T>`	`writeConsistencyLevel(String level)`

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.stratio.deep.config.IDeepJobConfig
getEntityClass

- Field Detail
  - isWriteConfig
```
protected Boolean isWriteConfig
```
- Constructor Detail
  - GenericDeepJobConfig
```
public GenericDeepJobConfig()
```
- Method Detail
  - session
```
public ICassandraDeepJobConfig<T> session(com.datastax.driver.core.Session session)
```
    Specified by:
    
    session in interface ICassandraDeepJobConfig<T>
  - getSession
```
public com.datastax.driver.core.Session getSession()
```
    Specified by:
    
    getSession in interface ICassandraDeepJobConfig<T>
  - close
```
public void close()
```
    Specified by:
    
    close in interface AutoCloseable
  - checkInitialized
```
protected void checkInitialized()
```
    Checks if this configuration object has been initialized or not.
    
    Throws:
    
    DeepIllegalAccessException - if not initialized
  - fetchTableMetadata
```
public com.datastax.driver.core.TableMetadata fetchTableMetadata()
```
    Fetches table metadata from the underlying datastore, using DataStax java driver.
    
    Returns:
    the table metadata as returned by the driver.
  - createOutputTableIfNeeded
```
public void createOutputTableIfNeeded(org.apache.spark.rdd.RDD<scala.Tuple2<Cells,Cells>> tupleRDD)
```
    Creates the output column family if not exists.
    We first check if the column family exists.
    If not, we get the first element from tupleRDD and we use it as a template to get columns metadata.
    This is a very heavy operation since to obtain the schema we need to get at least one element of the output RDD.
    
    Parameters:
    tupleRDD - the pair RDD.
  - columnDefinitions
```
public Map<String,Cell> columnDefinitions()
```
    Specified by:
    
    columnDefinitions in interface IDeepJobConfig<T,ICassandraDeepJobConfig<T>>
  - columnFamily
```
public ICassandraDeepJobConfig<T> columnFamily(String columnFamily)
```
    Specified by:
    
    columnFamily in interface ICassandraDeepJobConfig<T>
  - table
```
public ICassandraDeepJobConfig<T> table(String table)
```
    Specified by:
    
    table in interface ICassandraDeepJobConfig<T>
  - getColumnFamily
```
public String getColumnFamily()
```
    Specified by:
    
    getColumnFamily in interface ICassandraDeepJobConfig<T>
  - getTable
```
public String getTable()
```
    Specified by:
    
    getTable in interface ICassandraDeepJobConfig<T>
  - getHost
```
public String getHost()
```
    Specified by:
    
    getHost in interface IDeepJobConfig<T,ICassandraDeepJobConfig<T>>
  - getInputColumns
```
public String[] getInputColumns()
```
    Specified by:
    
    getInputColumns in interface IDeepJobConfig<T,ICassandraDeepJobConfig<T>>
  - getKeyspace
```
public String getKeyspace()
```
    Specified by:
    
    getKeyspace in interface ICassandraDeepJobConfig<T>
  - getPartitionerClassName
```
public String getPartitionerClassName()
```
    Specified by:
    
    getPartitionerClassName in interface ICassandraDeepJobConfig<T>
  - getPassword
```
public String getPassword()
```
    Specified by:
    
    getPassword in interface IDeepJobConfig<T,ICassandraDeepJobConfig<T>>
  - getRpcPort
```
public Integer getRpcPort()
```
    Specified by:
    
    getRpcPort in interface ICassandraDeepJobConfig<T>
  - getCqlPort
```
public Integer getCqlPort()
```
    Specified by:
    
    getCqlPort in interface ICassandraDeepJobConfig<T>
  - getUsername
```
public String getUsername()
```
    Specified by:
    
    getUsername in interface IDeepJobConfig<T,ICassandraDeepJobConfig<T>>
  - host
```
public ICassandraDeepJobConfig<T> host(String hostname)
```
    Specified by:
    
    host in interface IDeepJobConfig<T,ICassandraDeepJobConfig<T>>
  - initialize
```
public ICassandraDeepJobConfig<T> initialize()
```
    Specified by:
    
    initialize in interface IDeepJobConfig<T,ICassandraDeepJobConfig<T>>
  - inputColumns
```
public ICassandraDeepJobConfig<T> inputColumns(String... columns)
```
    Specified by:
    
    inputColumns in interface IDeepJobConfig<T,ICassandraDeepJobConfig<T>>
  - keyspace
```
public ICassandraDeepJobConfig<T> keyspace(String keyspace)
```
    Specified by:
    
    keyspace in interface ICassandraDeepJobConfig<T>
  - bisectFactor
```
public ICassandraDeepJobConfig<T> bisectFactor(int bisectFactor)
```
    Specified by:
    
    bisectFactor in interface ICassandraDeepJobConfig<T>
  - partitioner
```
public ICassandraDeepJobConfig<T> partitioner(String partitionerClassName)
```
    Specified by:
    
    partitioner in interface ICassandraDeepJobConfig<T>
  - password
```
public ICassandraDeepJobConfig<T> password(String password)
```
    Specified by:
    
    password in interface IDeepJobConfig<T,ICassandraDeepJobConfig<T>>
  - rpcPort
```
public ICassandraDeepJobConfig<T> rpcPort(Integer port)
```
    Specified by:
    
    rpcPort in interface ICassandraDeepJobConfig<T>
  - cqlPort
```
public ICassandraDeepJobConfig<T> cqlPort(Integer port)
```
    Specified by:
    
    cqlPort in interface ICassandraDeepJobConfig<T>
  - username
```
public ICassandraDeepJobConfig<T> username(String username)
```
    Specified by:
    
    username in interface IDeepJobConfig<T,ICassandraDeepJobConfig<T>>
  - batchSize
```
public ICassandraDeepJobConfig<T> batchSize(int batchSize)
```
    Specified by:
    
    batchSize in interface ICassandraDeepJobConfig<T>
  - isCreateTableOnWrite
```
public Boolean isCreateTableOnWrite()
```
    Specified by:
    
    isCreateTableOnWrite in interface ICassandraDeepJobConfig<T>
  - createTableOnWrite
```
public ICassandraDeepJobConfig<T> createTableOnWrite(Boolean createTableOnWrite)
```
    Specified by:
    
    createTableOnWrite in interface ICassandraDeepJobConfig<T>
  - getAdditionalFilters
```
public Map<String,Serializable> getAdditionalFilters()
```
    Specified by:
    
    getAdditionalFilters in interface IDeepJobConfig<T,ICassandraDeepJobConfig<T>>
  - getPageSize
```
public int getPageSize()
```
    Specified by:
    
    getPageSize in interface IDeepJobConfig<T,ICassandraDeepJobConfig<T>>
  - filterByField
```
public ICassandraDeepJobConfig<T> filterByField(String filterColumnName,
                                       Serializable filterValue)
```
    Specified by:
    
    filterByField in interface IDeepJobConfig<T,ICassandraDeepJobConfig<T>>
  - pageSize
```
public ICassandraDeepJobConfig<T> pageSize(int pageSize)
```
    Specified by:
    
    pageSize in interface IDeepJobConfig<T,ICassandraDeepJobConfig<T>>
  - getReadConsistencyLevel
```
public String getReadConsistencyLevel()
```
    Specified by:
    
    getReadConsistencyLevel in interface ICassandraDeepJobConfig<T>
  - getWriteConsistencyLevel
```
public String getWriteConsistencyLevel()
```
    Specified by:
    
    getWriteConsistencyLevel in interface ICassandraDeepJobConfig<T>
  - readConsistencyLevel
```
public ICassandraDeepJobConfig<T> readConsistencyLevel(String level)
```
    Specified by:
    
    readConsistencyLevel in interface ICassandraDeepJobConfig<T>
  - writeConsistencyLevel
```
public ICassandraDeepJobConfig<T> writeConsistencyLevel(String level)
```
    Specified by:
    
    writeConsistencyLevel in interface ICassandraDeepJobConfig<T>
  - getBatchSize
```
public int getBatchSize()
```
    Specified by:
    
    getBatchSize in interface ICassandraDeepJobConfig<T>
  - getIsWriteConfig
```
public Boolean getIsWriteConfig()
```
    Specified by:
    
    getIsWriteConfig in interface ICassandraDeepJobConfig<T>
  - getBisectFactor
```
public int getBisectFactor()
```
    Specified by:
    
    getBisectFactor in interface ICassandraDeepJobConfig<T>

Class GenericDeepJobConfig<T>

Field Summary

Constructor Summary

Method Summary

Methods inherited from class java.lang.Object

Methods inherited from interface com.stratio.deep.config.IDeepJobConfig

Field Detail

isWriteConfig

Constructor Detail

GenericDeepJobConfig

Method Detail

session

getSession

close

checkInitialized

fetchTableMetadata

createOutputTableIfNeeded

columnDefinitions

columnFamily

table

getColumnFamily

getTable

getHost

getInputColumns

getKeyspace

getPartitionerClassName

getPassword

getRpcPort

getCqlPort

getUsername

host

initialize

inputColumns

keyspace

bisectFactor

partitioner

password

rpcPort

cqlPort

username

batchSize

isCreateTableOnWrite

createTableOnWrite

getAdditionalFilters

getPageSize

filterByField

pageSize

getReadConsistencyLevel

getWriteConsistencyLevel

readConsistencyLevel

writeConsistencyLevel

getBatchSize

getIsWriteConfig

getBisectFactor