org.apache.hadoop.hive.serde2

Class OpenCSVSerde

java.lang.Object

org.apache.hadoop.hive.serde2.AbstractSerDe

org.apache.hadoop.hive.serde2.AbstractEncodingAwareSerDe

org.apache.hadoop.hive.serde2.OpenCSVSerde

All Implemented Interfaces:

Deserializer, SerDe, Serializer

public final class OpenCSVSerde
extends AbstractEncodingAwareSerDe

OpenCSVSerde use opencsv to deserialize CSV format. Users can specify custom separator, quote or escape characters. And the default separator(\), quote("), and escape characters(\) are the same as the opencsv library.

Field Summary

Fields

Modifier and Type	Field and Description
static String	ESCAPECHAR
static String	QUOTECHAR
static String	SEPARATORCHAR

Fields inherited from class org.apache.hadoop.hive.serde2.AbstractEncodingAwareSerDe

charset

Fields inherited from class org.apache.hadoop.hive.serde2.AbstractSerDe

configuration, log, partitionProperties, properties, tableProperties

Constructor Summary

Constructors

Constructor and Description
OpenCSVSerde()

Method Summary

Modifier and Type	Method and Description
Object	doDeserialize(org.apache.hadoop.io.Writable blob)
org.apache.hadoop.io.Writable	doSerialize(Object obj, ObjectInspector objInspector)
ObjectInspector	getObjectInspector() Get the object inspector that can be used to navigate through the internal structure of the Object returned from deserialize(...).
Class<? extends org.apache.hadoop.io.Writable>	getSerializedClass() Returns the Writable class that would be returned by the serialize method.
void	initialize(org.apache.hadoop.conf.Configuration configuration, Properties tableProperties, Properties partitionProperties) Initialize the SerDe.
protected org.apache.hadoop.io.Text	transformFromUTF8(org.apache.hadoop.io.Writable blob) transform Writable data from UTF-8 to charset before serialize.
protected org.apache.hadoop.io.Text	transformToUTF8(org.apache.hadoop.io.Writable blob) transform Writable data from charset to UTF-8 before doDeserialize.

Methods inherited from class org.apache.hadoop.hive.serde2.AbstractEncodingAwareSerDe

deserialize, serialize

Methods inherited from class org.apache.hadoop.hive.serde2.AbstractSerDe

getColumnComments, getColumnNames, getColumnTypes, getConfiguration, getPartitionColumnComments, getPartitionColumnNames, getPartitionColumnTypes, getSerDeStats, parseColumnComments, parseColumnNames, parseColumnNames, parseColumnTypes, parseColumnTypes, shouldStoreFieldsInMetastore, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface org.apache.hadoop.hive.serde2.SerDe

handleJobLevelConfiguration

Field Detail

SEPARATORCHAR

public static final String SEPARATORCHAR

See Also:

Constant Field Values

QUOTECHAR

public static final String QUOTECHAR

See Also:

Constant Field Values

ESCAPECHAR

public static final String ESCAPECHAR

See Also:

Constant Field Values

Constructor Detail

OpenCSVSerde

public OpenCSVSerde()

Method Detail

initialize

public void initialize(org.apache.hadoop.conf.Configuration configuration,
                       Properties tableProperties,
                       Properties partitionProperties)
                throws SerDeException

Description copied from class: AbstractSerDe

Initialize the SerDe. By default, this will use one set of properties, either the table properties or the partition properties. If a SerDe needs access to both sets, it should override this method. Eventually, once all SerDes have implemented this method, we should convert it to an abstract method.

Overrides:

initialize in class AbstractEncodingAwareSerDe

Parameters:

configuration - Hadoop configuration

tableProperties - Table properties

partitionProperties - Partition properties (may be null if table has no partitions)

Throws:

SerDeException - if SerDe fails to initialize

doSerialize

public org.apache.hadoop.io.Writable doSerialize(Object obj,
                                                 ObjectInspector objInspector)
                                          throws SerDeException

Specified by:

doSerialize in class AbstractEncodingAwareSerDe

Throws:

SerDeException

doDeserialize

public Object doDeserialize(org.apache.hadoop.io.Writable blob)
                     throws SerDeException

Specified by:

doDeserialize in class AbstractEncodingAwareSerDe

Throws:

SerDeException

getObjectInspector

public ObjectInspector getObjectInspector()
                                   throws SerDeException

Description copied from interface: Deserializer

Get the object inspector that can be used to navigate through the internal structure of the Object returned from deserialize(...).

Throws:

SerDeException

getSerializedClass

public Class<? extends org.apache.hadoop.io.Writable> getSerializedClass()

Description copied from class: AbstractSerDe

Returns the Writable class that would be returned by the serialize method. This is used to initialize SequenceFile header.

Specified by:

getSerializedClass in interface Serializer

Specified by:

getSerializedClass in class AbstractSerDe

transformFromUTF8

protected org.apache.hadoop.io.Text transformFromUTF8(org.apache.hadoop.io.Writable blob)

Description copied from class: AbstractEncodingAwareSerDe

transform Writable data from UTF-8 to charset before serialize.

Specified by:

transformFromUTF8 in class AbstractEncodingAwareSerDe

Returns:

transformToUTF8

protected org.apache.hadoop.io.Text transformToUTF8(org.apache.hadoop.io.Writable blob)

Description copied from class: AbstractEncodingAwareSerDe

transform Writable data from charset to UTF-8 before doDeserialize.

Specified by:

transformToUTF8 in class AbstractEncodingAwareSerDe

Returns: