object CSVUtils
- Alphabetic
- By Inheritance
- CSVUtils
- AnyRef
- Any
- Hide All
- Show All
- Public
- Protected
Value Members
- final def !=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def ##: Int
- Definition Classes
- AnyRef → Any
- final def ==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
- final def asInstanceOf[T0]: T0
- Definition Classes
- Any
- def clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.CloneNotSupportedException]) @native()
- final def eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- def equals(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef → Any
- def filterCommentAndEmpty(iter: Iterator[String], options: CSVOptions): Iterator[String]
- def filterCommentAndEmpty(lines: Dataset[String], options: CSVOptions): Dataset[String]
Filter ignorable rows for CSV dataset (lines empty and starting with
comment).Filter ignorable rows for CSV dataset (lines empty and starting with
comment). This is currently being used in CSV schema inference. - def filterHeaderLine(iter: Iterator[String], firstLine: String, options: CSVOptions): Iterator[String]
Skip the given first line so that only data can remain in a dataset.
Skip the given first line so that only data can remain in a dataset. This is similar with
dropHeaderLinebelow and currently being used in CSV schema inference. - def finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.Throwable])
- final def getClass(): Class[_ <: AnyRef]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- def hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- final def isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- def makeSafeHeader(row: Array[String], caseSensitive: Boolean, options: CSVOptions): Array[String]
Generates a header from the given row which is null-safe and duplicate-safe.
- final def ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
- final def notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- final def notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- def sample(csv: RDD[Array[String]], options: CSVOptions): RDD[Array[String]]
Sample CSV RDD as configured by
samplingRatio. - def sample(csv: Dataset[String], options: CSVOptions): Dataset[String]
Sample CSV dataset as configured by
samplingRatio. - final def synchronized[T0](arg0: => T0): T0
- Definition Classes
- AnyRef
- def toString(): String
- Definition Classes
- AnyRef → Any
- final def wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException])
- final def wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws(classOf[java.lang.InterruptedException]) @native()