Interface DataQualityGlueTable.Builder

    • Method Detail

      • databaseName

        DataQualityGlueTable.Builder databaseName​(String databaseName)

        A database name in the Glue Data Catalog.

        Parameters:
        databaseName - A database name in the Glue Data Catalog.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • tableName

        DataQualityGlueTable.Builder tableName​(String tableName)

        A table name in the Glue Data Catalog.

        Parameters:
        tableName - A table name in the Glue Data Catalog.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • catalogId

        DataQualityGlueTable.Builder catalogId​(String catalogId)

        A unique identifier for the Glue Data Catalog.

        Parameters:
        catalogId - A unique identifier for the Glue Data Catalog.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • connectionName

        DataQualityGlueTable.Builder connectionName​(String connectionName)

        The name of the connection to the Glue Data Catalog.

        Parameters:
        connectionName - The name of the connection to the Glue Data Catalog.
        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • additionalOptions

        DataQualityGlueTable.Builder additionalOptions​(Map<String,​String> additionalOptions)

        Additional options for the table. Currently there are two keys supported:

        • pushDownPredicate: to filter on partitions without having to list and read all the files in your dataset.

        • catalogPartitionPredicate: to use server-side partition pruning using partition indexes in the Glue Data Catalog.

        Parameters:
        additionalOptions - Additional options for the table. Currently there are two keys supported:

        • pushDownPredicate: to filter on partitions without having to list and read all the files in your dataset.

        • catalogPartitionPredicate: to use server-side partition pruning using partition indexes in the Glue Data Catalog.

        Returns:
        Returns a reference to this object so that method calls can be chained together.
      • preProcessingQuery

        DataQualityGlueTable.Builder preProcessingQuery​(String preProcessingQuery)

        SQL Query of SparkSQL format that can be used to pre-process the data for the table in Glue Data Catalog, before running the Data Quality Operation.

        Parameters:
        preProcessingQuery - SQL Query of SparkSQL format that can be used to pre-process the data for the table in Glue Data Catalog, before running the Data Quality Operation.
        Returns:
        Returns a reference to this object so that method calls can be chained together.