Package com.google.cloud.aiplatform.v1
Class InputDataConfig
java.lang.Object
com.google.protobuf.AbstractMessageLite
com.google.protobuf.AbstractMessage
com.google.protobuf.GeneratedMessage
com.google.cloud.aiplatform.v1.InputDataConfig
- All Implemented Interfaces:
InputDataConfigOrBuilder,com.google.protobuf.Message,com.google.protobuf.MessageLite,com.google.protobuf.MessageLiteOrBuilder,com.google.protobuf.MessageOrBuilder,Serializable
@Generated
public final class InputDataConfig
extends com.google.protobuf.GeneratedMessage
implements InputDataConfigOrBuilder
Specifies Vertex AI owned input data to be used for training, and possibly evaluating, the Model.Protobuf type
google.cloud.aiplatform.v1.InputDataConfig- See Also:
-
Nested Class Summary
Nested ClassesModifier and TypeClassDescriptionstatic final classSpecifies Vertex AI owned input data to be used for training, and possibly evaluating, the Model.static enumstatic enumNested classes/interfaces inherited from class com.google.protobuf.GeneratedMessage
com.google.protobuf.GeneratedMessage.ExtendableBuilder<MessageT extends com.google.protobuf.GeneratedMessage.ExtendableMessage<MessageT>,BuilderT extends com.google.protobuf.GeneratedMessage.ExtendableBuilder<MessageT, BuilderT>>, com.google.protobuf.GeneratedMessage.ExtendableMessage<MessageT extends com.google.protobuf.GeneratedMessage.ExtendableMessage<MessageT>>, com.google.protobuf.GeneratedMessage.ExtendableMessageOrBuilder<MessageT extends com.google.protobuf.GeneratedMessage.ExtendableMessage<MessageT>>, com.google.protobuf.GeneratedMessage.FieldAccessorTable, com.google.protobuf.GeneratedMessage.GeneratedExtension<ContainingT extends com.google.protobuf.Message, T extends Object>, com.google.protobuf.GeneratedMessage.UnusedPrivateParameter Nested classes/interfaces inherited from class com.google.protobuf.AbstractMessage
com.google.protobuf.AbstractMessage.BuilderParentNested classes/interfaces inherited from class com.google.protobuf.AbstractMessageLite
com.google.protobuf.AbstractMessageLite.InternalOneOfEnum -
Field Summary
FieldsModifier and TypeFieldDescriptionstatic final intstatic final intstatic final intstatic final intstatic final intstatic final intstatic final intstatic final intstatic final intstatic final intstatic final intstatic final intFields inherited from class com.google.protobuf.GeneratedMessage
alwaysUseFieldBuilders, loggedPre22TypeNames, unknownFieldsFields inherited from class com.google.protobuf.AbstractMessage
memoizedSizeFields inherited from class com.google.protobuf.AbstractMessageLite
memoizedHashCode -
Method Summary
Modifier and TypeMethodDescriptionbooleanApplicable only to custom training with Datasets that have DataItems and Annotations.com.google.protobuf.ByteStringApplicable only to custom training with Datasets that have DataItems and Annotations.Applicable only to Datasets that have DataItems and Annotations.com.google.protobuf.ByteStringApplicable only to Datasets that have DataItems and Annotations.Only applicable to custom training with tabular Dataset with BigQuery source.Only applicable to custom training with tabular Dataset with BigQuery source.Required.com.google.protobuf.ByteStringRequired.static InputDataConfigstatic final com.google.protobuf.Descriptors.DescriptorSplit based on the provided filters for each set.Split based on the provided filters for each set.Split based on fractions defining the size of each set.Split based on fractions defining the size of each set.The Cloud Storage location where the training data is to be written to.The Cloud Storage location where the training data is to be written to.com.google.protobuf.Parser<InputDataConfig>booleanWhether to persist the ML use assignment to data item system labels.Supported only for tabular Datasets.Supported only for tabular Datasets.Only applicable to Datasets that have SavedQueries.com.google.protobuf.ByteStringOnly applicable to Datasets that have SavedQueries.intSupported only for tabular Datasets.Supported only for tabular Datasets.Supported only for tabular Datasets.Supported only for tabular Datasets.booleanOnly applicable to custom training with tabular Dataset with BigQuery source.booleanSplit based on the provided filters for each set.booleanSplit based on fractions defining the size of each set.booleanThe Cloud Storage location where the training data is to be written to.inthashCode()booleanSupported only for tabular Datasets.booleanSupported only for tabular Datasets.booleanSupported only for tabular Datasets.protected com.google.protobuf.GeneratedMessage.FieldAccessorTablefinal booleanstatic InputDataConfig.Builderstatic InputDataConfig.BuildernewBuilder(InputDataConfig prototype) protected InputDataConfig.BuildernewBuilderForType(com.google.protobuf.AbstractMessage.BuilderParent parent) static InputDataConfigparseDelimitedFrom(InputStream input) static InputDataConfigparseDelimitedFrom(InputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) static InputDataConfigparseFrom(byte[] data) static InputDataConfigparseFrom(byte[] data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) static InputDataConfigparseFrom(com.google.protobuf.ByteString data) static InputDataConfigparseFrom(com.google.protobuf.ByteString data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) static InputDataConfigparseFrom(com.google.protobuf.CodedInputStream input) static InputDataConfigparseFrom(com.google.protobuf.CodedInputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) static InputDataConfigparseFrom(InputStream input) static InputDataConfigparseFrom(InputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) static InputDataConfigparseFrom(ByteBuffer data) static InputDataConfigparseFrom(ByteBuffer data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) static com.google.protobuf.Parser<InputDataConfig>parser()voidwriteTo(com.google.protobuf.CodedOutputStream output) Methods inherited from class com.google.protobuf.GeneratedMessage
canUseUnsafe, computeStringSize, computeStringSizeNoTag, emptyBooleanList, emptyDoubleList, emptyFloatList, emptyIntList, emptyList, emptyLongList, getAllFields, getDescriptorForType, getField, getOneofFieldDescriptor, getRepeatedField, getRepeatedFieldCount, getUnknownFields, hasField, hasOneof, internalGetMapField, internalGetMapFieldReflection, isStringEmpty, makeExtensionsImmutable, makeMutableCopy, makeMutableCopy, mergeFromAndMakeImmutableInternal, newFileScopedGeneratedExtension, newInstance, newMessageScopedGeneratedExtension, parseDelimitedWithIOException, parseDelimitedWithIOException, parseUnknownField, parseUnknownFieldProto3, parseWithIOException, parseWithIOException, parseWithIOException, parseWithIOException, serializeBooleanMapTo, serializeIntegerMapTo, serializeLongMapTo, serializeStringMapTo, writeReplace, writeString, writeStringNoTagMethods inherited from class com.google.protobuf.AbstractMessage
findInitializationErrors, getInitializationErrorString, hashFields, toStringMethods inherited from class com.google.protobuf.AbstractMessageLite
addAll, checkByteStringIsUtf8, toByteArray, toByteString, writeDelimitedTo, writeToMethods inherited from class java.lang.Object
clone, finalize, getClass, notify, notifyAll, wait, wait, waitMethods inherited from interface com.google.protobuf.MessageLite
toByteArray, toByteString, writeDelimitedTo, writeToMethods inherited from interface com.google.protobuf.MessageOrBuilder
findInitializationErrors, getAllFields, getDescriptorForType, getField, getInitializationErrorString, getOneofFieldDescriptor, getRepeatedField, getRepeatedFieldCount, getUnknownFields, hasField, hasOneof
-
Field Details
-
FRACTION_SPLIT_FIELD_NUMBER
public static final int FRACTION_SPLIT_FIELD_NUMBER- See Also:
-
FILTER_SPLIT_FIELD_NUMBER
public static final int FILTER_SPLIT_FIELD_NUMBER- See Also:
-
PREDEFINED_SPLIT_FIELD_NUMBER
public static final int PREDEFINED_SPLIT_FIELD_NUMBER- See Also:
-
TIMESTAMP_SPLIT_FIELD_NUMBER
public static final int TIMESTAMP_SPLIT_FIELD_NUMBER- See Also:
-
STRATIFIED_SPLIT_FIELD_NUMBER
public static final int STRATIFIED_SPLIT_FIELD_NUMBER- See Also:
-
GCS_DESTINATION_FIELD_NUMBER
public static final int GCS_DESTINATION_FIELD_NUMBER- See Also:
-
BIGQUERY_DESTINATION_FIELD_NUMBER
public static final int BIGQUERY_DESTINATION_FIELD_NUMBER- See Also:
-
DATASET_ID_FIELD_NUMBER
public static final int DATASET_ID_FIELD_NUMBER- See Also:
-
ANNOTATIONS_FILTER_FIELD_NUMBER
public static final int ANNOTATIONS_FILTER_FIELD_NUMBER- See Also:
-
ANNOTATION_SCHEMA_URI_FIELD_NUMBER
public static final int ANNOTATION_SCHEMA_URI_FIELD_NUMBER- See Also:
-
SAVED_QUERY_ID_FIELD_NUMBER
public static final int SAVED_QUERY_ID_FIELD_NUMBER- See Also:
-
PERSIST_ML_USE_ASSIGNMENT_FIELD_NUMBER
public static final int PERSIST_ML_USE_ASSIGNMENT_FIELD_NUMBER- See Also:
-
-
Method Details
-
getDescriptor
public static final com.google.protobuf.Descriptors.Descriptor getDescriptor() -
internalGetFieldAccessorTable
protected com.google.protobuf.GeneratedMessage.FieldAccessorTable internalGetFieldAccessorTable()- Specified by:
internalGetFieldAccessorTablein classcom.google.protobuf.GeneratedMessage
-
getSplitCase
- Specified by:
getSplitCasein interfaceInputDataConfigOrBuilder
-
getDestinationCase
- Specified by:
getDestinationCasein interfaceInputDataConfigOrBuilder
-
hasFractionSplit
public boolean hasFractionSplit()Split based on fractions defining the size of each set.
.google.cloud.aiplatform.v1.FractionSplit fraction_split = 2;- Specified by:
hasFractionSplitin interfaceInputDataConfigOrBuilder- Returns:
- Whether the fractionSplit field is set.
-
getFractionSplit
Split based on fractions defining the size of each set.
.google.cloud.aiplatform.v1.FractionSplit fraction_split = 2;- Specified by:
getFractionSplitin interfaceInputDataConfigOrBuilder- Returns:
- The fractionSplit.
-
getFractionSplitOrBuilder
Split based on fractions defining the size of each set.
.google.cloud.aiplatform.v1.FractionSplit fraction_split = 2;- Specified by:
getFractionSplitOrBuilderin interfaceInputDataConfigOrBuilder
-
hasFilterSplit
public boolean hasFilterSplit()Split based on the provided filters for each set.
.google.cloud.aiplatform.v1.FilterSplit filter_split = 3;- Specified by:
hasFilterSplitin interfaceInputDataConfigOrBuilder- Returns:
- Whether the filterSplit field is set.
-
getFilterSplit
Split based on the provided filters for each set.
.google.cloud.aiplatform.v1.FilterSplit filter_split = 3;- Specified by:
getFilterSplitin interfaceInputDataConfigOrBuilder- Returns:
- The filterSplit.
-
getFilterSplitOrBuilder
Split based on the provided filters for each set.
.google.cloud.aiplatform.v1.FilterSplit filter_split = 3;- Specified by:
getFilterSplitOrBuilderin interfaceInputDataConfigOrBuilder
-
hasPredefinedSplit
public boolean hasPredefinedSplit()Supported only for tabular Datasets. Split based on a predefined key.
.google.cloud.aiplatform.v1.PredefinedSplit predefined_split = 4;- Specified by:
hasPredefinedSplitin interfaceInputDataConfigOrBuilder- Returns:
- Whether the predefinedSplit field is set.
-
getPredefinedSplit
Supported only for tabular Datasets. Split based on a predefined key.
.google.cloud.aiplatform.v1.PredefinedSplit predefined_split = 4;- Specified by:
getPredefinedSplitin interfaceInputDataConfigOrBuilder- Returns:
- The predefinedSplit.
-
getPredefinedSplitOrBuilder
Supported only for tabular Datasets. Split based on a predefined key.
.google.cloud.aiplatform.v1.PredefinedSplit predefined_split = 4;- Specified by:
getPredefinedSplitOrBuilderin interfaceInputDataConfigOrBuilder
-
hasTimestampSplit
public boolean hasTimestampSplit()Supported only for tabular Datasets. Split based on the timestamp of the input data pieces.
.google.cloud.aiplatform.v1.TimestampSplit timestamp_split = 5;- Specified by:
hasTimestampSplitin interfaceInputDataConfigOrBuilder- Returns:
- Whether the timestampSplit field is set.
-
getTimestampSplit
Supported only for tabular Datasets. Split based on the timestamp of the input data pieces.
.google.cloud.aiplatform.v1.TimestampSplit timestamp_split = 5;- Specified by:
getTimestampSplitin interfaceInputDataConfigOrBuilder- Returns:
- The timestampSplit.
-
getTimestampSplitOrBuilder
Supported only for tabular Datasets. Split based on the timestamp of the input data pieces.
.google.cloud.aiplatform.v1.TimestampSplit timestamp_split = 5;- Specified by:
getTimestampSplitOrBuilderin interfaceInputDataConfigOrBuilder
-
hasStratifiedSplit
public boolean hasStratifiedSplit()Supported only for tabular Datasets. Split based on the distribution of the specified column.
.google.cloud.aiplatform.v1.StratifiedSplit stratified_split = 12;- Specified by:
hasStratifiedSplitin interfaceInputDataConfigOrBuilder- Returns:
- Whether the stratifiedSplit field is set.
-
getStratifiedSplit
Supported only for tabular Datasets. Split based on the distribution of the specified column.
.google.cloud.aiplatform.v1.StratifiedSplit stratified_split = 12;- Specified by:
getStratifiedSplitin interfaceInputDataConfigOrBuilder- Returns:
- The stratifiedSplit.
-
getStratifiedSplitOrBuilder
Supported only for tabular Datasets. Split based on the distribution of the specified column.
.google.cloud.aiplatform.v1.StratifiedSplit stratified_split = 12;- Specified by:
getStratifiedSplitOrBuilderin interfaceInputDataConfigOrBuilder
-
hasGcsDestination
public boolean hasGcsDestination()The Cloud Storage location where the training data is to be written to. In the given directory a new directory is created with name: `dataset-<dataset-id>-<annotation-type>-<timestamp-of-training-call>` where timestamp is in YYYY-MM-DDThh:mm:ss.sssZ ISO-8601 format. All training input data is written into that directory. The Vertex AI environment variables representing Cloud Storage data URIs are represented in the Cloud Storage wildcard format to support sharded data. e.g.: "gs://.../training-*.jsonl" * AIP_DATA_FORMAT = "jsonl" for non-tabular data, "csv" for tabular data * AIP_TRAINING_DATA_URI = "gcs_destination/dataset-<dataset-id>-<annotation-type>-<time>/training-*.${AIP_DATA_FORMAT}" * AIP_VALIDATION_DATA_URI = "gcs_destination/dataset-<dataset-id>-<annotation-type>-<time>/validation-*.${AIP_DATA_FORMAT}" * AIP_TEST_DATA_URI = "gcs_destination/dataset-<dataset-id>-<annotation-type>-<time>/test-*.${AIP_DATA_FORMAT}".google.cloud.aiplatform.v1.GcsDestination gcs_destination = 8;- Specified by:
hasGcsDestinationin interfaceInputDataConfigOrBuilder- Returns:
- Whether the gcsDestination field is set.
-
getGcsDestination
The Cloud Storage location where the training data is to be written to. In the given directory a new directory is created with name: `dataset-<dataset-id>-<annotation-type>-<timestamp-of-training-call>` where timestamp is in YYYY-MM-DDThh:mm:ss.sssZ ISO-8601 format. All training input data is written into that directory. The Vertex AI environment variables representing Cloud Storage data URIs are represented in the Cloud Storage wildcard format to support sharded data. e.g.: "gs://.../training-*.jsonl" * AIP_DATA_FORMAT = "jsonl" for non-tabular data, "csv" for tabular data * AIP_TRAINING_DATA_URI = "gcs_destination/dataset-<dataset-id>-<annotation-type>-<time>/training-*.${AIP_DATA_FORMAT}" * AIP_VALIDATION_DATA_URI = "gcs_destination/dataset-<dataset-id>-<annotation-type>-<time>/validation-*.${AIP_DATA_FORMAT}" * AIP_TEST_DATA_URI = "gcs_destination/dataset-<dataset-id>-<annotation-type>-<time>/test-*.${AIP_DATA_FORMAT}".google.cloud.aiplatform.v1.GcsDestination gcs_destination = 8;- Specified by:
getGcsDestinationin interfaceInputDataConfigOrBuilder- Returns:
- The gcsDestination.
-
getGcsDestinationOrBuilder
The Cloud Storage location where the training data is to be written to. In the given directory a new directory is created with name: `dataset-<dataset-id>-<annotation-type>-<timestamp-of-training-call>` where timestamp is in YYYY-MM-DDThh:mm:ss.sssZ ISO-8601 format. All training input data is written into that directory. The Vertex AI environment variables representing Cloud Storage data URIs are represented in the Cloud Storage wildcard format to support sharded data. e.g.: "gs://.../training-*.jsonl" * AIP_DATA_FORMAT = "jsonl" for non-tabular data, "csv" for tabular data * AIP_TRAINING_DATA_URI = "gcs_destination/dataset-<dataset-id>-<annotation-type>-<time>/training-*.${AIP_DATA_FORMAT}" * AIP_VALIDATION_DATA_URI = "gcs_destination/dataset-<dataset-id>-<annotation-type>-<time>/validation-*.${AIP_DATA_FORMAT}" * AIP_TEST_DATA_URI = "gcs_destination/dataset-<dataset-id>-<annotation-type>-<time>/test-*.${AIP_DATA_FORMAT}".google.cloud.aiplatform.v1.GcsDestination gcs_destination = 8;- Specified by:
getGcsDestinationOrBuilderin interfaceInputDataConfigOrBuilder
-
hasBigqueryDestination
public boolean hasBigqueryDestination()Only applicable to custom training with tabular Dataset with BigQuery source. The BigQuery project location where the training data is to be written to. In the given project a new dataset is created with name `dataset_<dataset-id>_<annotation-type>_<timestamp-of-training-call>` where timestamp is in YYYY_MM_DDThh_mm_ss_sssZ format. All training input data is written into that dataset. In the dataset three tables are created, `training`, `validation` and `test`. * AIP_DATA_FORMAT = "bigquery". * AIP_TRAINING_DATA_URI = "bigquery_destination.dataset_<dataset-id>_<annotation-type>_<time>.training" * AIP_VALIDATION_DATA_URI = "bigquery_destination.dataset_<dataset-id>_<annotation-type>_<time>.validation" * AIP_TEST_DATA_URI = "bigquery_destination.dataset_<dataset-id>_<annotation-type>_<time>.test"
.google.cloud.aiplatform.v1.BigQueryDestination bigquery_destination = 10;- Specified by:
hasBigqueryDestinationin interfaceInputDataConfigOrBuilder- Returns:
- Whether the bigqueryDestination field is set.
-
getBigqueryDestination
Only applicable to custom training with tabular Dataset with BigQuery source. The BigQuery project location where the training data is to be written to. In the given project a new dataset is created with name `dataset_<dataset-id>_<annotation-type>_<timestamp-of-training-call>` where timestamp is in YYYY_MM_DDThh_mm_ss_sssZ format. All training input data is written into that dataset. In the dataset three tables are created, `training`, `validation` and `test`. * AIP_DATA_FORMAT = "bigquery". * AIP_TRAINING_DATA_URI = "bigquery_destination.dataset_<dataset-id>_<annotation-type>_<time>.training" * AIP_VALIDATION_DATA_URI = "bigquery_destination.dataset_<dataset-id>_<annotation-type>_<time>.validation" * AIP_TEST_DATA_URI = "bigquery_destination.dataset_<dataset-id>_<annotation-type>_<time>.test"
.google.cloud.aiplatform.v1.BigQueryDestination bigquery_destination = 10;- Specified by:
getBigqueryDestinationin interfaceInputDataConfigOrBuilder- Returns:
- The bigqueryDestination.
-
getBigqueryDestinationOrBuilder
Only applicable to custom training with tabular Dataset with BigQuery source. The BigQuery project location where the training data is to be written to. In the given project a new dataset is created with name `dataset_<dataset-id>_<annotation-type>_<timestamp-of-training-call>` where timestamp is in YYYY_MM_DDThh_mm_ss_sssZ format. All training input data is written into that dataset. In the dataset three tables are created, `training`, `validation` and `test`. * AIP_DATA_FORMAT = "bigquery". * AIP_TRAINING_DATA_URI = "bigquery_destination.dataset_<dataset-id>_<annotation-type>_<time>.training" * AIP_VALIDATION_DATA_URI = "bigquery_destination.dataset_<dataset-id>_<annotation-type>_<time>.validation" * AIP_TEST_DATA_URI = "bigquery_destination.dataset_<dataset-id>_<annotation-type>_<time>.test"
.google.cloud.aiplatform.v1.BigQueryDestination bigquery_destination = 10;- Specified by:
getBigqueryDestinationOrBuilderin interfaceInputDataConfigOrBuilder
-
getDatasetId
Required. The ID of the Dataset in the same Project and Location which data will be used to train the Model. The Dataset must use schema compatible with Model being trained, and what is compatible should be described in the used TrainingPipeline's [training_task_definition] [google.cloud.aiplatform.v1.TrainingPipeline.training_task_definition]. For tabular Datasets, all their data is exported to training, to pick and choose from.
string dataset_id = 1 [(.google.api.field_behavior) = REQUIRED];- Specified by:
getDatasetIdin interfaceInputDataConfigOrBuilder- Returns:
- The datasetId.
-
getDatasetIdBytes
public com.google.protobuf.ByteString getDatasetIdBytes()Required. The ID of the Dataset in the same Project and Location which data will be used to train the Model. The Dataset must use schema compatible with Model being trained, and what is compatible should be described in the used TrainingPipeline's [training_task_definition] [google.cloud.aiplatform.v1.TrainingPipeline.training_task_definition]. For tabular Datasets, all their data is exported to training, to pick and choose from.
string dataset_id = 1 [(.google.api.field_behavior) = REQUIRED];- Specified by:
getDatasetIdBytesin interfaceInputDataConfigOrBuilder- Returns:
- The bytes for datasetId.
-
getAnnotationsFilter
Applicable only to Datasets that have DataItems and Annotations. A filter on Annotations of the Dataset. Only Annotations that both match this filter and belong to DataItems not ignored by the split method are used in respectively training, validation or test role, depending on the role of the DataItem they are on (for the auto-assigned that role is decided by Vertex AI). A filter with same syntax as the one used in [ListAnnotations][google.cloud.aiplatform.v1.DatasetService.ListAnnotations] may be used, but note here it filters across all Annotations of the Dataset, and not just within a single DataItem.
string annotations_filter = 6;- Specified by:
getAnnotationsFilterin interfaceInputDataConfigOrBuilder- Returns:
- The annotationsFilter.
-
getAnnotationsFilterBytes
public com.google.protobuf.ByteString getAnnotationsFilterBytes()Applicable only to Datasets that have DataItems and Annotations. A filter on Annotations of the Dataset. Only Annotations that both match this filter and belong to DataItems not ignored by the split method are used in respectively training, validation or test role, depending on the role of the DataItem they are on (for the auto-assigned that role is decided by Vertex AI). A filter with same syntax as the one used in [ListAnnotations][google.cloud.aiplatform.v1.DatasetService.ListAnnotations] may be used, but note here it filters across all Annotations of the Dataset, and not just within a single DataItem.
string annotations_filter = 6;- Specified by:
getAnnotationsFilterBytesin interfaceInputDataConfigOrBuilder- Returns:
- The bytes for annotationsFilter.
-
getAnnotationSchemaUri
Applicable only to custom training with Datasets that have DataItems and Annotations. Cloud Storage URI that points to a YAML file describing the annotation schema. The schema is defined as an OpenAPI 3.0.2 [Schema Object](https://github.com/OAI/OpenAPI-Specification/blob/main/versions/3.0.2.md#schemaObject). The schema files that can be used here are found in gs://google-cloud-aiplatform/schema/dataset/annotation/ , note that the chosen schema must be consistent with [metadata][google.cloud.aiplatform.v1.Dataset.metadata_schema_uri] of the Dataset specified by [dataset_id][google.cloud.aiplatform.v1.InputDataConfig.dataset_id]. Only Annotations that both match this schema and belong to DataItems not ignored by the split method are used in respectively training, validation or test role, depending on the role of the DataItem they are on. When used in conjunction with [annotations_filter][google.cloud.aiplatform.v1.InputDataConfig.annotations_filter], the Annotations used for training are filtered by both [annotations_filter][google.cloud.aiplatform.v1.InputDataConfig.annotations_filter] and [annotation_schema_uri][google.cloud.aiplatform.v1.InputDataConfig.annotation_schema_uri].
string annotation_schema_uri = 9;- Specified by:
getAnnotationSchemaUriin interfaceInputDataConfigOrBuilder- Returns:
- The annotationSchemaUri.
-
getAnnotationSchemaUriBytes
public com.google.protobuf.ByteString getAnnotationSchemaUriBytes()Applicable only to custom training with Datasets that have DataItems and Annotations. Cloud Storage URI that points to a YAML file describing the annotation schema. The schema is defined as an OpenAPI 3.0.2 [Schema Object](https://github.com/OAI/OpenAPI-Specification/blob/main/versions/3.0.2.md#schemaObject). The schema files that can be used here are found in gs://google-cloud-aiplatform/schema/dataset/annotation/ , note that the chosen schema must be consistent with [metadata][google.cloud.aiplatform.v1.Dataset.metadata_schema_uri] of the Dataset specified by [dataset_id][google.cloud.aiplatform.v1.InputDataConfig.dataset_id]. Only Annotations that both match this schema and belong to DataItems not ignored by the split method are used in respectively training, validation or test role, depending on the role of the DataItem they are on. When used in conjunction with [annotations_filter][google.cloud.aiplatform.v1.InputDataConfig.annotations_filter], the Annotations used for training are filtered by both [annotations_filter][google.cloud.aiplatform.v1.InputDataConfig.annotations_filter] and [annotation_schema_uri][google.cloud.aiplatform.v1.InputDataConfig.annotation_schema_uri].
string annotation_schema_uri = 9;- Specified by:
getAnnotationSchemaUriBytesin interfaceInputDataConfigOrBuilder- Returns:
- The bytes for annotationSchemaUri.
-
getSavedQueryId
Only applicable to Datasets that have SavedQueries. The ID of a SavedQuery (annotation set) under the Dataset specified by [dataset_id][google.cloud.aiplatform.v1.InputDataConfig.dataset_id] used for filtering Annotations for training. Only Annotations that are associated with this SavedQuery are used in respectively training. When used in conjunction with [annotations_filter][google.cloud.aiplatform.v1.InputDataConfig.annotations_filter], the Annotations used for training are filtered by both [saved_query_id][google.cloud.aiplatform.v1.InputDataConfig.saved_query_id] and [annotations_filter][google.cloud.aiplatform.v1.InputDataConfig.annotations_filter]. Only one of [saved_query_id][google.cloud.aiplatform.v1.InputDataConfig.saved_query_id] and [annotation_schema_uri][google.cloud.aiplatform.v1.InputDataConfig.annotation_schema_uri] should be specified as both of them represent the same thing: problem type.
string saved_query_id = 7;- Specified by:
getSavedQueryIdin interfaceInputDataConfigOrBuilder- Returns:
- The savedQueryId.
-
getSavedQueryIdBytes
public com.google.protobuf.ByteString getSavedQueryIdBytes()Only applicable to Datasets that have SavedQueries. The ID of a SavedQuery (annotation set) under the Dataset specified by [dataset_id][google.cloud.aiplatform.v1.InputDataConfig.dataset_id] used for filtering Annotations for training. Only Annotations that are associated with this SavedQuery are used in respectively training. When used in conjunction with [annotations_filter][google.cloud.aiplatform.v1.InputDataConfig.annotations_filter], the Annotations used for training are filtered by both [saved_query_id][google.cloud.aiplatform.v1.InputDataConfig.saved_query_id] and [annotations_filter][google.cloud.aiplatform.v1.InputDataConfig.annotations_filter]. Only one of [saved_query_id][google.cloud.aiplatform.v1.InputDataConfig.saved_query_id] and [annotation_schema_uri][google.cloud.aiplatform.v1.InputDataConfig.annotation_schema_uri] should be specified as both of them represent the same thing: problem type.
string saved_query_id = 7;- Specified by:
getSavedQueryIdBytesin interfaceInputDataConfigOrBuilder- Returns:
- The bytes for savedQueryId.
-
getPersistMlUseAssignment
public boolean getPersistMlUseAssignment()Whether to persist the ML use assignment to data item system labels.
bool persist_ml_use_assignment = 11;- Specified by:
getPersistMlUseAssignmentin interfaceInputDataConfigOrBuilder- Returns:
- The persistMlUseAssignment.
-
isInitialized
public final boolean isInitialized()- Specified by:
isInitializedin interfacecom.google.protobuf.MessageLiteOrBuilder- Overrides:
isInitializedin classcom.google.protobuf.GeneratedMessage
-
writeTo
- Specified by:
writeToin interfacecom.google.protobuf.MessageLite- Overrides:
writeToin classcom.google.protobuf.GeneratedMessage- Throws:
IOException
-
getSerializedSize
public int getSerializedSize()- Specified by:
getSerializedSizein interfacecom.google.protobuf.MessageLite- Overrides:
getSerializedSizein classcom.google.protobuf.GeneratedMessage
-
equals
- Specified by:
equalsin interfacecom.google.protobuf.Message- Overrides:
equalsin classcom.google.protobuf.AbstractMessage
-
hashCode
public int hashCode()- Specified by:
hashCodein interfacecom.google.protobuf.Message- Overrides:
hashCodein classcom.google.protobuf.AbstractMessage
-
parseFrom
public static InputDataConfig parseFrom(ByteBuffer data) throws com.google.protobuf.InvalidProtocolBufferException - Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
public static InputDataConfig parseFrom(ByteBuffer data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws com.google.protobuf.InvalidProtocolBufferException - Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
public static InputDataConfig parseFrom(com.google.protobuf.ByteString data) throws com.google.protobuf.InvalidProtocolBufferException - Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
public static InputDataConfig parseFrom(com.google.protobuf.ByteString data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws com.google.protobuf.InvalidProtocolBufferException - Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
public static InputDataConfig parseFrom(byte[] data) throws com.google.protobuf.InvalidProtocolBufferException - Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
public static InputDataConfig parseFrom(byte[] data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws com.google.protobuf.InvalidProtocolBufferException - Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
- Throws:
IOException
-
parseFrom
public static InputDataConfig parseFrom(InputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws IOException - Throws:
IOException
-
parseDelimitedFrom
- Throws:
IOException
-
parseDelimitedFrom
public static InputDataConfig parseDelimitedFrom(InputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws IOException - Throws:
IOException
-
parseFrom
public static InputDataConfig parseFrom(com.google.protobuf.CodedInputStream input) throws IOException - Throws:
IOException
-
parseFrom
public static InputDataConfig parseFrom(com.google.protobuf.CodedInputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws IOException - Throws:
IOException
-
newBuilderForType
- Specified by:
newBuilderForTypein interfacecom.google.protobuf.Message- Specified by:
newBuilderForTypein interfacecom.google.protobuf.MessageLite
-
newBuilder
-
newBuilder
-
toBuilder
- Specified by:
toBuilderin interfacecom.google.protobuf.Message- Specified by:
toBuilderin interfacecom.google.protobuf.MessageLite
-
newBuilderForType
protected InputDataConfig.Builder newBuilderForType(com.google.protobuf.AbstractMessage.BuilderParent parent) - Overrides:
newBuilderForTypein classcom.google.protobuf.AbstractMessage
-
getDefaultInstance
-
parser
-
getParserForType
- Specified by:
getParserForTypein interfacecom.google.protobuf.Message- Specified by:
getParserForTypein interfacecom.google.protobuf.MessageLite- Overrides:
getParserForTypein classcom.google.protobuf.GeneratedMessage
-
getDefaultInstanceForType
- Specified by:
getDefaultInstanceForTypein interfacecom.google.protobuf.MessageLiteOrBuilder- Specified by:
getDefaultInstanceForTypein interfacecom.google.protobuf.MessageOrBuilder
-