Package com.google.cloud.aiplatform.v1
Class ExportDataConfig
java.lang.Object
com.google.protobuf.AbstractMessageLite
com.google.protobuf.AbstractMessage
com.google.protobuf.GeneratedMessage
com.google.cloud.aiplatform.v1.ExportDataConfig
- All Implemented Interfaces:
ExportDataConfigOrBuilder,com.google.protobuf.Message,com.google.protobuf.MessageLite,com.google.protobuf.MessageLiteOrBuilder,com.google.protobuf.MessageOrBuilder,Serializable
@Generated
public final class ExportDataConfig
extends com.google.protobuf.GeneratedMessage
implements ExportDataConfigOrBuilder
Describes what part of the Dataset is to be exported, the destination of the export and how to export.Protobuf type
google.cloud.aiplatform.v1.ExportDataConfig- See Also:
-
Nested Class Summary
Nested ClassesModifier and TypeClassDescriptionstatic final classDescribes what part of the Dataset is to be exported, the destination of the export and how to export.static enumstatic enumExportUse indicates the usage of the exported files.static enumNested classes/interfaces inherited from class com.google.protobuf.GeneratedMessage
com.google.protobuf.GeneratedMessage.ExtendableBuilder<MessageT extends com.google.protobuf.GeneratedMessage.ExtendableMessage<MessageT>,BuilderT extends com.google.protobuf.GeneratedMessage.ExtendableBuilder<MessageT, BuilderT>>, com.google.protobuf.GeneratedMessage.ExtendableMessage<MessageT extends com.google.protobuf.GeneratedMessage.ExtendableMessage<MessageT>>, com.google.protobuf.GeneratedMessage.ExtendableMessageOrBuilder<MessageT extends com.google.protobuf.GeneratedMessage.ExtendableMessage<MessageT>>, com.google.protobuf.GeneratedMessage.FieldAccessorTable, com.google.protobuf.GeneratedMessage.GeneratedExtension<ContainingT extends com.google.protobuf.Message, T extends Object>, com.google.protobuf.GeneratedMessage.UnusedPrivateParameter Nested classes/interfaces inherited from class com.google.protobuf.AbstractMessage
com.google.protobuf.AbstractMessage.BuilderParentNested classes/interfaces inherited from class com.google.protobuf.AbstractMessageLite
com.google.protobuf.AbstractMessageLite.InternalOneOfEnum -
Field Summary
FieldsModifier and TypeFieldDescriptionstatic final intstatic final intstatic final intstatic final intstatic final intstatic final intstatic final intFields inherited from class com.google.protobuf.GeneratedMessage
alwaysUseFieldBuilders, loggedPre22TypeNames, unknownFieldsFields inherited from class com.google.protobuf.AbstractMessage
memoizedSizeFields inherited from class com.google.protobuf.AbstractMessageLite
memoizedHashCode -
Method Summary
Modifier and TypeMethodDescriptionbooleanThe Cloud Storage URI that points to a YAML file describing the annotation schema.com.google.protobuf.ByteStringThe Cloud Storage URI that points to a YAML file describing the annotation schema.An expression for filtering what part of the Dataset is to be exported.com.google.protobuf.ByteStringAn expression for filtering what part of the Dataset is to be exported.static ExportDataConfigstatic final com.google.protobuf.Descriptors.DescriptorIndicates the usage of the exported files.intIndicates the usage of the exported files.Split based on the provided filters for each set.Split based on the provided filters for each set.Split based on fractions defining the size of each set.Split based on fractions defining the size of each set.The Google Cloud Storage location where the output is to be written to.The Google Cloud Storage location where the output is to be written to.com.google.protobuf.Parser<ExportDataConfig>The ID of a SavedQuery (annotation set) under the Dataset specified by [ExportDataRequest.name][google.cloud.aiplatform.v1.ExportDataRequest.name] used for filtering Annotations for training.com.google.protobuf.ByteStringThe ID of a SavedQuery (annotation set) under the Dataset specified by [ExportDataRequest.name][google.cloud.aiplatform.v1.ExportDataRequest.name] used for filtering Annotations for training.intbooleanSplit based on the provided filters for each set.booleanSplit based on fractions defining the size of each set.booleanThe Google Cloud Storage location where the output is to be written to.inthashCode()protected com.google.protobuf.GeneratedMessage.FieldAccessorTablefinal booleanstatic ExportDataConfig.Builderstatic ExportDataConfig.BuildernewBuilder(ExportDataConfig prototype) protected ExportDataConfig.BuildernewBuilderForType(com.google.protobuf.AbstractMessage.BuilderParent parent) static ExportDataConfigparseDelimitedFrom(InputStream input) static ExportDataConfigparseDelimitedFrom(InputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) static ExportDataConfigparseFrom(byte[] data) static ExportDataConfigparseFrom(byte[] data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) static ExportDataConfigparseFrom(com.google.protobuf.ByteString data) static ExportDataConfigparseFrom(com.google.protobuf.ByteString data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) static ExportDataConfigparseFrom(com.google.protobuf.CodedInputStream input) static ExportDataConfigparseFrom(com.google.protobuf.CodedInputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) static ExportDataConfigparseFrom(InputStream input) static ExportDataConfigparseFrom(InputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) static ExportDataConfigparseFrom(ByteBuffer data) static ExportDataConfigparseFrom(ByteBuffer data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) static com.google.protobuf.Parser<ExportDataConfig>parser()voidwriteTo(com.google.protobuf.CodedOutputStream output) Methods inherited from class com.google.protobuf.GeneratedMessage
canUseUnsafe, computeStringSize, computeStringSizeNoTag, emptyBooleanList, emptyDoubleList, emptyFloatList, emptyIntList, emptyList, emptyLongList, getAllFields, getDescriptorForType, getField, getOneofFieldDescriptor, getRepeatedField, getRepeatedFieldCount, getUnknownFields, hasField, hasOneof, internalGetMapField, internalGetMapFieldReflection, isStringEmpty, makeExtensionsImmutable, makeMutableCopy, makeMutableCopy, mergeFromAndMakeImmutableInternal, newFileScopedGeneratedExtension, newInstance, newMessageScopedGeneratedExtension, parseDelimitedWithIOException, parseDelimitedWithIOException, parseUnknownField, parseUnknownFieldProto3, parseWithIOException, parseWithIOException, parseWithIOException, parseWithIOException, serializeBooleanMapTo, serializeIntegerMapTo, serializeLongMapTo, serializeStringMapTo, writeReplace, writeString, writeStringNoTagMethods inherited from class com.google.protobuf.AbstractMessage
findInitializationErrors, getInitializationErrorString, hashFields, toStringMethods inherited from class com.google.protobuf.AbstractMessageLite
addAll, checkByteStringIsUtf8, toByteArray, toByteString, writeDelimitedTo, writeToMethods inherited from class java.lang.Object
clone, finalize, getClass, notify, notifyAll, wait, wait, waitMethods inherited from interface com.google.protobuf.MessageLite
toByteArray, toByteString, writeDelimitedTo, writeToMethods inherited from interface com.google.protobuf.MessageOrBuilder
findInitializationErrors, getAllFields, getDescriptorForType, getField, getInitializationErrorString, getOneofFieldDescriptor, getRepeatedField, getRepeatedFieldCount, getUnknownFields, hasField, hasOneof
-
Field Details
-
GCS_DESTINATION_FIELD_NUMBER
public static final int GCS_DESTINATION_FIELD_NUMBER- See Also:
-
FRACTION_SPLIT_FIELD_NUMBER
public static final int FRACTION_SPLIT_FIELD_NUMBER- See Also:
-
FILTER_SPLIT_FIELD_NUMBER
public static final int FILTER_SPLIT_FIELD_NUMBER- See Also:
-
ANNOTATIONS_FILTER_FIELD_NUMBER
public static final int ANNOTATIONS_FILTER_FIELD_NUMBER- See Also:
-
SAVED_QUERY_ID_FIELD_NUMBER
public static final int SAVED_QUERY_ID_FIELD_NUMBER- See Also:
-
ANNOTATION_SCHEMA_URI_FIELD_NUMBER
public static final int ANNOTATION_SCHEMA_URI_FIELD_NUMBER- See Also:
-
EXPORT_USE_FIELD_NUMBER
public static final int EXPORT_USE_FIELD_NUMBER- See Also:
-
-
Method Details
-
getDescriptor
public static final com.google.protobuf.Descriptors.Descriptor getDescriptor() -
internalGetFieldAccessorTable
protected com.google.protobuf.GeneratedMessage.FieldAccessorTable internalGetFieldAccessorTable()- Specified by:
internalGetFieldAccessorTablein classcom.google.protobuf.GeneratedMessage
-
getDestinationCase
- Specified by:
getDestinationCasein interfaceExportDataConfigOrBuilder
-
getSplitCase
- Specified by:
getSplitCasein interfaceExportDataConfigOrBuilder
-
hasGcsDestination
public boolean hasGcsDestination()The Google Cloud Storage location where the output is to be written to. In the given directory a new directory will be created with name: `export-data-<dataset-display-name>-<timestamp-of-export-call>` where timestamp is in YYYY-MM-DDThh:mm:ss.sssZ ISO-8601 format. All export output will be written into that directory. Inside that directory, annotations with the same schema will be grouped into sub directories which are named with the corresponding annotations' schema title. Inside these sub directories, a schema.yaml will be created to describe the output format.
.google.cloud.aiplatform.v1.GcsDestination gcs_destination = 1;- Specified by:
hasGcsDestinationin interfaceExportDataConfigOrBuilder- Returns:
- Whether the gcsDestination field is set.
-
getGcsDestination
The Google Cloud Storage location where the output is to be written to. In the given directory a new directory will be created with name: `export-data-<dataset-display-name>-<timestamp-of-export-call>` where timestamp is in YYYY-MM-DDThh:mm:ss.sssZ ISO-8601 format. All export output will be written into that directory. Inside that directory, annotations with the same schema will be grouped into sub directories which are named with the corresponding annotations' schema title. Inside these sub directories, a schema.yaml will be created to describe the output format.
.google.cloud.aiplatform.v1.GcsDestination gcs_destination = 1;- Specified by:
getGcsDestinationin interfaceExportDataConfigOrBuilder- Returns:
- The gcsDestination.
-
getGcsDestinationOrBuilder
The Google Cloud Storage location where the output is to be written to. In the given directory a new directory will be created with name: `export-data-<dataset-display-name>-<timestamp-of-export-call>` where timestamp is in YYYY-MM-DDThh:mm:ss.sssZ ISO-8601 format. All export output will be written into that directory. Inside that directory, annotations with the same schema will be grouped into sub directories which are named with the corresponding annotations' schema title. Inside these sub directories, a schema.yaml will be created to describe the output format.
.google.cloud.aiplatform.v1.GcsDestination gcs_destination = 1;- Specified by:
getGcsDestinationOrBuilderin interfaceExportDataConfigOrBuilder
-
hasFractionSplit
public boolean hasFractionSplit()Split based on fractions defining the size of each set.
.google.cloud.aiplatform.v1.ExportFractionSplit fraction_split = 5;- Specified by:
hasFractionSplitin interfaceExportDataConfigOrBuilder- Returns:
- Whether the fractionSplit field is set.
-
getFractionSplit
Split based on fractions defining the size of each set.
.google.cloud.aiplatform.v1.ExportFractionSplit fraction_split = 5;- Specified by:
getFractionSplitin interfaceExportDataConfigOrBuilder- Returns:
- The fractionSplit.
-
getFractionSplitOrBuilder
Split based on fractions defining the size of each set.
.google.cloud.aiplatform.v1.ExportFractionSplit fraction_split = 5;- Specified by:
getFractionSplitOrBuilderin interfaceExportDataConfigOrBuilder
-
hasFilterSplit
public boolean hasFilterSplit()Split based on the provided filters for each set.
.google.cloud.aiplatform.v1.ExportFilterSplit filter_split = 7;- Specified by:
hasFilterSplitin interfaceExportDataConfigOrBuilder- Returns:
- Whether the filterSplit field is set.
-
getFilterSplit
Split based on the provided filters for each set.
.google.cloud.aiplatform.v1.ExportFilterSplit filter_split = 7;- Specified by:
getFilterSplitin interfaceExportDataConfigOrBuilder- Returns:
- The filterSplit.
-
getFilterSplitOrBuilder
Split based on the provided filters for each set.
.google.cloud.aiplatform.v1.ExportFilterSplit filter_split = 7;- Specified by:
getFilterSplitOrBuilderin interfaceExportDataConfigOrBuilder
-
getAnnotationsFilter
An expression for filtering what part of the Dataset is to be exported. Only Annotations that match this filter will be exported. The filter syntax is the same as in [ListAnnotations][google.cloud.aiplatform.v1.DatasetService.ListAnnotations].
string annotations_filter = 2;- Specified by:
getAnnotationsFilterin interfaceExportDataConfigOrBuilder- Returns:
- The annotationsFilter.
-
getAnnotationsFilterBytes
public com.google.protobuf.ByteString getAnnotationsFilterBytes()An expression for filtering what part of the Dataset is to be exported. Only Annotations that match this filter will be exported. The filter syntax is the same as in [ListAnnotations][google.cloud.aiplatform.v1.DatasetService.ListAnnotations].
string annotations_filter = 2;- Specified by:
getAnnotationsFilterBytesin interfaceExportDataConfigOrBuilder- Returns:
- The bytes for annotationsFilter.
-
getSavedQueryId
The ID of a SavedQuery (annotation set) under the Dataset specified by [ExportDataRequest.name][google.cloud.aiplatform.v1.ExportDataRequest.name] used for filtering Annotations for training. Only used for custom training data export use cases. Only applicable to Datasets that have SavedQueries. Only Annotations that are associated with this SavedQuery are used in respectively training. When used in conjunction with [annotations_filter][google.cloud.aiplatform.v1.ExportDataConfig.annotations_filter], the Annotations used for training are filtered by both [saved_query_id][google.cloud.aiplatform.v1.ExportDataConfig.saved_query_id] and [annotations_filter][google.cloud.aiplatform.v1.ExportDataConfig.annotations_filter]. Only one of [saved_query_id][google.cloud.aiplatform.v1.ExportDataConfig.saved_query_id] and [annotation_schema_uri][google.cloud.aiplatform.v1.ExportDataConfig.annotation_schema_uri] should be specified as both of them represent the same thing: problem type.
string saved_query_id = 11;- Specified by:
getSavedQueryIdin interfaceExportDataConfigOrBuilder- Returns:
- The savedQueryId.
-
getSavedQueryIdBytes
public com.google.protobuf.ByteString getSavedQueryIdBytes()The ID of a SavedQuery (annotation set) under the Dataset specified by [ExportDataRequest.name][google.cloud.aiplatform.v1.ExportDataRequest.name] used for filtering Annotations for training. Only used for custom training data export use cases. Only applicable to Datasets that have SavedQueries. Only Annotations that are associated with this SavedQuery are used in respectively training. When used in conjunction with [annotations_filter][google.cloud.aiplatform.v1.ExportDataConfig.annotations_filter], the Annotations used for training are filtered by both [saved_query_id][google.cloud.aiplatform.v1.ExportDataConfig.saved_query_id] and [annotations_filter][google.cloud.aiplatform.v1.ExportDataConfig.annotations_filter]. Only one of [saved_query_id][google.cloud.aiplatform.v1.ExportDataConfig.saved_query_id] and [annotation_schema_uri][google.cloud.aiplatform.v1.ExportDataConfig.annotation_schema_uri] should be specified as both of them represent the same thing: problem type.
string saved_query_id = 11;- Specified by:
getSavedQueryIdBytesin interfaceExportDataConfigOrBuilder- Returns:
- The bytes for savedQueryId.
-
getAnnotationSchemaUri
The Cloud Storage URI that points to a YAML file describing the annotation schema. The schema is defined as an OpenAPI 3.0.2 [Schema Object](https://github.com/OAI/OpenAPI-Specification/blob/main/versions/3.0.2.md#schemaObject). The schema files that can be used here are found in gs://google-cloud-aiplatform/schema/dataset/annotation/, note that the chosen schema must be consistent with [metadata][google.cloud.aiplatform.v1.Dataset.metadata_schema_uri] of the Dataset specified by [ExportDataRequest.name][google.cloud.aiplatform.v1.ExportDataRequest.name]. Only used for custom training data export use cases. Only applicable to Datasets that have DataItems and Annotations. Only Annotations that both match this schema and belong to DataItems not ignored by the split method are used in respectively training, validation or test role, depending on the role of the DataItem they are on. When used in conjunction with [annotations_filter][google.cloud.aiplatform.v1.ExportDataConfig.annotations_filter], the Annotations used for training are filtered by both [annotations_filter][google.cloud.aiplatform.v1.ExportDataConfig.annotations_filter] and [annotation_schema_uri][google.cloud.aiplatform.v1.ExportDataConfig.annotation_schema_uri].
string annotation_schema_uri = 12;- Specified by:
getAnnotationSchemaUriin interfaceExportDataConfigOrBuilder- Returns:
- The annotationSchemaUri.
-
getAnnotationSchemaUriBytes
public com.google.protobuf.ByteString getAnnotationSchemaUriBytes()The Cloud Storage URI that points to a YAML file describing the annotation schema. The schema is defined as an OpenAPI 3.0.2 [Schema Object](https://github.com/OAI/OpenAPI-Specification/blob/main/versions/3.0.2.md#schemaObject). The schema files that can be used here are found in gs://google-cloud-aiplatform/schema/dataset/annotation/, note that the chosen schema must be consistent with [metadata][google.cloud.aiplatform.v1.Dataset.metadata_schema_uri] of the Dataset specified by [ExportDataRequest.name][google.cloud.aiplatform.v1.ExportDataRequest.name]. Only used for custom training data export use cases. Only applicable to Datasets that have DataItems and Annotations. Only Annotations that both match this schema and belong to DataItems not ignored by the split method are used in respectively training, validation or test role, depending on the role of the DataItem they are on. When used in conjunction with [annotations_filter][google.cloud.aiplatform.v1.ExportDataConfig.annotations_filter], the Annotations used for training are filtered by both [annotations_filter][google.cloud.aiplatform.v1.ExportDataConfig.annotations_filter] and [annotation_schema_uri][google.cloud.aiplatform.v1.ExportDataConfig.annotation_schema_uri].
string annotation_schema_uri = 12;- Specified by:
getAnnotationSchemaUriBytesin interfaceExportDataConfigOrBuilder- Returns:
- The bytes for annotationSchemaUri.
-
getExportUseValue
public int getExportUseValue()Indicates the usage of the exported files.
.google.cloud.aiplatform.v1.ExportDataConfig.ExportUse export_use = 4;- Specified by:
getExportUseValuein interfaceExportDataConfigOrBuilder- Returns:
- The enum numeric value on the wire for exportUse.
-
getExportUse
Indicates the usage of the exported files.
.google.cloud.aiplatform.v1.ExportDataConfig.ExportUse export_use = 4;- Specified by:
getExportUsein interfaceExportDataConfigOrBuilder- Returns:
- The exportUse.
-
isInitialized
public final boolean isInitialized()- Specified by:
isInitializedin interfacecom.google.protobuf.MessageLiteOrBuilder- Overrides:
isInitializedin classcom.google.protobuf.GeneratedMessage
-
writeTo
- Specified by:
writeToin interfacecom.google.protobuf.MessageLite- Overrides:
writeToin classcom.google.protobuf.GeneratedMessage- Throws:
IOException
-
getSerializedSize
public int getSerializedSize()- Specified by:
getSerializedSizein interfacecom.google.protobuf.MessageLite- Overrides:
getSerializedSizein classcom.google.protobuf.GeneratedMessage
-
equals
- Specified by:
equalsin interfacecom.google.protobuf.Message- Overrides:
equalsin classcom.google.protobuf.AbstractMessage
-
hashCode
public int hashCode()- Specified by:
hashCodein interfacecom.google.protobuf.Message- Overrides:
hashCodein classcom.google.protobuf.AbstractMessage
-
parseFrom
public static ExportDataConfig parseFrom(ByteBuffer data) throws com.google.protobuf.InvalidProtocolBufferException - Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
public static ExportDataConfig parseFrom(ByteBuffer data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws com.google.protobuf.InvalidProtocolBufferException - Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
public static ExportDataConfig parseFrom(com.google.protobuf.ByteString data) throws com.google.protobuf.InvalidProtocolBufferException - Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
public static ExportDataConfig parseFrom(com.google.protobuf.ByteString data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws com.google.protobuf.InvalidProtocolBufferException - Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
public static ExportDataConfig parseFrom(byte[] data) throws com.google.protobuf.InvalidProtocolBufferException - Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
public static ExportDataConfig parseFrom(byte[] data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws com.google.protobuf.InvalidProtocolBufferException - Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
- Throws:
IOException
-
parseFrom
public static ExportDataConfig parseFrom(InputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws IOException - Throws:
IOException
-
parseDelimitedFrom
- Throws:
IOException
-
parseDelimitedFrom
public static ExportDataConfig parseDelimitedFrom(InputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws IOException - Throws:
IOException
-
parseFrom
public static ExportDataConfig parseFrom(com.google.protobuf.CodedInputStream input) throws IOException - Throws:
IOException
-
parseFrom
public static ExportDataConfig parseFrom(com.google.protobuf.CodedInputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws IOException - Throws:
IOException
-
newBuilderForType
- Specified by:
newBuilderForTypein interfacecom.google.protobuf.Message- Specified by:
newBuilderForTypein interfacecom.google.protobuf.MessageLite
-
newBuilder
-
newBuilder
-
toBuilder
- Specified by:
toBuilderin interfacecom.google.protobuf.Message- Specified by:
toBuilderin interfacecom.google.protobuf.MessageLite
-
newBuilderForType
protected ExportDataConfig.Builder newBuilderForType(com.google.protobuf.AbstractMessage.BuilderParent parent) - Overrides:
newBuilderForTypein classcom.google.protobuf.AbstractMessage
-
getDefaultInstance
-
parser
-
getParserForType
- Specified by:
getParserForTypein interfacecom.google.protobuf.Message- Specified by:
getParserForTypein interfacecom.google.protobuf.MessageLite- Overrides:
getParserForTypein classcom.google.protobuf.GeneratedMessage
-
getDefaultInstanceForType
- Specified by:
getDefaultInstanceForTypein interfacecom.google.protobuf.MessageLiteOrBuilder- Specified by:
getDefaultInstanceForTypein interfacecom.google.protobuf.MessageOrBuilder
-