Uses of Class
com.google.cloud.aiplatform.v1.SpeculativeDecodingSpec.Builder
Packages that use SpeculativeDecodingSpec.Builder
-
Uses of SpeculativeDecodingSpec.Builder in com.google.cloud.aiplatform.v1
Methods in com.google.cloud.aiplatform.v1 that return SpeculativeDecodingSpec.BuilderModifier and TypeMethodDescriptionSpeculativeDecodingSpec.Builder.clear()SpeculativeDecodingSpec.Builder.clearDraftModelSpeculation()draft model speculation.SpeculativeDecodingSpec.Builder.clearNgramSpeculation()N-Gram speculation.SpeculativeDecodingSpec.Builder.clearSpeculation()SpeculativeDecodingSpec.Builder.clearSpeculativeTokenCount()The number of speculative tokens to generate at each step.DeployedModel.Builder.getSpeculativeDecodingSpecBuilder()Optional.SpeculativeDecodingSpec.Builder.mergeDraftModelSpeculation(SpeculativeDecodingSpec.DraftModelSpeculation value) draft model speculation.SpeculativeDecodingSpec.Builder.mergeFrom(SpeculativeDecodingSpec other) SpeculativeDecodingSpec.Builder.mergeFrom(com.google.protobuf.CodedInputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) SpeculativeDecodingSpec.Builder.mergeFrom(com.google.protobuf.Message other) SpeculativeDecodingSpec.Builder.mergeNgramSpeculation(SpeculativeDecodingSpec.NgramSpeculation value) N-Gram speculation.SpeculativeDecodingSpec.newBuilder()SpeculativeDecodingSpec.newBuilder(SpeculativeDecodingSpec prototype) SpeculativeDecodingSpec.newBuilderForType()protected SpeculativeDecodingSpec.BuilderSpeculativeDecodingSpec.newBuilderForType(com.google.protobuf.AbstractMessage.BuilderParent parent) SpeculativeDecodingSpec.Builder.setDraftModelSpeculation(SpeculativeDecodingSpec.DraftModelSpeculation value) draft model speculation.SpeculativeDecodingSpec.Builder.setDraftModelSpeculation(SpeculativeDecodingSpec.DraftModelSpeculation.Builder builderForValue) draft model speculation.SpeculativeDecodingSpec.Builder.setNgramSpeculation(SpeculativeDecodingSpec.NgramSpeculation value) N-Gram speculation.SpeculativeDecodingSpec.Builder.setNgramSpeculation(SpeculativeDecodingSpec.NgramSpeculation.Builder builderForValue) N-Gram speculation.SpeculativeDecodingSpec.Builder.setSpeculativeTokenCount(int value) The number of speculative tokens to generate at each step.SpeculativeDecodingSpec.toBuilder()Methods in com.google.cloud.aiplatform.v1 with parameters of type SpeculativeDecodingSpec.BuilderModifier and TypeMethodDescriptionDeployedModel.Builder.setSpeculativeDecodingSpec(SpeculativeDecodingSpec.Builder builderForValue) Optional.