Uses of Class
com.google.cloud.aiplatform.v1.SpeculativeDecodingSpec.NgramSpeculation.Builder
Packages that use SpeculativeDecodingSpec.NgramSpeculation.Builder
-
Uses of SpeculativeDecodingSpec.NgramSpeculation.Builder in com.google.cloud.aiplatform.v1
Methods in com.google.cloud.aiplatform.v1 that return SpeculativeDecodingSpec.NgramSpeculation.BuilderModifier and TypeMethodDescriptionSpeculativeDecodingSpec.NgramSpeculation.Builder.clear()SpeculativeDecodingSpec.NgramSpeculation.Builder.clearNgramSize()The number of last N input tokens used as ngram to search/match against the previous prompt sequence.SpeculativeDecodingSpec.Builder.getNgramSpeculationBuilder()N-Gram speculation.SpeculativeDecodingSpec.NgramSpeculation.Builder.mergeFrom(SpeculativeDecodingSpec.NgramSpeculation other) SpeculativeDecodingSpec.NgramSpeculation.Builder.mergeFrom(com.google.protobuf.CodedInputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) SpeculativeDecodingSpec.NgramSpeculation.Builder.mergeFrom(com.google.protobuf.Message other) SpeculativeDecodingSpec.NgramSpeculation.newBuilder()SpeculativeDecodingSpec.NgramSpeculation.newBuilder(SpeculativeDecodingSpec.NgramSpeculation prototype) SpeculativeDecodingSpec.NgramSpeculation.newBuilderForType()SpeculativeDecodingSpec.NgramSpeculation.newBuilderForType(com.google.protobuf.AbstractMessage.BuilderParent parent) SpeculativeDecodingSpec.NgramSpeculation.Builder.setNgramSize(int value) The number of last N input tokens used as ngram to search/match against the previous prompt sequence.SpeculativeDecodingSpec.NgramSpeculation.toBuilder()Methods in com.google.cloud.aiplatform.v1 with parameters of type SpeculativeDecodingSpec.NgramSpeculation.BuilderModifier and TypeMethodDescriptionSpeculativeDecodingSpec.Builder.setNgramSpeculation(SpeculativeDecodingSpec.NgramSpeculation.Builder builderForValue) N-Gram speculation.