Package com.google.cloud.aiplatform.v1

Interface SpeculativeDecodingSpec.NgramSpeculationOrBuilder

All Superinterfaces:
com.google.protobuf.MessageLiteOrBuilder, com.google.protobuf.MessageOrBuilder
All Known Implementing Classes:
SpeculativeDecodingSpec.NgramSpeculation, SpeculativeDecodingSpec.NgramSpeculation.Builder
Enclosing class:
SpeculativeDecodingSpec
public static interface SpeculativeDecodingSpec.NgramSpeculationOrBuilder extends com.google.protobuf.MessageOrBuilder

  • Method Summary

    Modifier and Type
    Method
    Description
    int
    getNgramSize()
    The number of last N input tokens used as ngram to search/match against the previous prompt sequence.

    Methods inherited from interface com.google.protobuf.MessageLiteOrBuilder

    isInitialized

    Methods inherited from interface com.google.protobuf.MessageOrBuilder

    findInitializationErrors, getAllFields, getDefaultInstanceForType, getDescriptorForType, getField, getInitializationErrorString, getOneofFieldDescriptor, getRepeatedField, getRepeatedFieldCount, getUnknownFields, hasField, hasOneof

  • Method Details

    • getNgramSize

      int getNgramSize()
       The number of last N input tokens used as ngram to search/match
 against the previous prompt sequence.
 This is equal to the N in N-Gram.
 The default value is 3 if not specified.
      int32 ngram_size = 1;
      Returns:
      The ngramSize.