Uses of Interface
com.google.cloud.aiplatform.v1.SpeculativeDecodingSpec.NgramSpeculationOrBuilder

Packages that use SpeculativeDecodingSpec.NgramSpeculationOrBuilder

Package	Description
com.google.cloud.aiplatform.v1

Uses of SpeculativeDecodingSpec.NgramSpeculationOrBuilder in com.google.cloud.aiplatform.v1

Classes in com.google.cloud.aiplatform.v1 that implement SpeculativeDecodingSpec.NgramSpeculationOrBuilder

Modifier and Type	Class	Description
static final class	SpeculativeDecodingSpec.NgramSpeculation	N-Gram speculation works by trying to find matching tokens in the previous prompt sequence and use those as speculation for generating new tokens.
static final class	SpeculativeDecodingSpec.NgramSpeculation.Builder	N-Gram speculation works by trying to find matching tokens in the previous prompt sequence and use those as speculation for generating new tokens.

Methods in com.google.cloud.aiplatform.v1 that return SpeculativeDecodingSpec.NgramSpeculationOrBuilder

Modifier and Type	Method	Description
SpeculativeDecodingSpec.NgramSpeculationOrBuilder	SpeculativeDecodingSpec.Builder.getNgramSpeculationOrBuilder()	N-Gram speculation.
SpeculativeDecodingSpec.NgramSpeculationOrBuilder	SpeculativeDecodingSpec.getNgramSpeculationOrBuilder()	N-Gram speculation.
SpeculativeDecodingSpec.NgramSpeculationOrBuilder	SpeculativeDecodingSpecOrBuilder.getNgramSpeculationOrBuilder()	N-Gram speculation.