Uses of Interface
software.amazon.awssdk.services.sagemakerruntime.model.InvokeEndpointWithResponseStreamRequest.Builder
Packages that use InvokeEndpointWithResponseStreamRequest.Builder
Package
Description
The Amazon SageMaker AI runtime API.
-
Uses of InvokeEndpointWithResponseStreamRequest.Builder in software.amazon.awssdk.services.sagemakerruntime
Method parameters in software.amazon.awssdk.services.sagemakerruntime with type arguments of type InvokeEndpointWithResponseStreamRequest.BuilderModifier and TypeMethodDescriptiondefault CompletableFuture<Void>SageMakerRuntimeAsyncClient.invokeEndpointWithResponseStream(Consumer<InvokeEndpointWithResponseStreamRequest.Builder> invokeEndpointWithResponseStreamRequest, InvokeEndpointWithResponseStreamResponseHandler asyncResponseHandler) Invokes a model at the specified endpoint to return the inference response as a stream. -
Uses of InvokeEndpointWithResponseStreamRequest.Builder in software.amazon.awssdk.services.sagemakerruntime.model
Methods in software.amazon.awssdk.services.sagemakerruntime.model that return InvokeEndpointWithResponseStreamRequest.BuilderModifier and TypeMethodDescriptionThe desired MIME type of the inference response from the model container.Provides input data, in the format specified in theContentTyperequest header.InvokeEndpointWithResponseStreamRequest.builder()InvokeEndpointWithResponseStreamRequest.Builder.contentType(String contentType) The MIME type of the input data in the request body.InvokeEndpointWithResponseStreamRequest.Builder.customAttributes(String customAttributes) Provides additional information about a request for an inference submitted to a model hosted at an Amazon SageMaker AI endpoint.InvokeEndpointWithResponseStreamRequest.Builder.endpointName(String endpointName) The name of the endpoint that you specified when you created the endpoint using the CreateEndpoint API.InvokeEndpointWithResponseStreamRequest.Builder.inferenceComponentName(String inferenceComponentName) If the endpoint hosts one or more inference components, this parameter specifies the name of inference component to invoke for a streaming response.InvokeEndpointWithResponseStreamRequest.Builder.inferenceId(String inferenceId) An identifier that you assign to your request.InvokeEndpointWithResponseStreamRequest.Builder.overrideConfiguration(Consumer<AwsRequestOverrideConfiguration.Builder> builderConsumer) InvokeEndpointWithResponseStreamRequest.Builder.overrideConfiguration(AwsRequestOverrideConfiguration overrideConfiguration) The ID of a stateful session to handle your request.InvokeEndpointWithResponseStreamRequest.Builder.targetContainerHostname(String targetContainerHostname) If the endpoint hosts multiple containers and is configured to use direct invocation, this parameter specifies the host name of the container to invoke.InvokeEndpointWithResponseStreamRequest.Builder.targetVariant(String targetVariant) Specify the production variant to send the inference request to when invoking an endpoint that is running two or more variants.InvokeEndpointWithResponseStreamRequest.toBuilder()Methods in software.amazon.awssdk.services.sagemakerruntime.model that return types with arguments of type InvokeEndpointWithResponseStreamRequest.BuilderModifier and TypeMethodDescriptionstatic Class<? extends InvokeEndpointWithResponseStreamRequest.Builder>InvokeEndpointWithResponseStreamRequest.serializableBuilderClass()