Examples on how to use your own model serving containers or extend pre-built containers on SageMaker.

PyTorch

Coming soon ..

Scikit

Coming soon…

TensorFlow

Elastic inference

• Using Amazon Elastic Inference with a pre-trained TensorFlow Serving model on SageMaker
• Deploy the trained Model to an Endpoint with an attached EI accelerator
• Invoke the Endpoint to get inferences
• Delete the Endpoint

TensorFlow Serving container

• Using the SageMaker TensorFlow Serving Container