AWS: SageMaker Inference now supports Multi-Instance GPU to maximize GPU utilization for model endpoints
Amazon SageMaker Inference now supports GPU partitioning with NVIDIA Multi Instance GPU (MIG), which divides one GPU into hardware isolated partitions so you can run a different model in each or take a right sized fraction of a newer accelerator.
The AWS Machine Learning Blog page documents the AWS update.