INSIGHT AI

Source-linked text edition ·

Amazon SageMaker AI inference now supports GPU partitioning for real-time endpoints

The written, source-linked counterpart to this video.

Spoken scripts · Report and scripts (PDF)

Published edition1 story

Amazon SageMaker AI inference now supports GPU partitioning for real-time endpoints

Amazon SageMaker AI inference now supports GPU partitioning, enabling you to run several models on a single GPU instead of dedicating a whole accelerator to each one.

Using NVIDIA Multi-Instance GPU (MIG) technology, SageMaker AI divides a GPU into as many as seven isolated partitions, each with its own memory and compute.

Source evidence for Amazon SageMaker AI inference now supports GPU partitioning for real-time endpoints
Source-linked proof · original source

Video edition · Markdown edition

Source ledger