AWS Lambda Adds GPU Support for Event Functions on Managed Instances
AWS Lambda now offers GPU support for EC2 G-series instances for Event Functions running on Lambda Managed Instances, letting customers run GPU-accelerated workloads with serverless simplicity.
AWS Lambda now offers GPU support for EC2 G-series instances for Event Functions running on Lambda Managed Instances, letting customers run GPU-accelerated workloads with serverless simplicity.
GPU-accelerated functions are deployed as OCI container images. Users build an image, point the function at it, and Lambda handles provisioning, scaling and event integration, with no GPU drivers, CUDA versions, AMIs, clusters or device plugins to manage.
The feature targets workloads including machine learning inference, media processing and transcoding, 3D rendering and generative media, and scientific computing and financial modeling. AWS says it is optimized for inference rather than training, and for custom models rather than large foundation models already available on services like Amazon Bedrock.
AWS says the feature addresses two customer problems: the work of building on self-managed GPU infrastructure, and low GPU utilization that leaves expensive hardware idle. Lambda consolidates functions onto instances and keeps GPUs busy across concurrent requests.
GPU-accelerated functions support the extended function timeout on Lambda Managed Instances, up to 90 minutes for asynchronous and event source mapping invocations. They support container images up to 32 GB, up to 32 GB of ephemeral storage, 2,048 to 32,768 MB of memory, 3 to 48 GB of accelerator memory, and up to 48 concurrent requests per execution environment.
The feature is generally available, supporting Amazon EC2 G-series instances (G4dn, G5, G6, G6f, Gr6, Gr6f, G6e) at launch, with more instance families to come. Customers pay the underlying EC2 instance fee, plus a 9.75 percent management fee for GPU instances, and the standard Lambda request fee of $0.20 per million requests.
Source: AWS
Ready to Modernize Your Business?
Get your AI automation roadmap in minutes, not months.
Analyze Your Workflows →