This message was deleted.
# aws
s
This message was deleted.
s
this is a really open ended question that depends a lot on the context of your situation. One way is to use AWS ASGs and autoscale based on CloudWatch metrics for GPU usage. Another possibility is with a container orchestrator like K8s/EKS, which can be set up to autoscale as well, assuming your workloads are already containerized.
p
Yes, I intentionally wanted to ask it open first 🙂 OK, I guess I will go for the AWS Autoscaling Group first 👍 Are there already workflows available on how to create a such via pulumi?