In deployment settings you'll either need to configure environment variables with your AWS credentials (you can mark these as secret), or you'll need to follow the OIDC guide so that deployments can issue short term AWS credentials for the operation:
https://www.pulumi.com/docs/pulumi-cloud/deployments/oidc/aws/