do pulumi stack needs to connect to specific aws profile to work with respective aws environment aka dev/integration/prod.... how do pulumi stack know which env to work?

Pulumi doesn't NEED to connect to a specific aws proflle. You CAN declare one in the stack config via the

aws:profile

key

Thanks