pulumi state delete

only deletes the resource from the pulumi stack, right? It doesn't delete the resource on AWS

Correct, this only modifies the state file.

👍