This is likely specific to the filestate backends (S3, GCS, etc.) - and should not be the case for the Pulumi Service backend.
We have work planned to overhaul the filestate backends soon to address a class of issues like this.
These issues are I believe tracking aspects of the same underlying issue - could you leave a note on whichever looks closest to your case with any additional details and/or upvotes?
• https://github.com/pulumi/pulumi/issues/4679
• https://github.com/pulumi/pulumi/issues/3714
• https://github.com/pulumi/pulumi/issues/2801