Is there a neat way to have pulumi delete non-empty buckets during stack update/destroy?

I believe

forceDestroy: true

handles this for you.

that doesn't work when I change bucket name of existing bucket that wasn't created with this flag initially. replace still fails with 409 when trying to delete it

That’s true. That property must have been set from the start.