Would it make sense to add automated tests that check if there are no changes for well-known examples in new versions? That could detect the replace suggestions like this?

Yes - https://github.com/pulumi/pulumi/issues/2757 includes a concrete proposal for this.