I have found when the underlying stack diverges from the pulumi config, you'll need to delete individual things from pulumi using https://www.pulumi.com/docs/reference/cli/pulumi_state_delete/