I seem to have messed up my state, not a critical environment but a good learning opportunity in how to fix issues like this.
When I try to delete a resource now it complains about the provider doesn't exist any more, and from the exported state file that make sense since the id of the kubernetes provider differs between the provider and where it is referenced.
In an attempt trying to fix this I did export the file and then just tried to update the ID so they match between the provider definition in the file and where it is referenced, but for some reason that doesn't work. When I change the ID of the provider and then to an import followed by an export the ID hasn't changed. Can't I change IDs when doing imports of stacks?