ugh yikes, just ran into total failure trying to p...
# general
s
ugh yikes, just ran into total failure trying to perform an update that required replacing an EKS cluster
Copy code
error: post-step event returned an error: failed to save snapshot: .pulumi/stacks/base.non-prod.json: snapshot integrity failure; it was already written, but is invalid (backup available at .pulumi/stacks/base.non-prod.json.bak): resource urn:pulumi:base.non-prod::yd-base::yd:eks:Cluster$eks:index:Cluster$kubernetes:core/v1:ConfigMap::yd-eks-nodeAccess refers to unknown provider urn:pulumi:base.non-prod::yd-base::yd:eks:Cluster$eks:index:Cluster$pulumi:providers:kubernetes::yd-eks-eks-k8s::b48893e2-fd53-4bed-9753-c28de972084c
i think i understand the error (the provider was deleted when the cluster was replaced), but unsure how to resolve restoring the backup, any tips?
also wondering if this needs a bug report
suggested solution kind of sucks in my case, since the dependency tree is pretty deep
what a total clusterfuck
b
we're sorry for this experience. generally, if you use autonaming and don't provide explicit clusternames, this doesn't happen the reason it happens when using explicit names is because the provider resource has an explicit name in it, the cluster disappears and then there's nowhere to put the the kubernetes resources
unfortunately there's not much you can do once you get into this state except repaiir your statefile 😞
s
yeah, okay, that makes sense. i understand the issue, and generally this kind of operation isn’t the sort of thing i’d expect to do in production, just didn’t expect to blow my foot off either
so you’re suggesting that we let pulumi name the cluster (i.e. suffix it automatically?)
hopefully don’t have to do this again but probably worth versus having pretty names
m
Thanks for leaving a comment on https://github.com/pulumi/pulumi/issues/4996, Jem, and sorry you hit this. I think that with the experience you’ve described in the thread we may have enough data to repro this, which has been tricky in the past.
❤️ 1
s
a little more info, the biggest clean up was helm chart objects, which even though they expressed a parent relationship to the cluster, got left behind