1. Does Pulumi tell you the Service is deleted?
2. Does Kubernetes tell you the Service is deleted?
3. Does AWS tell you the LoadBalancer is deleted?
If Yes, Yes, No - then that is most likely a Kubernetes/EKS issue.
If Yes, No, No - then that is most likely a Pulumi issue.