It is entirely possible to use pulumi operator from outside the cluster if your control plane is exposed (and secure).
You can either refer to another stack output for getting the cluster credentials if( the clusters were created using pulumi)
Alternatively, you can encrypt the control plane kubeconfig in a pulumi secret inside the Pulumi.{env}.yaml.