Er, somehow fixed it,

pulumictl

was not installed on the docker container