Sorry for the late response. I was able to figure out what the issue was. It wasnt a pulumi error it was actually a powershell problem. Powershell was complaining about the secret being use having an & in it
Had to find the runner logs to get the full error as the github console doesnt show the complete error from powershell sometimes