Inside a GitHub Action I'm now getting this error here:

error: could not load plugin for azure provider 'urn:pulumi:incidentdev::azure-incidents::pulumi:providers:azure::default_2_5_0_alpha_1586239871': no resource plugin 'azure-v2.5.0-alpha.1586239871' found in the workspace or on your $PATH, install the plugin using `pulumi plugin install resource azure v2.5.0-alpha.1586239871`

Just before that however it is installing the correct azure plugin based on our package.json

Logged into 5a66626ce332 as root (***)

> @pulumi/azure@3.4.0 install /github/workspace/node_modules/@pulumi/azure
> node scripts/install-pulumi-plugin.js resource azure v3.4.0

[resource plugin azure-3.4.0] installing

Downloading plugin: 0 B / 47.81 MiB    0.00%
Downloading plugin: 86.06 KiB / 47.81 MiB    0.18% 1m53s
Downloading plugin: 854.06 KiB / 47.81 MiB    1.74% 22s
Downloading plugin: 3.44 MiB / 47.81 MiB    7.19% 7s
Downloading plugin: 12.08 MiB / 47.81 MiB   25.27% 2s
Downloading plugin: 18.15 MiB / 47.81 MiB   37.95% 1s
Downloading plugin: 25.56 MiB / 47.81 MiB   53.46% 1s
Downloading plugin: 32.87 MiB / 47.81 MiB   68.74%
Downloading plugin: 40.58 MiB / 47.81 MiB   84.88%
Downloading plugin: 47.81 MiB / 47.81 MiB  100.00%
Downloading plugin: 47.81 MiB / 47.81 MiB  100.00%
Downloading plugin: 47.81 MiB / 47.81 MiB  100.00%
Downloading plugin: 47.81 MiB / 47.81 MiB  100.00%
Downloading plugin: 47.81 MiB / 47.81 MiB  100.00%
Downloading plugin: 47.81 MiB / 47.81 MiB  100.00%
Downloading plugin: 47.81 MiB / 47.81 MiB  100.00% 2s
Moving plugin... done.

Locally we've updated to the latest pulumi version already.