https://pulumi.com logo
Title
w

white-chef-55657

11/22/2022, 9:01 AM
howdy 👋 I recently noticed we’re no longer getting comments on PRs, I don’t think anything changed with the github integration, the only major change I can think of is that we switched to reusable workflows Pulumi still adds status checks on the PRs, but not comments - any idea how to troubleshoot this?
l

limited-rainbow-51650

11/22/2022, 10:54 AM
I will loop this by one of our engineers.
w

white-chef-55657

11/22/2022, 10:55 AM
Thanks! Should I open a support ticket?
l

limited-rainbow-51650

11/22/2022, 10:56 AM
Please do. The Github App is part of our service implementation, so please file it here: https://github.com/pulumi/service-requests/
h

hallowed-photographer-31251

11/22/2022, 4:32 PM
@white-chef-55657 if you're comfortable including some information on the issue like your pulumi org and github org that would help me debug. if you're not comfortable sharing that you can DM me
w

white-chef-55657

11/22/2022, 4:33 PM
I have a support ticket opened #2085 with all the relevant information
I see @many-telephone-49025 is on it
can I get an update from anyone on this? @many-telephone-49025 @hallowed-photographer-31251?
l

limited-rainbow-51650

11/23/2022, 1:17 PM
@white-chef-55657 our guess for now is that not all environment variables are passed to the called reusable workflow. Can you verify if the
PULUMI_CI_*
environment variables are passed to the called workflow from the parent workflow? You see the complete list of these env vars here: https://github.com/pulumi/pulumi/issues/11425
w

white-chef-55657

11/23/2022, 1:20 PM
ah, that could be it - let me look
• Any environment variables set in an
env
context defined at the workflow level in the caller workflow are not propagated to the called workflow. For more information about the
env
context, see “Context and expression syntax for GitHub Actions.”
https://docs.github.com/en/enterprise-cloud@latest/actions/using-workflows/reusing-workflows
should I pass ALL the vars listed in the issue you sent? or just the few PULUMI_CI ?
l

limited-rainbow-51650

11/23/2022, 1:26 PM
The easiest is indeed to pass all env vars. But the
PULUMI_CI_*
vars are the ones we rely on mainly.
w

white-chef-55657

11/23/2022, 1:27 PM
see the quote above, it’s a known limitation of reusable workflows, cannot share all env vars but can pass individually will add the
PULUMI_CI_*
ones to see if that fixes it, thanks!
• “PULUMI_CI_BRANCH_NAME” • “PULUMI_CI_BUILD_ID” • “PULUMI_CI_BUILD_NUMBER” • “PULUMI_CI_BUILD_TYPE” • “PULUMI_CI_BUILD_URL” • “PULUMI_CI_PULL_REQUEST_SHA” • “PULUMI_CI_SYSTEM”
l

limited-rainbow-51650

11/23/2022, 1:29 PM
Credit to @hallowed-photographer-31251 because he went into the correct direction.
w

white-chef-55657

11/23/2022, 1:29 PM
actually - I’m thinking about this again, and why would those even exist in the “caller” workflow?
perhaps you’re looking for the
GITHUB_
ones ?
this is the caller workflow, you probably need the GITHUB info about the PR that created that event
l

limited-rainbow-51650

11/23/2022, 1:31 PM
Good thinking. From the general ones, we might convert these to our Pulumi ones. Next to the
GITHUB_
ones, I also would pass the
CI_*
and
GIT_*
ones.
w

white-chef-55657

11/23/2022, 1:31 PM
ok, will give that a shot
is your github app open source?
it will probably show what it’s using from the events
l

limited-rainbow-51650

11/23/2022, 1:56 PM
No, the code of our Github app is part of our cloud service.
m

many-telephone-49025

11/23/2022, 2:07 PM
Interesting, didn't know that the env variables are not propagated down... Thanks @white-chef-55657 for the link!
w

white-chef-55657

11/23/2022, 2:09 PM
Passing CI_ GITHUB_ and GIT_ did not solve it
As checks are properly added and marked successful I don't think it's an issue with the env vars, Your GitHub app gets the information it needs to mark the checks but not post comments Could someone on your end look at the logs and see what's missing ?
hello?
h

hallowed-photographer-31251

11/24/2022, 5:07 PM
@white-chef-55657 fwiw a lot of us are out on holiday today and tomorrow so we'll be slow to respond. great catch on env vars not getting propagated -- we should figure out how to do this and document it in the action. the cli is open source and that's the piece responsible for detecting these env vars and sending them as part of the update. these ones are picked up from github actions -- did you already try all of them? there might be some additional ones required https://github.com/pulumi/pulumi/blob/10dd3d09233fb7cfd9688ef8305add0203002615/sdk/go/common/util/ciutil/github_actions.go#L52
Pulumi still adds status checks on the PRs, but not comments - any idea how to troubleshoot this?
i just noticed this -- if you are getting status checks that tells me we do have all the info we need to comment on your PR. what i think is happening here: if the update doesn't make any changes (no resources updated / created / deleted / replaced) it will omit the comment in the interest of keeping noise down on your PR. it's worth looking at your updates to see if that might be the case. if that is the issue here and you would prefer to always get a comment even when nothing has changed, please file an issue on https://github.com/pulumi/service-requests/ and we can look into making this behavior configurable.
w

white-chef-55657

11/24/2022, 6:55 PM
I don’t get any comment - ever
I used to get comments, but it recently stopped
I checked the env vars are in fact available in the shared workflow, as expected they are there
would appreciate some proper feedback, the support ticket is open and didn’t get a response at all yet.. @many-telephone-49025
m

many-telephone-49025

11/24/2022, 7:36 PM
Hi @white-chef-55657, how about a short call and maybe screen share 2morrow? Most of the engineers are on their Thanksgiving holidays but maybe I can see your code/workflows and add more infos to your ticket?
w

white-chef-55657

11/24/2022, 7:37 PM
anytime, will DM you - thanks
m

many-telephone-49025

11/24/2022, 7:37 PM
Awesome!
Hi @white-chef-55657, Here is my first test Pulumi Program: https://github.com/dirien/github-pulumi-action/pull/2 Init: Fresh stack Content: simple stack (CIVO vm) and a reusable workflow, So far the comments get produces
I will now extend the code with using the Pulumi automation API to see how it continues
h

hallowed-photographer-31251

11/30/2022, 5:28 AM
@white-chef-55657 can you tell me the version of Pulumi your action was using on a PR that got comments and a PR that didn't? trying to narrow down if perhaps something in the cli changed recently. if you're using pulumi/actions, in the github logs you should see something like "Configured range: ^3 Matched version: v3.48.0" for the pulumi/actions step
w

white-chef-55657

11/30/2022, 7:50 AM
hi @hallowed-photographer-31251, not using pulumi/actions because we use the automation api using 3.48.0 thanks @many-telephone-49025 for the reproduce, will take a look!
@many-telephone-49025 I see you implemented both automation api and actions we don’t use
pulumi/actions
let’s remove that?
m

many-telephone-49025

11/30/2022, 7:55 AM
its already on if: false
w

white-chef-55657

11/30/2022, 7:56 AM
oh I missed that, let me look again
I see you have
COMMENT_ON_PR
- where is that used?
m

many-telephone-49025

11/30/2022, 7:57 AM
I tried different things because it’s not working! No comments for me neither when I use automation API
w

white-chef-55657

11/30/2022, 7:58 AM
oh, I thought you did get it to work
m

many-telephone-49025

11/30/2022, 7:58 AM
without automation api and callable workflow it works
w

white-chef-55657

11/30/2022, 7:58 AM
ok - so you’re able to reproduce the issue?
m

many-telephone-49025

11/30/2022, 7:59 AM
Yes
w

white-chef-55657

11/30/2022, 7:59 AM
sorry for the misunderstanding
ok - how else can I help then?
m

many-telephone-49025

11/30/2022, 8:00 AM
I will discuss this with engineering, as we have now a very boiled down example to examine
Thanks for your patience Omer!
h

hallowed-photographer-31251

11/30/2022, 8:25 PM
@white-chef-55657 just to confirm, you were able to get comments with pulumi version 3.48.0, and you're still using that version but now not getting comments?
w

white-chef-55657

12/01/2022, 10:53 AM
@hallowed-photographer-31251 see the repo that @many-telephone-49025 has for details
@hallowed-photographer-31251 @many-telephone-49025 any update on this?
m

many-telephone-49025

12/05/2022, 6:21 PM
Hi @white-chef-55657 just came out of an investigation session with @hallowed-photographer-31251! We made good progress on analysing the issue and Bryce is following up for possible solution with his team. Yeah! 🎉
w

white-chef-55657

12/05/2022, 6:22 PM
that’s awesome, thanks for the update!
@many-telephone-49025 @hallowed-photographer-31251 any solution in sight?
m

many-telephone-49025

12/20/2022, 5:43 PM
Hi @white-chef-55657, I think @hallowed-photographer-31251 took the issue to the engineering team. There was recently an update in the issue from him. https://github.com/pulumi/pulumi/issues/11574
w

white-chef-55657

12/20/2022, 5:44 PM
right, and I responded is there any way to prioritize this?
m

many-telephone-49025

12/20/2022, 7:27 PM
We try to prioritise the open issue with the engineering team, but can't make any commitments on timing.
w

white-chef-55657

12/26/2022, 1:35 PM
hi @many-telephone-49025 please pass on the message that since we don’t have these previews, combined with the overall performance issues - we have no reason to keep using pulumi service backend and will be switching to S3
m

many-telephone-49025

12/26/2022, 1:39 PM
Hi Omer, we should talk after the holiday days! 🙂
Nevertheless I will pass this internally as you requested. I am sure we will find a solution
w

white-chef-55657

01/22/2023, 7:57 AM
@hallowed-photographer-31251 @limited-rainbow-51650 any update on this? I ended up implementing a replacement from scratch using the
plans.json
in case that’s helpful to anyone else I’m happy to share the solution
l

limited-rainbow-51650

01/22/2023, 8:57 PM
@white-chef-55657 I wouldn’t know as I’ve been away from work for 4 weeks. @many-telephone-49025, were you able to follow up?
w

white-chef-55657

01/23/2023, 8:21 AM
I was told it’s not a priority right now - which is very disappointing.. with this feature now implemented locally we don’t have any other use for the pulumi service and will be offboarding soon
notifications suddenly started appearing today - did you guys fix anything?
by the way - my implementation catches changes that yours doesn’t 😛 happy to share my code if needed
m

many-telephone-49025

03/15/2023, 2:18 PM
CC: @hallowed-photographer-31251
h

hallowed-photographer-31251

03/15/2023, 7:33 PM
we deliberately omit some operations from PR comments to keep the noise down.
w

white-chef-55657

03/15/2023, 9:15 PM
Ok But did you fix anything that is started working ?
h

hallowed-photographer-31251

03/15/2023, 9:17 PM
we did recently fix an issue where comments weren't being posted to "internal" repositories -- did that fix it for you?
ah sorry i see above that it did