Added a few questions in Github discussions (assuming it's used, or should I post on stack overflow with tag?)
I plan on going through more pulumi adoption writing and maybe I'll find the answer. In the meantime anyone with experience using pulumi with CI and dealing with config values changing constantly maybe you'll have some insight?
https://github.com/pulumi/pulumi/discussions/8875