modern-napkin-9670703/17/2021, 3:05 PM
or I can hardcode the
python my-dataflow-script.py --template_location '<gs://my-template-bucket/my-dataflow-template>'
in the script itself and just run
which then packages the beam application as a template to be run in dataflow. I’ve tried calling the dataflow script from another python script using
which works, but trying that in pulumi’s
TypeError: cannot pickle 'TaskStepMethWrapper' object
tries to pickle the whole pulumi program or do something else which probably doesn’t make sense. Any experience on dataflow + pulumi and getting this working?
gentle-diamond-7014703/17/2021, 3:47 PM
from your Pulumi application or are you trying to (B) call your Pulumi application from
? (A) is supported. The best way would be to create a Dynamic Provider to call your script at the right "event" (create, update, etc) - https://www.pulumi.com/docs/intro/concepts/resources/#dynamicproviders. (B) is not supported as the
cli (engine) must be the invocation point of your pulumi application.
modern-napkin-9670703/17/2021, 4:17 PM
gentle-diamond-7014703/17/2021, 4:18 PM
modern-napkin-9670703/17/2021, 4:26 PM