Hey all, trying to use the flex template resource,...
# google-cloudb
breezy-lifeguard-15721
06/07/2022, 12:30 AMHey all, trying to use the flex template resource, https://www.pulumi.com/registry/packages/gcp/api-docs/dataflow/flextemplatejob/.
Pulumi creates the resource just fine. It also updates the job fine the first time but the section time it gives an error:
has terminated with state "JOB_STATE_UPDATED"breezy-lifeguard-15721
06/07/2022, 4:00 PMDid a bit of digging in my stack export and found the new ID is different than the ID:
"id": "2022-06-06_23_03_18-5843176362055954902" Copy code
"outputs": {
"id": "2022-06-07_08_21_12-44324234441230267",
"jobId": "2022-06-07_08_21_12-44324234441230267",g
great-queen-39697
06/10/2022, 10:44 PMThe resource docs you're referencing are from https://github.com/pulumi/pulumi-gcp instead of https://github.com/pulumi/terraform-provider-google-beta.
That being said, can you share the code where you're defining the flex template job? Dataflow is a bit odd in the sense that jobs can start and stop independently of a Pulumi run, so I suspect that there's some flag that we need to set to ensure Pulumi knows that it could change outside of the defined state. I don't know it that well, but I'm willing to try to help figure it out.
b
breezy-lifeguard-15721
06/28/2022, 7:59 PM Copy code
const job = new gcp.dataflow.FlexTemplateJob(
name,
{
name: name,
containerSpecGcsPath: interpolate`<gs://stagingbucket/templates/spec>`,
onDelete: 'drain',
project: project,
parameters: {
setup_file: './src/python/setup.py',
service_account_email: serviceAccount.email,
...
},
},
resourceOptions,
);breezy-lifeguard-15721
06/28/2022, 8:01 PMPretty simple definition, I manually create the flex template spec with
Copy code
const template: FlexTemplate = {
defaultEnvironment: {},
image: imageName,
sdkInfo: {
language: 'PYTHON',
},
};breezy-lifeguard-15721
06/28/2022, 8:01 PM@great-queen-39697
2 Views