Hey I m getting some errors when trying to create `gcp datac Pulumi Community #google-cloud

Hey, I'm getting some errors when trying to create...

refined-carpet-42005

12/01/2022, 1:34 PM

Hey, I'm getting some errors when trying to create

gcp:datacatalog:Tag

on columns using pulumi. The issue only happens sometimes and it's quite random which columns tags work on and which they don't 😅 One thing that's common for all of them though is that the tags are being successfully created in GCP, I can view them in the console and fetch them using the CLI. The problem is only that pulumi doesn't seem to be able to fetch them and I'm also not able to import them after the fact.

refined-carpet-42005

12/01/2022, 1:34 PM

Below is the output of what happens:

Copy code

pulumi:pulumi:Stack                    datahem-data-contracts-dev                                                                             **failed**              1 error
 +   └─ mathem:datahem:Entity               ecom-credit-DatahemTopic-entity                                                                        created (9s)
 +      └─ google-native:bigquery/v2:Table  ecom-credit-DatahemTopic-table                                                                         created (2s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-ownership_v1                                                                  created (0.99s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-federated_identity_v1-memberid                                                created (1s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-products.value.pharmacyinformation.activesubstance       created (1s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-products.value.pharmacyinformation.articlenumber         created (2s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-products.value.pharmacyinformation.salesrestrictiontype  created (2s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-products.value.pharmacyinformation.itemtype              created (3s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-changingorderid                                          created (3s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-products.value.pharmacyinformation.saleslimit            created (4s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-deliverytime.truckrouteid                                created (4s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-address.id                                               created (5s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-address.legacyaddressid                                  created (5s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-address.companyname                                      created (6s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-address.firstname                                        created (6s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-federated_identity_v1-socialsecurityno                                        created (7s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-address.phonehome                                        created (7s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-address.alternativephonehome                             created (8s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-address.alternativephonemobile                           created (8s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-products.value.pharmacyinformation.vendingtype           **creating failed**     1 error
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-address.lastname                                         created (9s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-giftvouchers.value.id                                    **creating failed**     1 error
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-giftvouchers.value.code                                  **creating failed**     1 error
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-federated_identity_v1-benefits.memberid                                       created (11s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-payment.orderreference                                   **creating failed**     1 error
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-address.phonemobile                                      **creating failed**     1 error
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-discounts.value.code                                     **creating failed**     1 error
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-fees.value.id                                            **creating failed**     1 error
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-address.addressrow2                                      created (13s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-address.latitude                                         **creating failed**     1 error
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-address.longitude                                        **creating failed**     1 error
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-federated_identity_v1-address.memberid                                        created (15s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-benefits.benefits.usedonorder                            **creating failed**     1 error
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-benefits.benefits.fromorderid                            **creating failed**     1 error
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-address.truckrouteid                                     **creating failed**     1 error
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-bonuses.value.code                                       **creating failed**     1 error
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-address.addressinfo                                      created (18s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-address.doorcode                                         **creating failed**     1 error
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-address.addressrow1                                      created (18s)
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-discounts.value.id                                       **creating failed**     1 error
 +         ├─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-giftvouchers.value.comments                              **creating failed**     1 error
 +         └─ gcp:datacatalog:Tag           ecom-credit-DatahemTopic-pii_de_identified_v1-bonuses.value.id                                         **creating failed**     1 error

refined-carpet-42005

12/01/2022, 1:34 PM

And all the failing ones get the following error:

Copy code

gcp:datacatalog:Tag (ecom-credit-DatahemTopic-pii_de_identified_v1-address.latitude):
    error: expected non-nil error with nil state during Create of urn:pulumi:dev::datahem-data-contracts::mathem:datahem:Entity$google-native:bigquery/v2:Table$gcp:datacatalog/tag:Tag::ecom-credit-DatahemTopic-pii_de_identified_v1-address.latitude

refined-carpet-42005

12/01/2022, 1:34 PM

I've tried the following without any success: • adding them one by one (random which ones work and which ones don't, it changes) • renaming them (works sometimes, with no clear pattern) • importing them after the fact (pulumi can't find them)

refined-carpet-42005

12/01/2022, 1:35 PM

I'm at a loss what to try next, I tried verbose logging and tracing but the logs just say that the tags were created successfully but then pulumi cant find them? Since the tags all seem to work fine on the GCP side I figured I'd try creating my own dynamic provider instead for this but then I got another error posted here 😅 any help would be appreciated

many-telephone-49025

12/02/2022, 7:16 PM

Hi Kasper, Can you maybe run

pulumi about

refined-carpet-42005

12/05/2022, 8:38 AM

Copy code

CLI
Version      3.48.0
Go Version   go1.19.2
Go Compiler  gc

Plugins
NAME           VERSION
gcp            6.44.0
google-native  0.27.0
python         unknown

Host
OS       darwin
Version  13.0
Arch     arm64

<...stack resources>

Dependencies:
NAME                      VERSION
google-cloud-bigquery     3.4.0
google-cloud-datacatalog  3.9.3
grpcio-status             1.47.0
pip                       22.3.1
pulumi-gcp                6.44.0
pulumi-google-native      0.27.0
schema                    0.7.5
setuptools                65.5.1
wheel                     0.37.1

4 Views

Open in Slack

Previous Next