QQ: Is there a way to execute pulumi`crossguard` when running

pulumi up

without specifying the

--policy-pack

(e.g., using Env-var…)

Hi guys, i'm getting this error while provision gitlab pulumi version : 3.34.1 "@pulumi/gitlab": "^4.7.0", Has anyone success provision gitlab repository?

Previewing update (dev)
ilds` must be specified. Examine values at 'Project.MirrorTriggerBuilds'.
    error: gitlab:index/project:Project resource 'my-project' has a problem: Missing required argument: "mirror": all of `import_url,mirror` must be specified. Examine values at 'Project.Mirror'.
    error: gitlab:index/project:Project resource 'my-project' has a problem: Missing required argument: "only_mirror_protected_branches": all of `import_url,only_mirror_protected_branches` must be specified. Examine values at 'Project.OnlyMirrorProtectedBranches'.
    error: gitlab:index/project:Project resource 'my-project' has a problem: Missing required argument: "mirror_overwrites_diverged_branches": all of `import_url,mirror_overwrites_diverged_branches` must be specified. Examine values at 'Project.MirrorOverwritesDivergedBranches'.

Hi Team - I am wondering if it is possible to use a regular provider as part of a dynamic provider. The use-case I have is that I want to create a local certificate authority and use that to generate a locally signed cert using pulumi_tls. The reason I would like to use a dynamic provider to manage this is because on create, I would like to install the root ca cert on the user's workstation, and on delete I would like to remove it. Is this possible? I am trying to do this with a minimal example example (just generating a private key and displaying the contents) but running into errors.

from typing import Any, Optional

from pulumi.dynamic import ResourceProvider, CreateResult, Resource
from pulumi import Input, ResourceOptions, Output, export
import pulumi_tls as tls
import pulumi

tls_provider = tls.Provider('tls_provider')


class WildcardProvider(ResourceProvider):
    def create(self, inputs):

        key = tls.PrivateKey("someNewKey", algorithm="RSA", opts=pulumi.ResourceOptions(provider=tls_provider))
        outputs = {"private_key_pem": key}
        return CreateResult(id_="foo", outs=outputs)  


class Wildcard(Resource):
    private_key: Output

    def __init__(self, name: str, props: Any, opts: Optional[ResourceOptions] = None):
        full_args = {"cert_pem": None, "private_key_pem": None, "ca_cert_pem": None, **props}
        super().__init__(WildcardProvider(), name, full_args, opts)

my_wildcard = Wildcard("my-new-resource", {})

Logs:

I0616 14:08:49.440319    3760 provider_plugin.go:643] Provider[pulumi-python, 0x140008721e0].Check(urn:pulumi:localca::localca::pulumi-python:dynamic:Resource::my-new-resource) success: inputs=#1 failures=#0
I0616 14:08:49.440331    3760 step_generator.go:689] Planner decided to create 'urn:pulumi:localca::localca::pulumi-python:dynamic:Resource::my-new-resource' (inputs=map[__provider:{gASVSAMAAAAAAACMCmRpbGwuX2RpbGyUjAxfY3JlYXRlX3R5cGWUk5QoaACMCl9sb2FkX3R5cGWUk5SMBHR5cGWUhZRSlIwQV2lsZGNhcmRQcm92aWRlcpSMFnB1bHVtaS5keW5hbWljLmR5bmFtaWOUjBBSZXNvdXJjZVByb3ZpZGVylJOUhZR9lCiMB19fZG9jX1+UTowKX19tb2R1bGVfX5SMCF9fbWFpbl9flIwNX19zbG90bmFtZXNfX5RdlIwGY3JlYXRllGgAjBBfY3JlYXRlX2Z1bmN0aW9ulJOUKGgAjAxfY3JlYXRlX2NvZGWUk5QoSwJLAEsASwVLB0tDQzZ0AKABZAGhAX0CdABqAmQCZAN0A3wCdARkBI0CZAWNA30DZAZ8A2kBfQR0BWQHfARkCI0CUwCUKE6MDHRsc19wcm92aWRlcpSMCnNvbWVOZXdLZXmUjANSU0GUjAhwcm92aWRlcpSMBnBhcmVudJSGlIwJYWxnb3JpdGhtlIwEb3B0c5SGlIwLcHJpdmF0ZV9rZXmUjANmb2+UjANpZF+UjARvdXRzlIaUdJQojAN0bHOUjAhQcm92aWRlcpSMClByaXZhdGVLZXmUjA9SZXNvdXJjZU9wdGlvbnOUaAqMDENyZWF0ZVJlc3VsdJR0lCiMBHNlbGaUjAZpbnB1dHOUaBmMA2tleZSMB291dHB1dHOUdJSMOS9Vc2Vycy9jbWFydGVlcGFudHMvUHljaGFybVByb2plY3RzL2xvY2FsY2EvLi9fX21haW5fXy5weZRoE0sRQwgAAQoBGAEIAZQpKXSUUpR9lIwIX19uYW1lX1+UaBBzaBNOTnSUUpR9lH2UKIwPX19hbm5vdGF0aW9uc19flH2UjAxfX3F1YWxuYW1lX1+UjBdXaWxkY2FyZFByb3ZpZGVyLmNyZWF0ZZR1hpRiaDcojAxDcmVhdGVSZXN1bHSUaAloLJOUjA9SZXNvdXJjZU9wdGlvbnOUjA9wdWx1bWkucmVzb3VyY2WUaCuTlIwQUmVzb3VyY2VQcm92aWRlcpRoC4wDdGxzlGgAjA5faW1wb3J0X21vZHVsZZSTlIwKcHVsdW1pX3Rsc5SFlFKUdTB1dJRSlCmBlC4=}])
I0616 14:08:49.440462    3760 step_executor.go:364] StepExecutor worker(-2): worker received chain for execution
I0616 14:08:49.440471    3760 step_executor.go:364] StepExecutor worker(-2): worker waiting for incoming chains
I0616 14:08:49.440478    3760 step_executor.go:364] StepExecutor worker(2): launching oneshot worker
I0616 14:08:49.440508    3760 snapshot.go:130] SnapshotManager: Beginning mutation for step `create` on resource `urn:pulumi:localca::localca::pulumi-python:dynamic:Resource::my-new-resource`
     Type                               Name             Status       
 +   pulumi:pulumi:Stack                localca-localca  creating..   
 +   └─ pulumi-python:dynamic:Resource  my-new-resource  creating     
I0616 14:08:49.564438    3760 state.go:291] error copying .pulumi/stacks/localca.json.gz to .pulumi/stacks/localca.json.gz.bak: blob (key ".pulumi/stacks/localca.json.gz -> .pulumi/stacks/localca.json.gz.bak") (code=NotFound): NoSuchKey: The specified key does not exist.
        status code: 404, request id: 9YQA6FZAQFJYR64M, host id: yXgNUIt03L09jr7kWkFkZsJB/1IWvVAGdDopL6vj5VpdDVAxItClPl/Vin0eJLfwUMi7vqcf77U=
I0616 14:08:49.625553    3760 state.go:297] error deleting source object after rename: .pulumi/stacks/localca.json.gz (blob (key ".pulumi/stacks/localca.json.gz") (code=NotFound): NotFound: Not Found
        status code: 404, request id: 9YQ6GE6NZW8ZBENS, host id: nsmxOvwpUIGsaheHH1j2CsehZ+DrcJgF9Qs1IJoCvnKFKduVfkKTorVgv2XnS3jJmtid62MXVkI=) skipping
I0616 14:08:49.833128    3760 state.go:248] Saved stack localca checkpoint to: .pulumi/stacks/localca.json (backup=.pulumi/stacks/localca.json.bak)
I0616 14:08:49.833284    3760 step_executor.go:364] StepExecutor worker(2): applying step create on urn:pulumi:localca::localca::pulumi-python:dynamic:Resource::my-new-resource (preview false)
I0616 14:08:49.833319    3760 registry.go:174] GetProvider(urn:pulumi:localca::localca::pulumi:providers:pulumi-python::default::01ef631b-e17e-43f9-b68d-02b250e6f04e)
I0616 14:08:49.833356    3760 provider_plugin.go:744] Provider[pulumi-python, 0x140008721e0].Create(urn:pulumi:localca::localca::pulumi-python:dynamic:Resource::my-new-resource) executing (#props=1)
I0616 14:08:49.833393    3760 rpc.go:74] Marshaling property for RPC[Provider[pulumi-python, 0x140008721e0].Create(urn:pulumi:localca::localca::pulumi-python:dynamic:Resource::my-new-resource).inputs]: __provider={gASVSAMAAAAAAACMCmRpbGwuX2RpbGyUjAxfY3JlYXRlX3R5cGWUk5QoaACMCl9sb2FkX3R5cGWUk5SMBHR5cGWUhZRSlIwQV2lsZGNhcmRQcm92aWRlcpSMFnB1bHVtaS5keW5hbWljLmR5bmFtaWOUjBBSZXNvdXJjZVByb3ZpZGVylJOUhZR9lCiMB19fZG9jX1+UTowKX19tb2R1bGVfX5SMCF9fbWFpbl9flIwNX19zbG90bmFtZXNfX5RdlIwGY3JlYXRllGgAjBBfY3JlYXRlX2Z1bmN0aW9ulJOUKGgAjAxfY3JlYXRlX2NvZGWUk5QoSwJLAEsASwVLB0tDQzZ0AKABZAGhAX0CdABqAmQCZAN0A3wCdARkBI0CZAWNA30DZAZ8A2kBfQR0BWQHfARkCI0CUwCUKE6MDHRsc19wcm92aWRlcpSMCnNvbWVOZXdLZXmUjANSU0GUjAhwcm92aWRlcpSMBnBhcmVudJSGlIwJYWxnb3JpdGhtlIwEb3B0c5SGlIwLcHJpdmF0ZV9rZXmUjANmb2+UjANpZF+UjARvdXRzlIaUdJQojAN0bHOUjAhQcm92aWRlcpSMClByaXZhdGVLZXmUjA9SZXNvdXJjZU9wdGlvbnOUaAqMDENyZWF0ZVJlc3VsdJR0lCiMBHNlbGaUjAZpbnB1dHOUaBmMA2tleZSMB291dHB1dHOUdJSMOS9Vc2Vycy9jbWFydGVlcGFudHMvUHljaGFybVByb2plY3RzL2xvY2FsY2EvLi9fX21haW5fXy5weZRoE0sRQwgAAQoBGAEIAZQpKXSUUpR9lIwIX19uYW1lX1+UaBBzaBNOTnSUUpR9lH2UKIwPX19hbm5vdGF0aW9uc19flH2UjAxfX3F1YWxuYW1lX1+UjBdXaWxkY2FyZFByb3ZpZGVyLmNyZWF0ZZR1hpRiaDcojAxDcmVhdGVSZXN1bHSUaAloLJOUjA9SZXNvdXJjZU9wdGlvbnOUjA9wdWx1bWkucmVzb3VyY2WUaCuTlIwQUmVzb3VyY2VQcm92aWRlcpRoC4wDdGxzlGgAjA5faW1wb3J0X21vZHVsZZSTlIwKcHVsdW1pX3Rsc5SFlFKUdTB1dJRSlCmBlC4=}
I0616 14:08:49.840313    3760 provider_plugin.go:1586] provider received rpc error `Unknown`: `Exception calling application: Program run without the Pulumi engine available; re-run using the `pulumi` CLI`
I0616 14:08:49.840345    3760 provider_plugin.go:1589] rpc error kind `Unknown` may not be recoverable
I0616 14:08:49.840355    3760 provider_plugin.go:800] Provider[pulumi-python, 0x140008721e0].Create(urn:pulumi:localca::localca::pulumi-python:dynamic:Resource::my-new-resource) failed: Exception calling application: Program run without the Pulumi engine available; re-run using the `pulumi` CLI
     Type                               Name             Status                  Info
 +   pulumi:pulumi:Stack                localca-localca  creating..              
 +   └─ pulumi-python:dynamic:Resource  my-new-resource  **creating failed**     error: Exception calling application: Program run without the Pulumi engine available; re-run using the `pulumi` CLI
I0616 14:08:49.973967    3760 state.go:291] error copying .pulumi/stacks/localca.json.gz to .pulumi/stacks/localca.json.gz.bak: blob (key ".pulumi/stacks/localca.json.gz -> .pulumi/stacks/localca.json.gz.bak") (code=NotFound): NoSuchKey: The specified key does not exist.
        status code: 404, request id: 9YQ5WSE9S77HGJN7, host id: 2DreBH/zBLA7obo9PFGQi6edUO0fxgkU13VBgjC2Sjy0i0gRT3BGfsNHES89YwHc7Tv4K3sNd8c=
I0616 14:08:50.028370    3760 state.go:297] error deleting source object after rename: .pulumi/stacks/localca.json.gz (blob (key ".pulumi/stacks/localca.json.gz") (code=NotFound): NotFound: Not Found
        status code: 404, request id: K73R852D4NM5HJYM, host id: NU+hZF0GchzOkeIX7n5LiioTpf/ehXB74Sbyp916x3gV8ETV8o5okiorNed6nevbz8Yji3jjEWU=) skipping
I0616 14:08:50.207675    3760 state.go:248] Saved stack localca checkpoint to: .pulumi/stacks/localca.json (backup=.pulumi/stacks/localca.json.bak)
I0616 14:08:50.207839    3760 step_executor.go:364] StepExecutor worker(2): step create on urn:pulumi:localca::localca::pulumi-python:dynamic:Resource::my-new-resource failed with an error: Exception calling application: Program run without the Pulumi engine available; re-run using the `pulumi` CLI
I0616 14:08:50.207883    3760 step_executor.go:364] StepExecutor worker(2): step create on urn:pulumi:localca::localca::pulumi-python:dynamic:Resource::my-new-resource failed, signalling cancellation
I0616 14:08:50.207933    3760 deployment_executor.go:293] deploymentExecutor.Execute(...): context finished: context canceled
I0616 14:08:50.207949    3760 step_executor.go:364] StepExecutor worker(-1): StepExecutor.waitForCompletion(): waiting for worker threads to exit
I0616 14:08:50.207981    3760 step_executor.go:364] StepExecutor worker(-2): worker exiting due to cancellation
I0616 14:08:50.207998    3760 step_executor.go:364] StepExecutor worker(-1): StepExecutor.waitForCompletion(): worker threads all exited
I0616 14:08:50.208523    3760 deployment_executor.go:303] deploymentExecutor.Execute(...): step executor has completed
 +   pulumi:pulumi:Stack                localca-localca  creating..              error: update failed
I0616 14:08:50.208781    3760 deployment_executor.go:161] deploymentExecutor.Execute(...): exiting provider canceller
I0616 14:08:50.214509    3760 langruntime_plugin.go:193] langhost[python].Run(pwd=/Users/cmarteepants/PycharmProjects/localca,program=.,...,dryrun=false) failed: err=error reading from server: read tcp 127.0.0.1:60993->127.0.0.1:60992: use of closed network connection
I0616 14:08:50.214547    3760 ignore.go:44] Explicitly ignoring and discarding error: rpc error: code = Canceled desc = grpc: the client connection is closing
I0616 14:08:50.217677    3760 ignore.go:44] Explicitly ignoring and discarding error: 1 error occurred:
        * operation not permitted
 +   pulumi:pulumi:Stack                localca-localca  **creating failed**     1 error
 +   └─ pulumi-python:dynamic:Resource  my-new-resource  **creating failed**     1 error
 
Diagnostics:
  pulumi:pulumi:Stack (localca-localca):
    error: update failed
 
  pulumi-python:dynamic:Resource (my-new-resource):
    error: Exception calling application: Program run without the Pulumi engine available; re-run using the `pulumi` CLI

Hi all, I have a TypeScript pulumi project with about 7 lambdas. Each lambda has its own folder inside of a parent app folder. Each lambda is its own nodeJS application. My question: does each lambda have to be its own nodejs application or can I roll everything up to one?

Hi everyone!! Greetings from 🇨🇴 !! I hope learn more in deep about pulumi logo !! Have an excellent day!!

I made some changes to my pulumi config, and it said it needed to replace an AWS VPC. That failed, because of dependent resources. I’ve removed all of the resources from my config now – but when doing

pulumi up

, it starts off with

completing deletion from previous update

and tries to delete the VPC, so it never deletes the dependent resources. How do I get pulumi to delete the other resources first, so it can complete deleting the VPC?

I've created some Customresources and trying to have one of them depending on another one using dependsOn, but the first resource is not being created before the second one.

const myfirstcustomresource= new FirstFunction(functionname, { resourcegroupname: MyResourceGroupName });
const mysecondresource = new Getkeys("keyresource", { resourcegroupname: MyResourceGroupName, keysname: functionname}, { dependsOn: [myfirstcustomresource] })

The deployment tries to create the second resource before the first one is created: Error: invocation of azure-nativeweblistWebAppHostKeys returned an error: request failed /subscriptions/xxxxx/resourceGroups/<resourcegroupname>/providers/Microsoft.Web/sites/<functionname>/host/default/listkeys: autorest/azure: Service returned an error. Status=404 Code="ResourceNotFound" Message="The Resource 'Microsoft.Web/sites/<functionname>' under resource group <resourcegroupname> was not found. Any good ideas what could be causing this?

Hey! I am trying to code a provider for our product API (wraps serverless functions). I was trying to use the dynamic provider

pulumi.dynamic.Resource

and provider for that. I was able to get create/update/read sort of working. Now I am looking to cross-reference already existing API resources to the pulumi managed ones. Is the

invoke

https://github.com/pulumi/pulumi/pull/369 functionality available for dynamic providers? I would appreciate any help or just documentation pointers on how to approach this. Thank you!

Hi, I would like to create a new

kubernetes.apiextension.CustomResource

but the inputs should be read from a kubernetes yaml. Any ideas? Thanks

Hey Team! Will Pulumi core team build Google Ai Platform soon?

Hi everyone - anyone got experience adding local ssd disks to a gcp compute instance? I just can't work out how to do it 😞 is there a specific syntax to the

attachedDisks

property? Think I've sussed it - there's a scratchDisks property

Hey guys, just kicking the tires here so far, but this is a really cool product. Thanks for all of your work.

I've had to destroy a k8s cluster from under pulumi. pulumi really wants to refresh state by checking things on the pods which don't exist. Is there a way to get a toposorted list of resources which depend on another resource so I can just run down the list and delete all of the k8s dependent ones?

Hello, Is it any way to recreate a resource based on ANY update of another resource? Example: After AWS Glue Job is changed (any field), we want to recreate a GlueJobStart resource (custom dynamic resource) Thank you!

anybody have a good example of exporting a complex object in a stack output?

struggling with either a map of maps or array of maps

Hi guys 👋, Pulumi is amazing product, appreciate your work! I created some organizations (team plan) but there is no

settings/org-tokens

page in the org settings panel, does this mean I need to upgrade to the enterprise version to use the organization level token properly? Can team plan users only be managed using account tokens, and how should we distinguish between multiple organizations? Thanks ❤️

I came back to my pulumi project after a while away, which involved getting a new laptop (apple M1) it seems like I have this problem https://www.pulumi.com/docs/support/troubleshooting/#403-http-error-fetching-plugin i.e. the Digital Ocean provider - I had been using v3.1.1 but I can’t install that on my new laptop, and if I install latest version it can’t refresh the stack the instructions for fixing it sound simple:

1. Open your Pulumi program on a non-arm64 based computer

2. Update your packages (pip / nuget / npm / go) and run

pulumi up

3. Once the update is complete, you can open the new, updated Pulumi program on your arm64-based system

I booted up a

--platform=linux/amd64

docker container and cloned my project, installed pulumi but actually I am not sure what to do next I have installed the old version of the provider… do I install the latest version too? and then if I

pulumi up

it can get state using the old provider, and will update it using latest version? not really clear what the fix is here

Hi, Does anyone know the answer to this question? https://pulumi-community.slack.com/archives/C01PF3E1B8V/p1655611190820939

Pulumi Community - We created a #finops channel to hear your ideas and examples of ways you have used Pulumi in you finops practice. Also I am at finopsx if you want to come chat about how great Pulumi is.

Hi everyone, I’m working on a project to convert Terraform code to Pulumi code and have been using the Terraform-Pulumi converter to the full extent My current work includes #aws #python My main issue is although the tool works up to 70%, I need help on converting some terraform features like Versioning -enabled Defining and using variables in Pulumi using python Element, templatefile, Jsoncode I need a way to convert these aspects of terraform to Pulumi

Hi all, I have simple use-case but it become harder 😞 I use RandomPassword to generate password and save it into variable

user_password = RandomPassword().result

the variable ‘user_password’ I sent to my dynamic resource which only create a query with the ‘user_password’ inside (Eventually is a string ) the problem is that the value is the Object itself

<pulumi.output.Output at 0x7ffe81ffe6d0>

is there a way to export the value i get from randomPassword into a string in run time? 😢 Thanks!

Hi there, anyone with a more serious production-adjacent/ready EKS cluster Pulumi project?

Getting a not so helpful

unknown

error when trying to destroy a stack

Previewing destroy (beta)

View Live: <https://app.pulumi.com/snip/snip/snip/previews/snip>

     Type                                               Name                            Plan       
 -   pulumi:pulumi:Stack                                snip                            delete     
 -   ├─ kubernetes:<http://networking.k8s.io/v1:Ingress|networking.k8s.io/v1:Ingress>         snip                            delete     
 -   snip (36 items)   
 
Outputs:
  - snip

Resources:
    - 37 to delete

Do you want to perform this destroy? yes
Destroying (snip)

View Live: <https://app.pulumi.com/snip/snip/snip/updates/46>

     Type                                        Name                       Status                  Info
     pulumi:pulumi:Stack                         snip                       **failed**              1 error
 -   └─ kubernetes:<http://networking.k8s.io/v1:Ingress|networking.k8s.io/v1:Ingress>  snip                       **deleting failed**     1 error
 
Diagnostics:
  kubernetes:<http://networking.k8s.io/v1:Ingress|networking.k8s.io/v1:Ingress> (snip):
    error: unknown
 
  pulumi:pulumi:Stack (snip):
    error: update failed
 
Resources:

Duration: 18s

Hi pulumi/postgresql needs to be able to connect to the database. But if I provision a db behind vpc without public accessibility (which is quite normal for db setup). what can I do for pulumi/postgresql to work??

Hi Why does pulumi ask me to replace rds proxy every time, I got this: (see screenshot) But new creation will still be like the left hand side and it will still ask me to replace to right hand side the next time I run “pulumi up”

Hi, i am pretty new to pulumi. And i want to popluate a pretty big stack, or multiple of those, based on some information that i can retrieve from a webservice. I think it is a brilliant idea to dynamically determinde the resources (to create) while the host-language(lets say: java) runs. I appreciate support of the idea, so just (thumb up), if you like it. But what i really want to known are the downsides of this kind of approach.

Hey guys, I am trying to create a serverless v2 rds cluster, but I keep getting this error. The example is copied straight from the documentation. I made sure that my pulumi is updated

hey pulumiers... I'm using the automation API to write integration tests - but I'm still in the "find out what works" phase of the test creation. My stacks and ideas are solid enough, but little things break, like the length of resource names are too long or accidentally contain a character that isn't allowed within a resource name for a cloud object. What techniques are you using to speed the dev cycle up? Is there any collection of "good practises" around? One blocker I've got is that I'm using the deployment instance stack name as a source of uniqueness in my resource names - which of course doesn't exist unless the pulumi runasync() is called - which means I have to instantiate a stack / deploy it - terribly slow. Any tips or pointers to better ways of testing are appreciated!

Running

flux bootrrap

within a Pulumi Command Pulumi reports errors when there is no error running the underlying command. I don’t really understand why, does Pulumi assume errors whilst receiving multiple lines of output?