pulumi-community #python

white-terabyte-21934

07/27/2022, 9:36 AM

Hi , I am looking for a way to pulumi login via automation api in python , any sample ?

kind-france-51068

07/27/2022, 8:12 PM

Hey everyone, this may or may not be a dumb question but I'm working on a project right now where I have to use pulumi to grab a list of all of the snapshots in a project and find the most recently created to build a new host instance. Seems pretty simple but I'm having a hard time with grabbing a list of snapshots. I'm using the "google-native" provider with the 'getSnapshot' function. The documentation says "Returns the specified Snapshot resource. Gets a list of available snapshots by making a list() request." and for the life of me I can't figure out how to send that list request. I'm also seeing the same documentation for 'getDisk' and 'getInstance' and others so I'm feeling like I'm missing something simple. Anyway, this is the documentation I'm talking about: https://www.pulumi.com/registry/packages/google-native/api-docs/compute/v1/getsnapshot/ any help would be appreciated.

shy-bird-55689

07/28/2022, 12:28 AM

Is there are a resource for AWS Client VPN Endpoints? Cant seem to find one, although i can see other vpn options

full-window-21515

07/28/2022, 9:48 PM

How would I do pulumi config set "aws:skipMetadataApiCheck" false In Python?

busy-branch-95201

08/02/2022, 9:57 AM

Hi, I want to migrate from one resource (EBS csi driver via Helm chart) to another (eks addon for ebs csi driver). However those two conflict with each other so creating the addon before deleting the helm chart does not work. Is there anything I could do to force pulumi to first delete the resources of the helm chart and after that install the eks addon?

worried-gold-55244

08/04/2022, 7:42 PM

Hi Guys, is it possible to catch invoke exceptions ? here is the code

Copy code

try:
    key_pair = compute.get_keypair_output(args.region + '_key',
                                          opts=pulumi.ResourceOptions(provider=provider, parent=self))
except:
    key_pair = compute.Keypair(args.region + '_key',
                               name=args.region + '_key',
                               public_key=args.ssh_key_pub,
                               opts=pulumi.ResourceOptions(provider=provider, parent=self))

and error:

Copy code

error: Program failed with an unhandled exception:
    error: Traceback (most recent call last):
      File "/usr/local/bin/pulumi-language-python-exec", line 107, in <module>
        loop.run_until_complete(coro)
      File "/usr/local/Cellar/python@3.9/3.9.13_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/asyncio/base_events.py", line 647, in run_until_complete
        return future.result()
      File "/Users/amuntean/Projects/new_netlog/venv/lib/python3.9/site-packages/pulumi/runtime/stack.py", line 126, in run_in_stack
        await run_pulumi_func(lambda: Stack(func))
      File "/Users/amuntean/Projects/new_netlog/venv/lib/python3.9/site-packages/pulumi/runtime/stack.py", line 51, in run_pulumi_func
        await wait_for_rpcs()
      File "/Users/amuntean/Projects/new_netlog/venv/lib/python3.9/site-packages/pulumi/runtime/stack.py", line 110, in wait_for_rpcs
        raise exception
      File "/Users/amuntean/Projects/new_netlog/venv/lib/python3.9/site-packages/pulumi/output.py", line 194, in run
        transformed: Input[U] = func(value)
      File "/Users/amuntean/Projects/new_netlog/venv/lib/python3.9/site-packages/pulumi_openstack/_utilities.py", line 232, in <lambda>
        }).apply(lambda resolved_args: func(*resolved_args['args'],
      File "/Users/amuntean/Projects/new_netlog/venv/lib/python3.9/site-packages/pulumi_openstack/compute/get_keypair.py", line 121, in get_keypair
        __ret__ = pulumi.runtime.invoke('openstack:compute/getKeypair:getKeypair', __args__, opts=opts, typ=GetKeypairResult).value
      File "/Users/amuntean/Projects/new_netlog/venv/lib/python3.9/site-packages/pulumi/runtime/invoke.py", line 144, in invoke
        raise invoke_error
    Exception: invoke of openstack:compute/getKeypair:getKeypair failed: invocation of openstack:compute/getKeypair:getKeypair returned an error: invoking openstack:compute/getKeypair:getKeypair: 1 error occurred:
        * Error retrieving openstack_compute_keypair_v2 iad-private-dev_key: Resource not found
    error: an unhandled error occurred: Program exited with non-zero exit code: 1

kind-hamburger-15227

08/05/2022, 12:17 AM

Copy code

import pulumi
import pulumi_aws as aws

# Create an AWS provider for the us-east-1 region.
useast1 = aws.Provider("useast1", region="us-east-1")

# Create an ACM certificate in us-east-1.
cert = aws.acm.Certificate("cert",
    domain_name="<http://foo.com|foo.com>",
    validation_method="EMAIL",
    __opts__=pulumi.ResourceOptions(provider=useast1))

Trying to create my own provider, but it fails with

Copy code

File ~/.local/lib/python3.10/site-packages/pulumi/runtime/settings.py:202, in get_monitor()
    200 monitor = SETTINGS.monitor
    201 if not monitor:
--> 202     require_test_mode_enabled()
    203 return monitor

File ~/.local/lib/python3.10/site-packages/pulumi/runtime/settings.py:147, in require_test_mode_enabled()
    145 def require_test_mode_enabled():
    146     if not is_test_mode_enabled():
--> 147         raise RunError(
    148             "Program run without the Pulumi engine available; re-run using the `pulumi` CLI"
    149         )

RunError: Program run without the Pulumi engine available; re-run using the `pulumi` CLI

The purpose of the provide to set config

pulumi config set aws:skipCredentialsValidation true

- I am trying to run flask api example for automation api: https://github.com/pulumi/automation-api-examples/blob/main/python/pulumi_over_http/app.py any hints? Original sample fails with

Copy code

Diagnostics:
  aws:s3:Bucket (s3-website-bucket):
    error: 1 error occurred:
    	* error configuring Terraform AWS Provider: AWS account ID not previously found and failed retrieving via all available methods. See <https://www.terraform.io/docs/providers/aws/index.html#skip_requesting_account_id> for workaround and implications. Errors: 2 errors occurred:

kind-hamburger-15227

08/07/2022, 11:02 AM

How to create default_target_group for load balancer in python?

Copy code

listener = awsx.lb.NetworkLoadBalancer("lb",default_target_group=['group',{ 'port' : 80, 'protocol':'TCP'}])

I am trying to re-create typescript example in python

Copy code

const listener = new awsx.lb.NetworkLoadBalancer('lb')
  .createTargetGroup('group', { port: 80, protocol: 'TCP' })
  .createListener('listener', {
    port: 443,
    protocol: 'TLS',
    // ARN of the Amazon Cert Manager certificate for *.<http://mysite.com|mysite.com>
    certificateArn: certCertificate.arn,
  })

few-tent-80031

08/08/2022, 4:02 PM

Hi guys, my name is Ivan Indjic and I am working as a DevOps engineer in a Serbian based company. I'm learning Pulumi both for work and for my master thesis. I have one problem with my current stack. I created one rds instance and I want to use output of that resource ( rds address ) as an env var in my ecs container definition. So, I have this instance below.

Copy code

database = aws.rds.Instance(
    resource_name="master-thesis-rds",
    allocated_storage = 5,
    instance_class='db.t4g.micro',
    allow_major_version_upgrade=False,
    apply_immediately=False,
    auto_minor_version_upgrade=True,
    db_name='master',
    db_subnet_group_name='db-subnet-group',
    deletion_protection=False,
    enabled_cloudwatch_logs_exports=['audit', 'error', 'general', 'slowquery'],
    engine='mysql',
    performance_insights_enabled=True,
    port=5432,
    publicly_accessible=False,
    skip_final_snapshot=True,
    vpc_security_group_ids=[db_sg.id],
    username='',
    password=password.value
)

Then, I did this:

Copy code

rds_endpoint = database.address.apply(lambda address: f"http://{address}")

And last, I have ecs container definition with these env vars:

Copy code

"environment": [
                {
                    "name": "user", "value": ""
                },
                {
                    "name": "password", "value": f"{password.value}"
                },
                {
                    "name": "db_host_replica", "value": rds_endpoint
                },
                {
                    "name": "db_host", "value": rds_endpoint
                }
            ],

However, when I run this, I get

Copy code

TypeError: Object of type Output is not JSON serializable

Do you guys know where is a mistake? I tried different ways but I cannot get right output converted to string. Thank you

sparse-intern-71089

08/09/2022, 7:55 AM

This message was deleted.

prehistoric-book-85014

08/18/2022, 9:21 PM

Good afternoon guys, how are you? How can I get all values from export using python?

elegant-smartphone-60282

08/21/2022, 12:27 PM

Hey, i have this python script that i want to check if the security group existing or not, if its existing then import it if not create a new one, but i get this error

Copy code

error: Program failed with an unhandled exception:
    Traceback (most recent call last):
      File "/opt/homebrew/bin/pulumi-language-python-exec", line 111, in <module>
        loop.run_until_complete(coro)
      File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/asyncio/base_events.py", line 641, in run_until_complete
        return future.result()
      File "/Users/afeefaz/Downloads/iac/pulumi/venv/lib/python3.10/site-packages/pulumi/runtime/stack.py", line 126, in run_in_stack
        await run_pulumi_func(lambda: Stack(func))
      File "/Users/afeefaz/Downloads/iac/pulumi/venv/lib/python3.10/site-packages/pulumi/runtime/stack.py", line 51, in run_pulumi_func
        await wait_for_rpcs()
      File "/Users/afeefaz/Downloads/iac/pulumi/venv/lib/python3.10/site-packages/pulumi/runtime/stack.py", line 73, in wait_for_rpcs
        await RPC_MANAGER.rpcs.pop()
      File "/Users/afeefaz/Downloads/iac/pulumi/venv/lib/python3.10/site-packages/pulumi/runtime/rpc_manager.py", line 68, in rpc_wrapper
        result = await rpc
      File "/Users/afeefaz/Downloads/iac/pulumi/venv/lib/python3.10/site-packages/pulumi/output.py", line 98, in is_value_known
        return await is_known and not contains_unknowns(await future)
      File "/Users/afeefaz/Downloads/iac/pulumi/venv/lib/python3.10/site-packages/pulumi/output.py", line 98, in is_value_known
        return await is_known and not contains_unknowns(await future)
      File "/Users/afeefaz/Downloads/iac/pulumi/venv/lib/python3.10/site-packages/pulumi/output.py", line 98, in is_value_known
        return await is_known and not contains_unknowns(await future)
      [Previous line repeated 10 more times]
      File "/Users/afeefaz/Downloads/iac/pulumi/venv/lib/python3.10/site-packages/pulumi/runtime/resource.py", line 561, in do_register
        req = resource_pb2.RegisterResourceRequest(
    TypeError: bad argument type for built-in operation

Here’s the python code :

Copy code

# check for SG existence
try:
    existing_sg = aws.ec2.get_security_group(name="sg_name", vpc_id=vpc_id)
except:
    print("Creating new SG")

    created_sg = aws.ec2.SecurityGroup("sg_name",
        name="sg_name",
        vpc_id=vpc_id,
        egress=[{
            'from_port': 0,
            'to_port': 0,
            'protocol': "-1",
            'cidr_blocks': ['0.0.0.0/0']
        }],
        ingress=[{
            'from_port': 0,
            'to_port': 0,
            'protocol': "-1",
            'cidr_blocks': ['0.0.0.0/0']
        }],
        tags={
            "Name":"sg_name"
        }
    )
    pulumi.export("sg_name", created_sg.id)
else:
    aws.ec2.SecurityGroup("sg_name",
        opts=pulumi.ResourceOptions(
            import_=[existing_sg.id]
            )
    )

elegant-smartphone-60282

08/25/2022, 12:07 PM

Hey i have this code

Copy code

public_subnets = dis_stack.get_output("public_subnets")

subnets_list = public_subnets.apply(lambda id: id)

but it returns an output object, how can i do that i get a list ?

aloof-traffic-97122

08/25/2022, 6:01 PM

Cross posting gcp channel question, as this is probably more relevant to the #python channel: https://pulumi-community.slack.com/archives/CRFUR2DGB/p1661450287196499

elegant-smartphone-60282

08/30/2022, 8:24 AM

Hey, i have this directory tree

Copy code

parent_dir:
  file_1.py
  folder_1:
    folder_2:
      file_2.py

i want to import file_1 to file_2, how to do that?

nutritious-battery-42762

09/01/2022, 5:33 PM

Using aws native i'm getting this issue anytime i attempt to update a task definition

Copy code

aws-native:ecs:TaskDefinition app-task-definition-staging updating [diff: ~containerDefinitions]; error: operation error CloudControl: UpdateResource, https response error StatusCode: 400, RequestID: c85809ba-1dc5-44ca-be06-ab16f348a1fb, NotUpdatableException: Invalid patch update: createOnlyProperties [/properties/ContainerDefinitions] cannot be updated
 ~  aws-native:ecs:TaskDefinition app-task-definition-staging **updating failed** [diff: ~containerDefinitions]; error: operation error CloudControl: UpdateResource, https response error StatusCode: 400, RequestID: c85809ba-1dc5-44ca-be06-ab16f348a1fb, NotUpdatableException: Invalid patch update: createOnlyProperties [/properties/ContainerDefinitions] cannot be updated
    pulumi:pulumi:Stack frontent-frontend.staging running error: update failed
    glamo:resource:Service frontend-service  
    pulumi:pulumi:Stack frontent-frontend.staging **failed** 1 error

worried-xylophone-86184

09/01/2022, 6:19 PM

Hi all ! For the implementation of the our Pulumi stack, we use the stack file heavily to store the configurations the infrastructure should come up with. Incase there is a misconfiguration in the STACK file, we report what the mistake is. Unfortunately, incase there is a mistake and some decides to move forward with the deployment, pulumi destroys the entire stack, which is the intended behaviour given the fact that it will either bring it up or it will tear it down. Is there a way I could exit the pulumi process incase there is misconfiguration.

victorious-continent-984

09/04/2022, 12:52 PM

Hi, with new version of pulumi 3.39.1 noticed warnings:

Copy code

warning: Error downloading plugin: 403 HTTP error fetching plugin from  <https://get.pulumi.com/releases/plugins/>...

I’m using several custom python packages generated using crd2pulumi. It seems like plugin resolving mechanism tries to download something from public repo… This is very annoying since int adds a good few minutes for each pulumi up run. Do you know anything about it?

astonishing-branch-30086

09/06/2022, 9:43 AM

We are using a dynamic provider written in Python. In one instance, we want to delete a resource using the provider. The delete() method is implemented and has worked before, but we are now running into a problem. Due to refactoring, we now require additional props in the delete() method, that were not present when the resource was created. Thus it is not part of

outputs

in the resource's stack entry. How do I solve this cleanly? I'm guessing the correct way is to somehow update the state only, so that for the dynamic resource, the outputs are rewritten with the current inputs?

astonishing-branch-30086

09/06/2022, 9:44 AM

Thinking more about it now, would

pulumi refresh

do this? Admittedly, we were lazy and have skipped the implementation of refresh() for the resource.

hallowed-animal-47023

09/06/2022, 7:53 PM

Is there any cleaner documentation for the Python SDK? I'm hoping I'm missing something - https://www.pulumi.com/docs/reference/pkg/python/pulumi/

able-thailand-87943

09/12/2022, 8:29 AM

Hello, Does anyone know if the field

updateInProgress

as a part of the output from

pulumi stack ls --json

really shows "true", if there is a pulumi up running in the background when not using pulumi service backend? In the short tests we have run, we see that it always returns

false

steep-lamp-20408

09/12/2022, 1:09 PM

Hey there, Is anyone using Localstack with Pulumi in Python, and/or pulumi-local? I read this doc which got me pretty excited before I tried since it looked simple enough.: https://docs.localstack.cloud/integrations/pulumi/ However, when running the command

pulumilocal up

, I get this non explicit error:

Copy code

Do you want to perform this update? yes
Updating (localstack)

View Live: <https://app.pulumi.com/my-user/myproject-backend/localstack/updates/5>

     Type                       Name                             Status                  Info
     pulumi:pulumi:Stack        myproject-backend-localstack     **failed**              1 error; 2 warnings
 +   └─ aws:appsync:GraphQLApi  myproject-localstack-graphqlapi  **creating failed**     1 error 

Diagnostics:
  aws:appsync:GraphQLApi (myproject-localstack-graphqlapi):
    error: 1 error occurred:
        * error creating AppSync GraphQL API: InternalFailure:
        status code: 501, request id: 2DNPS6TTA6YNSW2F783MVI1V6DJZEJ8GJ61G1F4F

pulumi:pulumi:Stack (myproject-backend-localstack):
    warning: provider config warning: Use s3_use_path_style instead.
    warning: provider config warning: Use s3_use_path_style instead.
    error: update failed

Notes: • The stack works well when

pulumi up

on non-local. • The stack consists of AWS resources, including a Appsync GraphQL API • Side question: what are those warnings?

kind-jelly-61624

09/13/2022, 8:56 PM

Does anyone have experience writing unit tests for Component Resources? I’m wondering if it’s possible to mock the call as it would come via the sdk

fresh-scientist-11672

09/14/2022, 8:35 PM

Hi, we have built an internal service using pulumi under the hood but we're using old python libs 😅. We are considering upgrade lib versions, does anyone have made it or know any breaking change? Currently we are using:

Copy code

$ pip freeze | grep pulumi
pulumi==2.19.0
pulumi-gcp==4.12.0

quaint-tailor-52411

09/15/2022, 8:50 PM

for ComponentResources, what does

self.register_outputs()

actually do? when I register some child resources there and then later try to access them as a property of component object i get

object no attribute my_outputted_resource

quaint-tailor-52411

09/15/2022, 8:51 PM

i was expecting to be able to access all registered outputs as outputs like a standard resource

bland-thailand-60821

09/15/2022, 10:14 PM

Copy code

import pulumi
import pulumi_equinix_metal as equinix_metal

test = equinix_metal.Connection("test",
    organization_id=local["my_organization_id"],
    project_id=local["my_project_id"],
    metro="sv",
    redundancy="redundant",
    type="shared")
__ERROR-----------------------
Diagnostics:
  pulumi:pulumi:Stack (mosk-auto-test):
    error: Program failed with an unhandled exception:
    Traceback (most recent call last):
      File "./__main__.py", line 4, in <module>
        test = equinix_metal.Connection("test",
    AttributeError: module 'pulumi_equinix_metal' has no attribute 'Connection'

limited-continent-1382

09/16/2022, 9:19 AM

Hello there, We know we can export values programmatically by using

pulumi.export("ip", "0.0.0.0")

, but is there a way to get that exported value from that key using Python?

breezy-knife-24305

09/20/2022, 6:49 PM

I'm trying to perform introspection of the AWS resources (

pulumi_aws

) so that we can dynamically define configuration templates. I'm running into the following issue:

Copy code

Traceback (most recent call last):
  File "~/Documents/workspace/ops/pulumi/pulumi-config.py", line 17, in <module>
    import pulumi_aws as aws
  File "~/.virtualenvs/pulumi/lib/python3.9/site-packages/pulumi_aws/__init__.py", line 5, in <module>
    from . import _utilities
  File "~/.virtualenvs/pulumi/lib/python3.9/site-packages/pulumi_aws/_utilities.py", line 15, in <module>
    import pulumi.runtime
ModuleNotFoundError: No module named 'pulumi.runtime'; 'pulumi' is not a package

Any ideas on how I can get

pulumi.runtime

recognized?