pulumi-community #python

helpful-processor-86468

08/14/2020, 11:48 AM

any clue why im getting:

gcp:organizations/getIAMPolicy:getIAMPolicy returned an error: grpc: error while marshaling: proto: repeated field Values has nil element

with:

Copy code

scheduler_policy_func_invoker = organizations.get_iam_policy(bindings=[
        {
            "members": [job_account_member],
            "role": "roles/cloudfunctions.invoker",
        },
    ])

fierce-market-67222

08/14/2020, 12:02 PM

hi i have some problems with pulumi_gcp ….i use it to create dns records on google and it works from on-prem clusters but i am getting forbidden when trying to do the same thing from a gke cluster …same user same code… but no clue why..thank you

stocky-spoon-28903

08/15/2020, 10:52 PM

Is there a way to catch exceptions from a data source in a python Pulumi program?

astonishing-branch-30086

08/17/2020, 12:45 PM

Is there a hook for the event that Pulumi creates a resource? I would like to print a message if and only if a resource of a particular type was created by Pulumi in the current

pulumi up

call.

early-match-56268

08/18/2020, 12:40 PM

Hi 👋 , does anyone know how pulumi figures out which plugin version to install? I started with a fresh installation of pulumi (cleaned the

~/.pulumi

dir and reinstalled) and then tried to run my project but the wrong plugin versions are being installed when I bring up my project:

Copy code

❯ poetry run pulumi up
Previewing update (prod):
[resource plugin kubernetes-2.4.0] installing
Downloading plugin: 23.95 MiB / 23.95 MiB [=========================] 100.00% 1s
Moving plugin... done.

error: could not load plugin for aws provider 'urn:pulumi:prod::new-data::pulumi:providers:aws::aws-east': no resource plugin 'aws' found in the workspace or on your $PATH

the aws plugin is not installed and the kubernetes version in my project is 2.4.3 but 2.4.0 plugin is being installed. I can workaround by manually installing the plugins but it is a bit inconvenient

echoing-breakfast-73834

08/18/2020, 4:04 PM

Hey all, does anybody know how to properly return

CheckResult

object with failures? I've tried

return CheckResult(None, check_failures)

return CheckResult([], check_failures)

and

return CheckResult(_news, check_failures)

but each of them raise a different error.

echoing-dawn-86996

08/19/2020, 4:09 PM

Hey guys! I'm trying to upgrade from '2.2.1' to '2.8.2' and I'm getting import errors:

Copy code

from pulumi.resource import ComponentResource, ResourceOptions, export
from pulumi_gcp import service_account, projects

This is the error:

Copy code

File "./components/service_accounts_binding.py", line 2, in <module>
    from pulumi_gcp import service_account, projects
ImportError: cannot import name 'service_account' from 'pulumi_gcp' (/usr/local/lib/python3.7/site-packages/pulumi_gcp/__init__.py)

My requirements.txt:

Copy code

pulumi>=2.0.0,<3.0.0
pulumi-gcp>=3.0.0,<4.0.0

echoing-dawn-86996

08/19/2020, 4:10 PM

Not sure what is going on in that package, but all seem correct to me.. What am I missing?

echoing-dawn-86996

08/19/2020, 4:20 PM

Looks like changing service_account to serviceaccount fixed the issue. This is similar issue to this: https://github.com/pulumi/pulumi-gcp/issues/410 I'll comment there too

bumpy-beach-79487

08/19/2020, 4:41 PM

Hi there!

bumpy-beach-79487

08/19/2020, 4:42 PM

i'm having the same issue

bumpy-beach-79487

08/19/2020, 4:42 PM

I have already changed the name to

serviceaccount

bumpy-beach-79487

08/19/2020, 4:43 PM

Copy code

from pulumi import Config
from pulumi import export as output
from pulumi import ResourceOptions
from pulumi_gcp import cloudrun, serviceaccount

bumpy-beach-79487

08/19/2020, 4:44 PM

This is the error I received:

Copy code

File "./__main__.py", line 4, in <module>
        from pulumi_gcp import cloudrun, serviceaccount
    ImportError: cannot import name 'serviceaccount' from 'pulumi_gcp' (/usr/local/lib/python3.7/site-packages/pulumi_gcp/__init__.py)
    error: an unhandled error occurred: Program exited with non-zero exit code: 1

bumpy-beach-79487

08/19/2020, 5:02 PM

I updated to python3.8, that fixed my error

broad-dog-22463

08/19/2020, 7:57 PM

Hi all We must apologise for the breaking change that occured in the minor version bump of the GCP provider. v3.19.0 introduced a codegen change that ensured consistent package names. This changed the following package names: Go

serviceAccount -> serviceaccount

NodeJS

serviceAccount -> serviceaccount

Python

service_account -> serviceaccount

This was an unintended consequence of the codegen change being released and is something that we should have ensured happened in a controlled manner rather than forcing the breakage on the customer We are going to have a followup post-mortem event to ensure we learn from this and that we add better quality bars to our releases so that we don't release these breaking changes without any warning or notice. We will publish the results of this post-mortem to make sure our customers understand what we have learned from this I am sorry for this issue. If this issue will cause you any unnecessary replacement of any infrastructure, then please do let us know and we can work with you on making sure this isn't the case Paul

busy-iron-87492

08/20/2020, 8:49 AM

Hi there! I'm doing some investigation to do some integration tests like described here: https://github.com/pulumi/examples/tree/31056c3480cc445e5d4d3a8a0a86977adce2bc5e/testing-integration only thing is that I would do it in python, does anyone have any example git project where this is illustrated?

faint-table-42725

08/25/2020, 3:37 PM

The pulumi CLI/engine is different from the pulumi SDK. You

brew install pulumi

to obtain the CLI whereas

pulumi

in your requirements.txt refers to the Python-specific SDK. When you run

pulumi up

it spins up both the engine and a language host. The latter executes your python program within your specified python environment. The diagram in https://www.pulumi.com/docs/intro/concepts/how-pulumi-works/ provides a useful diagram and more details.

limited-knife-15571

08/26/2020, 10:04 PM

I'm trying to reproduced the script from here (in typescript) in python to create a digitalocean container registry credential

ContainerRegistryDockerCredentials

in python. https://github.com/pulumi/pulumi-kubernetesx/issues/49#issuecomment-651498775 My code look like that

Copy code

container_registry = ContainerRegistry.get("source", "hyperwave-research")
        registry_creds = pulumi.Output.secret( ContainerRegistryDockerCredentials(
            "container-registry-creds", registry_name=container_registry.name).docker_credentials)

        def encode_base64_dc(dc):
            message_bytes = dc.encode('ascii')
            base64_bytes = base64.b64encode(message_bytes)
            print(f"===> Docker  : {dc}")
            print(f"===> Docker Credential : {base64_bytes.decode('utf-8')}")
            return base64_bytes.decode("utf-8")

        dc = registry_creds.apply(encode_base64_dc)

        self.secret = Secret(
            "registry-creds-kube-secret",
            type="<http://kubernetes.io/dockerconfigjson|kubernetes.io/dockerconfigjson>",
            metadata={"namespace": "default", "name": f"registry-{do_registry_name}"},
            string_data={".dockerconfigjson": dc},
            opts=opts,
        )

However whatever I tried, the docker.credential is everytime None. I tried other property of the

ContainerRegistryDockerCredentials

and I can confirm I have value like registry_name

Copy code

```
      File "/home/dzucker/git/Hyperwave.Infrastructure/venv/lib/python3.8/site-packages/pulumi/runtime/rpc.py", line 192, in serialize_property
        obj[transformed_key] = await serialize_property(v, deps, input_transformer)
      File "/home/dzucker/git/Hyperwave.Infrastructure/venv/lib/python3.8/site-packages/pulumi/runtime/rpc.py", line 173, in serialize_property
        value = await serialize_property(output.future(), deps, input_transformer)
      File "/home/dzucker/git/Hyperwave.Infrastructure/venv/lib/python3.8/site-packages/pulumi/runtime/rpc.py", line 159, in serialize_property
        future_return = await asyncio.ensure_future(awaitable)
      File "/home/dzucker/git/Hyperwave.Infrastructure/venv/lib/python3.8/site-packages/pulumi/output.py", line 112, in get_value
        val = await self._future
      File "/home/dzucker/git/Hyperwave.Infrastructure/venv/lib/python3.8/site-packages/pulumi/output.py", line 174, in run
        transformed: Input[U] = func(value)
      File "./digitalocean/docker_registry.py", line 42, in print_dc
        message_bytes = dc.encode('ascii')
    AttributeError: 'NoneType' object has no attribute 'encode'
    error: an unhandled error occurred: Program exited with non-zero exit code: 1

I tried other idea that I found from the slack https://pulumi-community.slack.com/archives/C84L4E3N1/p1596457104392200?thread_ts=1596452646.389800&cid=C84L4E3N1 however same result. Am I doing something ? or could it be they are a mapping error on the python property naming.

worried-plastic-45846

08/27/2020, 4:52 PM

Hello, I had a codebuild.Project() configured to source from github, with

source_version="master"

. I switched this CodeBuild project to an S3 source, and removed the

source_version

parameter entirely (it's optional for S3, and defaults to the latest version of the source artifact). After a

pulumi up

, CodeBuild kept the value at "master", I had to explicitly add

source_version=""

to my codebuild.Project(). Is this the expected behavior? FYI @broad-dog-22463 @bright-orange-69401

gentle-soccer-81698

08/27/2020, 6:28 PM

Hi all, I'm trying to get vsphere host thumbprint using the new resource and I'm getting an error when trying to retrieve it.

Copy code

raise ValueError(f"unexpected input of type {type(value).__name__}")
    ValueError: unexpected input of type GetHostThumbprintResult

gentle-soccer-81698

08/27/2020, 6:28 PM

Copy code

hosts = ['<http://vlab-esx-80.vballin.com|vlab-esx-80.vballin.com>','<http://vlab-esx-90.vballin.com|vlab-esx-90.vballin.com>','<http://vlab-esx-100.vballin.com|vlab-esx-100.vballin.com>','<http://vlab-esx-110.vballin.com|vlab-esx-110.vballin.com>','<http://vlab-esx-120.vballin.com|vlab-esx-120.vballin.com>','<http://vlab-esx-130.vballin.com|vlab-esx-130.vballin.com>','<http://vlab-esx-140.vballin.com|vlab-esx-140.vballin.com>','<http://vlab-esx-150.vballin.com|vlab-esx-150.vballin.com>']

host_thumb_list = []
def get_host_thumbprint():
    for h in hosts:
        thumbprint = vsphere.get_host_thumbprint(address=h, insecure=True)
        host_thumb_list.append(thumbprint)
    return
get_host_thumbprint()

gentle-soccer-81698

08/27/2020, 6:28 PM

https://www.pulumi.com/docs/reference/pkg/vsphere/gethostthumbprint/

gentle-soccer-81698

08/27/2020, 6:33 PM

Copy code

pulumi version
v2.9.0
pulumi plugin ls
NAME     KIND      VERSION  SIZE   INSTALLED   LAST USED
vsphere  resource  2.8.0    61 MB  2 days ago  2 days ago

many-psychiatrist-74327

08/28/2020, 3:31 AM

Hi all. I’m having troubles using

tags

on AWS resource, and the error seems to be related the RPC python implementation…

pulumi up

fails with:

Copy code

File "/<path-redacted>/python3.8/site-packages/pulumi/runtime/rpc.py", line 451, in translate_output_properties
        raise AssertionError(f"Unexpected type. Expected 'list' got '{typ}'")
    AssertionError: Unexpected type. Expected 'list' got '<class 'str'>'
    error: an unhandled error occurred: Program exited with non-zero exit code: 1

With this,

pulumi up

works:

Copy code

for zone in zones.names:
    vpc_subnet = ec2.Subnet(
        f'vpc-subnet-{zone}',
        assign_ipv6_address_on_creation=False,
        vpc_id=vpc.id,
        map_public_ip_on_launch=True,
        cidr_block=f'10.100.{len(subnet_ids)}.0/24',
        availability_zone= zone,
        tags={
            'Name' : f'pulumi-sn-{zone}'
        }
    )

With this, it doesn’t:

Copy code

for zone in zones.names:
    vpc_subnet = ec2.Subnet(
        f'vpc-subnet-{zone}',
        assign_ipv6_address_on_creation=False,
        vpc_id=vpc.id,
        map_public_ip_on_launch=True,
        cidr_block=f'10.100.{len(subnet_ids)}.0/24',
        availability_zone= zone,
        tags={
            'Name' : f'pulumi-sn-{zone}',
            'new-tag': 'new-value'  # <---- this is the only change
        }
    )

Any ideas/suggestions on what might be going on here?

white-balloon-205

08/28/2020, 5:51 PM

Cross-posting for the #python folks here as well. https://pulumi-community.slack.com/archives/CB36DSVSA/p1598635165030400

steep-alligator-79173

08/28/2020, 7:43 PM

Hi I’m trying to conver pulumi output object to string that can be assign to variable and used as a parameter in curl request. Im following documentation https://www.pulumi.com/docs/intro/concepts/programming-model/#outputs

Copy code

repo_id = gitlab_repo.id.apply(lambda repo_id: repo_id)

steep-alligator-79173

08/28/2020, 7:44 PM

when I try to print this variable I all the time getting

Copy code

<pulumi.output.Output object at 0x10acc5a00>

steep-alligator-79173

08/28/2020, 7:44 PM

how I can get raw string that can be used in curl request

steep-alligator-79173

08/28/2020, 7:44 PM

I want to add gitlab environment