pulumi-community #general

handsome-zebra-11018

08/27/2020, 7:06 AM

Wanted to create namespace with FIXED name

Copy code

const devNamespace = "m1af-dev"
const devNs = new k8s.core.v1.Namespace(devNamespace, {
    metadata: {
        "name": devNamespace,
        "labels": {
            "name": devNamespace
        }
    }
}, {});

Used above but it create name with

m1af-dev-h0cgk8db

and not

m1af-dev

chilly-rainbow-79265

08/27/2020, 9:27 AM

How to get stack name in program, so that we can create resources with stack_name prefixed. Like

staging_akscluster

sticky-receptionist-53934

08/27/2020, 10:38 AM

is there any way to just clean/destroy a stack even when there are errors? I find that quite often the pulumi stack enters in some kind of error situation which is impossible to get out from, I have resembled to just destroy the gcp project and start all over but it is quite time consuming, any tips?

bitter-application-91815

08/27/2020, 12:24 PM

I have found when the underlying stack diverges from the pulumi config, you'll need to delete individual things from pulumi using https://www.pulumi.com/docs/reference/cli/pulumi_state_delete/

bitter-application-91815

08/27/2020, 12:24 PM

after you have nuked it from the underlying stack

bitter-application-91815

08/27/2020, 12:24 PM

the you can destroy the full stack with the usual command

sticky-receptionist-53934

08/27/2020, 1:32 PM

Can this warning/error be ignored or does it imply that CRDs are not going to work properly?

Copy code

manifest_sorter.go:192: info: skipping unknown hook: "crd-install"

hallowed-beach-15050

08/27/2020, 1:54 PM

that looks like a helm error. I would make sure your CRDs are in the right spot in the helm chart for the version of helm you are using… assuming helm is in the mix, of course

sticky-receptionist-53934

08/27/2020, 2:22 PM

helm is in the mix, yes. Do you know if this error is a consequence of this other warning that I get?:

Copy code

warning: <http://apiextensions.k8s.io/v1beta1/CustomResourceDefinition|apiextensions.k8s.io/v1beta1/CustomResourceDefinition> is deprecated by <http://apiextensions.k8s.io/v1/CustomResourceDefinition|apiextensions.k8s.io/v1/CustomResourceDefinition> and not supported by Kubernetes v1.22+ clusters.

billowy-kangaroo-51688

08/27/2020, 5:08 PM

Hey fellow Pulumians 🙋‍♂️ I just realized that my project is not uploading the expected

aws-sdk

(NodeJS) version to Lambda and I'm not sure how to bundle the intended version, pinned via package.json

dependencies

& even yarn

resolutions

and

yarn.lock

. What am I missing?

✅ 1

early-intern-90238

08/27/2020, 7:41 PM

Well, after 2 years of hard work my site is finally live. Back-end architecture completely driven by Pulumi. Would like to thank everyone here for their help over the course of that time!! Also a small shameless plug: https://cloudlayer.io if you want to check it out!! Did it all myself, was a TON of work, but learned a lot. Thanks guys!!

👏 5

🎉 2

👍 5

big-potato-91793

08/27/2020, 7:50 PM

does tf2pulumi supports tf12?

calm-pizza-15027

08/27/2020, 8:39 PM

Hey team, I am trying to get the ip address of a helm generated load balancer

Copy code

const devNamespace = new k8s.core.v1.Namespace("devNamespace", {
    metadata: {
        name: "dev",
    },
},{provider:clusterRecIngProvider});

export const nginxIngress = new k8s.helm.v3.Chart("nginx-ingress", {
    chart: "nginx-ingress",
    namespace: devNamespace.metadata.name,
    fetchOpts:{
        repo: "<https://helm.nginx.com/stable/>",
    },
},{provider:clusterRecIngProvider});
const status = nginxIngress.getResourceProperty("v1/Service","nginx-ingress-nginx-ingress","status");
export const recIp = status.apply((status)=> status.loadBalancer.ingress[0].ip);

calm-pizza-15027

08/27/2020, 8:40 PM

Any ideas on how to use getResourceProperty() ?

many-psychiatrist-74327

08/28/2020, 1:59 AM

👋 hello! qq: is it possible to edit the tags (or really, any Input) of a given Resource after it’s been declared? The context is how to break circular dependencies. In my immediate situation, I’m creating a Cluster that needs the VPC id. But my VPC also needs the cluster name in its tags so it can be discovered by ingress controllers. I suppose a workaround is to specify the physical name of the Cluster when creating it.. but I’d rather avoid that if possible.

many-psychiatrist-74327

08/28/2020, 4:55 AM

Cross-posting from #python: I’m getting the following error when running `pulumi up`: Tried on pulumi 2.9.0 and 2.9.1. Problem seems to be related to the an AWS VPC resource.

Copy code

$ pulumi up
Previewing update (test):
     Type                 Name             Plan       Info
 +   pulumi:pulumi:Stack  kubernetes-test  create     3 errors; 37 messages
 +   └─ aws:ec2:Vpc       eks-vpc-2        create

Diagnostics:
  pulumi:pulumi:Stack (kubernetes-test):
    error: Program failed with an unhandled exception:
    error: Traceback (most recent call last):
      File "/usr/local/bin/pulumi-language-python-exec", line 85, in <module>
        loop.run_until_complete(coro)
      File "/usr/local/Cellar/python@3.8/3.8.5/Frameworks/Python.framework/Versions/3.8/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
        return future.result()
      File "/Users/<redacted>/venv/lib/python3.8/site-packages/pulumi/runtime/stack.py", line 83, in run_in_stack
        await run_pulumi_func(lambda: Stack(func))
      File "/Users/<redacted>/venv/lib/python3.8/site-packages/pulumi/runtime/stack.py", line 51, in run_pulumi_func
        await RPC_MANAGER.rpcs.pop()
      File "/Users/<redacted>/venv/lib/python3.8/site-packages/pulumi/runtime/rpc_manager.py", line 67, in rpc_wrapper
        result = await rpc
      File "/Users/<redacted>/venv/lib/python3.8/site-packages/pulumi/runtime/resource.py", line 427, in do_register
        await rpc.resolve_outputs(res, resolver.serialized_props, resp.object, resolvers)
      File "/Users/<redacted>/lib/python3.8/site-packages/pulumi/runtime/rpc.py", line 487, in resolve_outputs
        translated_value = translate_output_properties(value, res.translate_output_property, types.get(key))
      File "/Users/<redacted>/lib/python3.8/site-packages/pulumi/runtime/rpc.py", line 434, in translate_output_properties
        return {
      File "/Users/<redacted>/venv/lib/python3.8/site-packages/pulumi/runtime/rpc.py", line 436, in <dictcomp>
        translate_output_properties(v, output_transformer, get_type(k))
      File "/Users/<redacted>/venv/lib/python3.8/site-packages/pulumi/runtime/rpc.py", line 451, in translate_output_properties
        raise AssertionError(f"Unexpected type. Expected 'list' got '{typ}'")
    AssertionError: Unexpected type. Expected 'list' got '<class 'str'>'
    error: an unhandled error occurred: Program exited with non-zero exit code: 1

To narrow down the problem, I created an entirely new stack, and commented out my resources until the error went away. If I define a VPC (like in the config below), the error shows up. If I remove the VPC resource, everything works fine.

Copy code

from pulumi_aws import ec2

vpc = ec2.Vpc(
    'eks-vpc',
    cidr_block='10.100.0.0/16',
    instance_tenancy='default',
    enable_dns_hostnames=True,
    enable_dns_support=True,
    tags={
        'Name' : 'pulumi-eks-vpc'
    }
)

Has anyone encountered this before or has any pointers/suggestions?

sticky-receptionist-53934

08/28/2020, 7:31 AM

Hello, just a quickie, are there any good practices on how to deploy a pulumi stack in different gcp projects? for example, common to me is that I have one prod project and one dev project and I want to easily be able to deploy on one or the other.

quick-finland-93793

08/28/2020, 7:37 AM

Hello! I’m having issues creating AWS RDS aurora-mysql DB instances. Referring to the AWS documentation, the value for

AllocatedStorage

is not applicable, but still is required when instanciating an

Rds.Instance()

with Engine

aurora-mysql

. Furthermore, the CLI reports, that a value for

iops

has to be set, but setting an

iops

value for engine

aurora-mysql

seems to be invalid (

InvalidParameterCombination: Specifying IOPs is not allowed for this engine

). I can’t find an applicable example of how to create AWS RDS Aurora-Mysql instances on the web - may someone give me some hints of what I'm doing wrong?

✅ 1

cuddly-dusk-95227

08/28/2020, 8:42 AM

Hello! Just tried out my first project in Pulumi, love it! Can’t wait to see what’s coming next :) and learning to use pulumi more in anger :)

🎉 2

victorious-helmet-11068

08/28/2020, 12:45 PM

hello! I use quite often StackReference.

victorious-helmet-11068

08/28/2020, 12:45 PM

In the output and programming model view it is better to export an object or an attribute of an object? It is better to export “nework” or “network.id” ?

breezy-cricket-40277

08/28/2020, 1:55 PM

Hello! Is it possible to read config secrets from

files

stdin

? Such as

Copy code

pulumi config set property --file myfile

astonishing-quill-88807

08/28/2020, 3:03 PM

I'm running into some trouble with trying to write a dynamic resource provider. When I try to preview the state it's throwing an error about the resource object not having an attribute that is defined as one of the outputs. The relevant code for the provider is here: https://github.com/mitodl/ol-infrastructure/blob/dagster_instance/src/ol_infrastructure/providers/salt/minion.py#L127-L149

astonishing-quill-88807

08/28/2020, 3:03 PM

The code where I'm trying to use the attribute is here: https://github.com/mitodl/ol-infrastructure/blob/dagster_instance/src/ol_infrastructure/infrastructure/applications/dagster/__main__.py#L162-L176

astonishing-quill-88807

08/28/2020, 3:08 PM

Here's the output that I'm seeing:

Copy code

Previewing update (<http://applications.dagster.QA|applications.dagster.QA>):
     Type                                          Name                                                           Plan        Info
     pulumi:pulumi:Stack                           <http://ol-infrastructure-dagster-application-applications.dagster.QA|ol-infrastructure-dagster-application-applications.dagster.QA>              3 errors
 ~   ├─ aws:ec2:SecurityGroup                      dagster-db-access-qa                                           update      [diff: ~ingress]
 +   ├─ pulumi-python:dynamic:Resource             dagster-data-qa-0                                              create      
     └─ ol:infrastructure:aws:database:OLAmazonDB  ol-etl-db-qa                                                               
 +-     └─ aws:rds:Instance                        ol-etl-db-qa-postgres-instance                                 replace     [diff: ~name]
 
Diagnostics:
  pulumi:pulumi:Stack (<http://ol-infrastructure-dagster-application-applications.dagster.QA|ol-infrastructure-dagster-application-applications.dagster.QA>):
    error: Program failed with an unhandled exception:
    error: Traceback (most recent call last):
      File "/usr/bin/pulumi-language-python-exec", line 85, in <module>
        loop.run_until_complete(coro)
      File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
        return future.result()
      File "/home/tmacey/code/mit/ops/infra/ol-infrastructure/.venv/lib/python3.8/site-packages/pulumi/runtime/stack.py", line 83, in run_in_stack
        await run_pulumi_func(lambda: Stack(func))
      File "/home/tmacey/code/mit/ops/infra/ol-infrastructure/.venv/lib/python3.8/site-packages/pulumi/runtime/stack.py", line 35, in run_pulumi_func
        func()
      File "/home/tmacey/code/mit/ops/infra/ol-infrastructure/.venv/lib/python3.8/site-packages/pulumi/runtime/stack.py", line 83, in <lambda>
        await run_pulumi_func(lambda: Stack(func))
      File "/home/tmacey/code/mit/ops/infra/ol-infrastructure/.venv/lib/python3.8/site-packages/pulumi/runtime/stack.py", line 106, in __init__
        func()
      File "/usr/bin/pulumi-language-python-exec", line 84, in <lambda>
        coro = pulumi.runtime.run_in_stack(lambda: runpy.run_path(args.PROGRAM, run_name='__main__'))
      File "/usr/lib/python3.8/runpy.py", line 282, in run_path
        return _run_code(code, mod_globals, init_globals,
      File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
        exec(code, run_globals)
      File "./__main__.py", line 173, in <module>
        {salt_minion.minion_public_key}
    AttributeError: 'OLSaltStack' object has no attribute 'minion_public_key'
    error: an unhandled error occurred: Program exited with non-zero exit code: 1

astonishing-quill-88807

08/28/2020, 3:16 PM

Nevermind, figured it out. I had forgotten to update the dict of attributes passed into the resource provider.

purple-dawn-53665

08/28/2020, 3:37 PM

I'm not sure if this would be suited for this channel or others, but is there any plan to build a provider for interfacing with Infoblox DNS/DHCP/IPAM to manage it?

echoing-breakfast-73834

08/28/2020, 4:10 PM

I've found what appears to be a nice bug involving the pulumi resource for AWS KMS keys. During preview of an existing key specifically on Ubuntu 18.04 (running in an Azure DevOps pipeline) I receive the below error. This doesn't happen on Win10 with identical settings, on 2.9.1 or 2.9.0. It looks like the terraform bridge is not able to correctly transform an output. Has anybody else experienced this issue?

echoing-breakfast-73834

08/28/2020, 4:10 PM

Copy code

I0828 15:57:58.508597    3262 eventsink.go:59] incoming output value translated: 128.0 -> 128.0
I0828 15:57:58.508613    3262 eventsink.go:62] eventSink::Debug(<{%reset%}>incoming output value translated: 128.0 -> 128.0<{%reset%}>)
I0828 15:57:58.508993    3262 eventsink.go:59] incoming output property translated: handler -> handler
I0828 15:57:58.509008    3262 eventsink.go:62] eventSink::Debug(<{%reset%}>incoming output property translated: handler -> handler<{%reset%}>)
I0828 15:57:58.509383    3262 eventsink.go:59] incoming output value translated: lambda_transform_alert.lambda_handler -> lambda_transform_alert.lambda_handler
I0828 15:57:58.509398    3262 eventsink.go:62] eventSink::Debug(<{%reset%}>incoming output value translated: lambda_transform_alert.lambda_handler -> lambda_transform_alert.lambda_handler<{%reset%}>)
I0828 15:57:58.509782    3262 eventsink.go:59] incoming output property translated: kmsKeyArn -> kms_key_arn
I0828 15:57:58.509797    3262 eventsink.go:62] eventSink::Debug(<{%reset%}>incoming output property translated: kmsKeyArn -> kms_key_arn<{%reset%}>)
I0828 15:57:58.510183    3262 eventsink.go:59] incoming output value translated: arn:aws:kms:us-east-2:ACCOUNT_ID:key/KEY_ID -> arn:aws:kms:us-east-2:ACCOUNT_ID:key/KEY_ID
I0828 15:57:58.510199    3262 eventsink.go:62] eventSink::Debug(<{%reset%}>incoming output value translated: arn:aws:kms:us-east-2:ACCOUNT_ID:key/KEY_ID -> arn:aws:kms:us-east-2:ACCOUNT_ID:key/KEY_ID<{%reset%}>)
I0828 15:57:58.510781    3262 eventsink.go:59] RPC failed with exception:
I0828 15:57:58.510797    3262 eventsink.go:62] eventSink::Debug(<{%reset%}>RPC failed with exception:<{%reset%}>)
I0828 15:57:58.511812    3262 eventsink.go:59] Traceback (most recent call last):
  File "/opt/hostedtoolcache/Python/3.8.5/x64/lib/python3.8/site-packages/pulumi/runtime/rpc_manager.py", line 67, in rpc_wrapper
    result = await rpc
  File "/opt/hostedtoolcache/Python/3.8.5/x64/lib/python3.8/site-packages/pulumi/runtime/resource.py", line 426, in do_register
    await rpc.resolve_outputs(res, resolver.serialized_props, resp.object, resolvers)
  File "/opt/hostedtoolcache/Python/3.8.5/x64/lib/python3.8/site-packages/pulumi/runtime/rpc.py", line 492, in resolve_outputs
    translated_value = translate_output_properties(value, res.translate_output_property, types.get(key))
  File "/opt/hostedtoolcache/Python/3.8.5/x64/lib/python3.8/site-packages/pulumi/runtime/rpc.py", line 432, in translate_output_properties
    translated_values = {
  File "/opt/hostedtoolcache/Python/3.8.5/x64/lib/python3.8/site-packages/pulumi/runtime/rpc.py", line 433, in <dictcomp>
    k: translate_output_properties(v, output_transformer, get_type(k))
  File "/opt/hostedtoolcache/Python/3.8.5/x64/lib/python3.8/site-packages/pulumi/runtime/rpc.py", line 439, in translate_output_properties
    return {
  File "/opt/hostedtoolcache/Python/3.8.5/x64/lib/python3.8/site-packages/pulumi/runtime/rpc.py", line 441, in <dictcomp>
    translate_output_properties(v, output_transformer, get_type(k))
  File "/opt/hostedtoolcache/Python/3.8.5/x64/lib/python3.8/site-packages/pulumi/runtime/rpc.py", line 456, in translate_output_properties
    raise AssertionError(f"Unexpected type. Expected 'list' got '{typ}'")
AssertionError: Unexpected type. Expected 'list' got '<class 'str'>'
I0828 15:57:58.511831    3262 eventsink.go:62] eventSink::Debug(<{%reset%}>Traceback (most recent call last):
  File "/opt/hostedtoolcache/Python/3.8.5/x64/lib/python3.8/site-packages/pulumi/runtime/rpc_manager.py", line 67, in rpc_wrapper
    result = await rpc
  File "/opt/hostedtoolcache/Python/3.8.5/x64/lib/python3.8/site-packages/pulumi/runtime/resource.py", line 426, in do_register
    await rpc.resolve_outputs(res, resolver.serialized_props, resp.object, resolvers)
  File "/opt/hostedtoolcache/Python/3.8.5/x64/lib/python3.8/site-packages/pulumi/runtime/rpc.py", line 492, in resolve_outputs
    translated_value = translate_output_properties(value, res.translate_output_property, types.get(key))
  File "/opt/hostedtoolcache/Python/3.8.5/x64/lib/python3.8/site-packages/pulumi/runtime/rpc.py", line 432, in translate_output_properties
    translated_values = {
  File "/opt/hostedtoolcache/Python/3.8.5/x64/lib/python3.8/site-packages/pulumi/runtime/rpc.py", line 433, in <dictcomp>
    k: translate_output_properties(v, output_transformer, get_type(k))
  File "/opt/hostedtoolcache/Python/3.8.5/x64/lib/python3.8/site-packages/pulumi/runtime/rpc.py", line 439, in translate_output_properties
    return {
  File "/opt/hostedtoolcache/Python/3.8.5/x64/lib/python3.8/site-packages/pulumi/runtime/rpc.py", line 441, in <dictcomp>
    translate_output_properties(v, output_transformer, get_type(k))
  File "/opt/hostedtoolcache/Python/3.8.5/x64/lib/python3.8/site-packages/pulumi/runtime/rpc.py", line 456, in translate_output_properties
AssertionError: Unexpected type. Expected 'list' got '<class 'str'>'
    raise AssertionError(f"Unexpected type. Expected 'list' got '{typ}'")
<{%reset%}>)

quaint-egg-65511

08/28/2020, 5:06 PM

We are approaching pulumi from a terraform background, we looked everywhere, every guide, every, github example but I can't figure out how is supposed to work in a fully automated environment. How can I create a stack entirely from CI? Stack init edits pulumi.stack.yml and we are supposed to save it