pulumi-community #general

great-sunset-355

07/22/2021, 11:08 AM

I have another about component resources and

register_outputs

pulumi.export()

that provides stack outputs. I have 2 projects

core

and

app

inside

core

there is a

ComponentResource

Copy code

class MyTopic(ComponentResource):
    """My SNS Topic"""

    def __init__(self, config: TopicModel, opts: ResourceOptions = None):
        super().__init__(
            "stekz:components:aws:sns-topic",
            config.name,
            None,
            opts,
        )

        self.topic = sns.Topic(
            "component_topic",
            name_prefix=config.name_prefix,
        )
        self.register_outputs(
            {
                'component_topic_name': self.topic.name,
            }
        )
# now we instantiate the resource
MyTopic(
    config=TopicModel(
        name='core-imported',
        name_prefix='cp'
    )
)

By doing so I expected to be able to refer to

MyTopic.outputs.component_topic_name

from

app

however that does not seem to be possible because all I can do is to use the

StackReference

. But stack reference can only refer to outputs from

pulumi.export('key', 'value)

So instead of using

register_outputs

I'd have to do this:

Copy code

t= MyTopic(
    config=TopicModel(
        name='core-imported',
        name_prefix='cp'
    )
)

pulumi.export('component_topic_name', t.name)

Which I consider quite ineffective in case this has to be done on a larger amount of resources. Of course, I can wrap it in the function and invent my own convention for this but my point is that I should not have to. I see this as a problem inherited from terraform which suffers a very similar problem. https://github.com/hashicorp/terraform/issues/8554 I wonder if these issues is somehow related to my problem: https://github.com/pulumi/pulumi/issues/2653, https://github.com/pulumi/pulumi/issues/5941 thank you. I'm curious if there is any specific limitation that does not allow referencing to the outputs of another stack the way I'd expect or is just the result of the initial implementation where pulumi team took ideas from existing solutions? Thank you

little-market-63455

07/22/2021, 12:41 PM

Just wondering, why is there a concept of a namespace in the config files. Why isn't the key the namespace Current

Copy code

aws:someProperty: 'a'
aws:somethingElse: 'b'

vs.

Copy code

aws:
  someProperty: 'a'
  somethingElse: 'b'

I feel this helps clear the confusion, at least mine, around reading nested configs and allows you to fold/unfold related options Something also related to this, why isn't the configuration key types inferred from the config file rather than specified explicitly. As in why

requireString()

and

requireObject()

and so on instead of just

require()

and

get

. I feel the config file already all has the type and secret semantics that you need for that?

➕ 1

mysterious-australia-14256

07/22/2021, 3:35 PM

Is it possible to rename a pulumi project?

steep-toddler-94095

07/22/2021, 9:27 PM

Is there a recommended pattern when dealing with multiple AWS accounts in a single organization? Is it better for the state to live in a single bucket in the root account or should the state for each account be in a bucket in that account?

refined-kitchen-10197

07/23/2021, 3:00 AM

hi guys, just made a question in #gitlab about the gitlab-ci integration that looks like is not working. https://www.pulumi.com/docs/guides/continuous-delivery/gitlab-app/

wet-sunset-4939

07/23/2021, 4:27 AM

Hi All, Not sure if anyone facing the same issues with me? The Pulumi Azure Pipelines Task runs very slow some time it takes more than 1 hours. Seems, mixing between azure and azure-native are slow down the process.

great-sunset-355

07/23/2021, 9:45 AM

How can I copy config between different projects? I've renamed the project by exporting and importing the stack, now I'd like to also copy the config to the new project, how can I do it? I tried

Copy code

pulumi config cp --stack staging  --dest <owner>/dest-proj/staging

I get

error: [400] Message authentication failed

✅ 1

mysterious-australia-14256

07/23/2021, 3:51 PM

Hi, we are considering switching from an Azure backend to the Pulumi managed (Team) backend. Is there any information on SLAs associated with this service?

👍 2

little-whale-73288

07/23/2021, 4:30 PM

Hi, how can I create Pulumi access tokens for continuous delivery that are not tied to a particular person? I'd like their scope to be limited to a particular project within the organization

👍 1

miniature-advantage-31279

07/24/2021, 4:35 AM

Hi guys, just curious, how do you manage to avoid the Route53 records errors for:

[ERR]: Error building changeset: InvalidChangeBatch: [Tried to create resource record set [name='***', type='CNAME'] but it already exists]

even though I applied the options for:

Copy code

{ deleteBeforeReplace: true },

average-television-1214

07/25/2021, 11:40 PM

Folks, the golang SDK often blows up on ctx.Export() in GCP, when some components are not ready. What's the general approach to dealing with it? As the script grows destroying and re-running from scratch becomes lengthier and and lengthier.

average-television-1214

07/25/2021, 11:43 PM

Something like this is not very helpful in identifying a root cause:

Copy code

panic: fatal: An assertion has failed
 
goroutine 201 [running]:
 
<http://github.com/pulumi/pulumi/sdk/v3/go/common/util/contract.failfast(...)|github.com/pulumi/pulumi/sdk/v3/go/common/util/contract.failfast(...)>
 
	/Users/alexlokshin/go/pkg/mod/github.com/pulumi/pulumi/sdk/v3@v3.8.0/go/common/util/contract/failfast.go:23
 
<http://github.com/pulumi/pulumi/sdk/v3/go/common/util/contract.Assert(...)|github.com/pulumi/pulumi/sdk/v3/go/common/util/contract.Assert(...)>
 
	/Users/alexlokshin/go/pkg/mod/github.com/pulumi/pulumi/sdk/v3@v3.8.0/go/common/util/contract/assert.go:26
 
<http://github.com/pulumi/pulumi/sdk/v3/go/pulumi.marshalInputAndDetermineSecret(0x288d040|github.com/pulumi/pulumi/sdk/v3/go/pulumi.marshalInputAndDetermineSecret(0x288d040>, 0xc0000e0000, 0x2d2a180, 0x25fdda0, 0xc0000dd801, 0x109e5f2, 0x265f0e0, 0x1, 0xc0000dd898, 0x109ce25, ...)
 
	/Users/alexlokshin/go/pkg/mod/github.com/pulumi/pulumi/sdk/v3@v3.8.0/go/pulumi/rpc.go:280 +0x38c5
 
<http://github.com/pulumi/pulumi/sdk/v3/go/pulumi.marshalInput(0x29b50e0|github.com/pulumi/pulumi/sdk/v3/go/pulumi.marshalInput(0x29b50e0>, 0xc000288850, 0x2d2a180, 0x25fdda0, 0x29b5001, 0xc000288850, 0x265f0e0, 0xc0000120b0, 0x94, 0x0, ...)
 
	/Users/alexlokshin/go/pkg/mod/github.com/pulumi/pulumi/sdk/v3@v3.8.0/go/pulumi/rpc.go:171 +0x73
 
<http://github.com/pulumi/pulumi/sdk/v3/go/pulumi.marshalInputAndDetermineSecret(0x26d12a0|github.com/pulumi/pulumi/sdk/v3/go/pulumi.marshalInputAndDetermineSecret(0x26d12a0>, 0xc000188450, 0x2d2a180, 0x2632e00, 0xc0001eee01, 0x1785baf, 0x273ee80, 0xc000592350, 0x2d2a180, 0x2454880, ...)
 
	/Users/alexlokshin/go/pkg/mod/github.com/pulumi/pulumi/sdk/v3@v3.8.0/go/pulumi/rpc.go:374 +0x100a
 
<http://github.com/pulumi/pulumi/sdk/v3/go/pulumi.marshalInput(0x26d12a0|github.com/pulumi/pulumi/sdk/v3/go/pulumi.marshalInput(0x26d12a0>, 0xc000188450, 0x2d2a180, 0x25fdda0, 0x1, 0x1, 0x0, 0x0, 0x0, 0x0, ...)
 
	/Users/alexlokshin/go/pkg/mod/github.com/pulumi/pulumi/sdk/v3@v3.8.0/go/pulumi/rpc.go:171 +0x73
 
<http://github.com/pulumi/pulumi/sdk/v3/go/pulumi.(*Context).RegisterResourceOutputs.func1(0xc00026e000|github.com/pulumi/pulumi/sdk/v3/go/pulumi.(*Context).RegisterResourceOutputs.func1(0xc00026e000>, 0x2d24678, 0xc00023c1c0, 0xc000188450)
 
	/Users/alexlokshin/go/pkg/mod/github.com/pulumi/pulumi/sdk/v3@v3.8.0/go/pulumi/context.go:1400 +0x13d
 
created by <http://github.com/pulumi/pulumi/sdk/v3/go/pulumi.(*Context).RegisterResourceOutputs|github.com/pulumi/pulumi/sdk/v3/go/pulumi.(*Context).RegisterResourceOutputs>
 
	/Users/alexlokshin/go/pkg/mod/github.com/pulumi/pulumi/sdk/v3@v3.8.0/go/pulumi/context.go:1387 +0x96
 
exit status 2
 
error: an unhandled error occurred: program exited with non-zero exit code: 1

breezy-butcher-78604

07/26/2021, 5:53 AM

is there a way to get Pulumi to download any relevant security policies in advance? contest is I'm trying to build a Pulumi docker image with a Pulumi project to be run in CI/CD and I want to download/install all relevant providers and security policies as I can at build time so that it doesn't need to do it at run time. providers appear to get installed when the relevant npm modules are installed, but security policies only get downloaded when I run

pulumi up

quiet-architect-74241

07/26/2021, 8:36 AM

Looking for an example on how to use the VirtualMachineExtension in C#, Azure Native.

Copy code

new AzureNative.Compute.VirtualMachineExtension($"{vmName}-VMExtensions", new AzureNative.Compute.VirtualMachineExtensionArgs()
            {
                VmName = vmName,
                ResourceGroupName = resourceGroup.Name,
                AutoUpgradeMinorVersion = true,
                Publisher = "Microsoft.Powershell",
                Type = "DSC",
                TypeHandlerVersion = "2.73",
                Settings = Output.Tuple(hostPool.Name, hostPool.RegistrationInfo).Apply((tuple) =>
                {
                    return JsonConvert.SerializeObject(new
                    {
                        modulesUrl = "<https://storageblobname.blob.core.windows.net/galleryartifacts/Configuration_5-5-2021.zip>",
                        configurationFunction = "Configuration.ps1\\AddSessionHost",
                        properties = new
                        {
                            hostPoolName = tuple.Item1,
                            registrationInfoToken = tuple.Item2.Token,
                            aadJoin = false,
                        }
                    });
                })
            });

which results in this error:

error: azure-native:compute:VirtualMachineExtension resource 'somename-vm-01-VMExtensions' has a problem: 'settings' should be of type '' but got a string

although the documentation says about the settings property:

Json formatted public settings for the extension.

I verified that the string that I am using for the settings property has the exact syntax as when I export the VirtualMachineExtension from the Azure Portal. Looking documentation or an example on how to use the VirtualMachineExtension for DSC extension. Can't find an example anywhere using my Google Fu.

quaint-garage-36651

07/26/2021, 11:14 AM

Hi Looking for example how to connect Network security Group to Network interface and how to add multiple rules in NSG using python for development of Azure

proud-dusk-33872

07/26/2021, 12:15 PM

Hi there. Is the slowness of

pulumi stack output

a known issue - and is there any way to work around it? It takes about 20 seconds to run for me and we have ~25 output variables

curved-ghost-20494

07/26/2021, 4:50 PM

Is there a away of “auto output-ing” variables? For example

Copy code

const instance = new CustomResource('foo');

export.bar = instance.bar;
export.baz = instance.baz;
export.bam = instance.bam;

It’s kind of irritating to do this for lots of variables, especially if I then go and create more instances.

curved-ghost-20494

07/26/2021, 8:12 PM

Another question if I may! Is the

dependsOn

array supposed to work with a

ComponentResource

? I’ve created a wrapper around a tonne of project boilerplate, but I need an SSL certificate to be generated first.

Copy code

let cert = new aws.acm.Certificate("cert", { domainName: '<http://example.com|example.com>' ]);

const project = new Project('foo', { dependsOn: [cert] });

Inside the

Project

there’s a call to

getCertificate('<http://example.com|example.com>')

and it fails as soon as I Run

pulumi up

, rather than waiting for the acm Certificate to complete. I’ve had

dependsOn

working in GCP without CustomResources no problem. Am I approaching this the right way, should I be doing something else perhaps? J x

worried-city-86458

07/26/2021, 11:19 PM

Quick question before I consider changing a username - do pulumi accounts using email login (within an organization) have to have a unique username across all of pulumi or just within the org?

great-sunset-355

07/27/2021, 5:13 AM

How can I undo

pulumi.export("some","value")

? Is this a bug? I exported the value and now I'd like to remove it so I removed it from the code and

pulumi up -y

Diff showed

Copy code

Outputs:
  - some: "value"

But then

pulumi stack

still shows

Copy code

Current stack outputs (1):
    OUTPUT  VALUE
    some    value

Pulumi then shows that it's removing the output until: another value is added to the Outputs

Copy code

pulumi.export('another', 'value')

Then

pulumi up -y

Copy code

Outputs:
  + another: "value"
  - some   : "value"

Then:

pulumi stack

Copy code

Current stack outputs (1):
    OUTPUT   VALUE
    another  value

Note: As long as there is at least one output, removing it works as expected. The described scenario above happens if there is only 1 output in the stack to be removed.

kind-manchester-13281

07/27/2021, 7:17 AM

Hello!, quick question here: Im having trouble using pulumi on an aws ec2 machine with a role - terraform works great with that role but pulumi fails with:

Copy code

2021-07-26 14:21:04,109 integration-test    [ip-172-31-30-43] 62c7f849 ERROR: got an exception while creating environment: 
 code: 255
 stdout: Updating (test):
+  pulumi:pulumi:Stack test-test creating
aws:ec2:SecurityGroup uat_automation_ubuntu:18.04_0_docker_installed_sg  error: 1 error occurred:
+  pulumi:pulumi:Stack test-test created
aws:ec2:SecurityGroup uat_automation_ubuntu:18.04_0_docker_installed_sg **failed** 1 error
Diagnostics:
aws:ec2:SecurityGroup (uat_automation_ubuntu:18.04_0_docker_installed_sg):
error: 1 error occurred:
* error configuring Terraform AWS Provider: no valid credential sources for Terraform AWS Provider found.
Please see <https://registry.terraform.io/providers/hashicorp/aws>
for more information about providing credentials.
Error: NoCredentialProviders: no valid providers in chain. Deprecated.
For verbose messaging see aws.Config.CredentialsChainVerboseErrors
Resources:

This is a ci machine that already has a role assumed, what should I do? Thanks!

calm-quill-21760

07/27/2021, 6:20 PM

Hi all! I’m building an EKS cluster and wanted to confirm whether this expected behavior. Basically, when I supply the minimum config, the EKS cluster builds and the nodes show up. When I specify the AMI, the nodes get built but they do not get attached to the cluster.

Copy code

cluster = eks.Cluster(
    cluster_name,
    name=cluster_name,
# Omitting the node_ami_id succeeds. Adding it in causes nodes to build but not be attached.
    node_ami_id="ami-092263943bcda23f5",
    node_root_volume_size=50,
    desired_capacity=2,
    min_size=1,
    max_size=2,
    encrypt_root_block_device=True,
    vpc_id=myVpc.id,
    cluster_security_group=my_security_group,
    endpoint_public_access=True,
    endpoint_private_access=True,
    public_subnet_ids=public_subnet_ids,
    create_oidc_provider=True,
)

faint-dog-16036

07/27/2021, 7:09 PM

Man, absolute nightmare scenario using pulumi (this was probably my mistake): I just finished moving our dev cluster and vcs system to be managed by pulumi. I ran locally before landing into gitops to ensure things were clean, pulumi runs on gitops and wipes away our vcs hard disk, blob files, database and half of my cluster at random. The connection and state was fine just seconds before.

😞 1

🤔 1

rough-energy-67721

07/27/2021, 7:43 PM

Hello Everyone! Thanks for the call for AWS Community Builders, and the link to the Slack Channel. I work at T-Systems México, and I am part of the AWS User Group for México City, and the AWS Community Builders. Love to develop, and like CDK a lot. My first question: What does Pulumi means?

❤️ 1

kind-cpu-30872

07/28/2021, 5:12 AM

Hey, need some help. I want to import a handful of existing resources. The resources to import need to be gathered at runtime. I need to search the cloud provider (aws for me) by tag, then import all resources with that tag. I feel like this is a dumb question, but I can't figure out how to query the cloud provider in this way using Pulumi, can anyone point me in the right direction on how to do this? Or, if such a mechanism doesn't exist in Pulumi, what's an alternative? Is it common to import the aws sdk to query what I need, then use Pulumi's "import_" to bring them under the Pulumi umbrella?

boundless-cartoon-44055

07/28/2021, 7:44 AM

Hey there! 👋 I am looking into concurrency control for alternative backends. https://news.ycombinator.com/item?id=26884879 states, this was added into Pulumi a while ago. I am unable to find any documentation on this, though. Maybe someone could help push me in the right direction here?

little-van-8457

07/28/2021, 8:13 AM

Copy code

Updating (test-stack):



    pulumi:pulumi:Stack test-project-test-stack running 

 ~  alicloud:fc:Service qianfeng-pulumi-component-test updating [diff: ~description]

 ~  alicloud:fc:Service qianfeng-pulumi-component-test updated [diff: ~description]

    alicloud:fc:Function my-function-1  

 ~  alicloud:fc:Service qianfeng-pulumi-component-test **updating failed** [diff: ~description]; error: Cannot delete parent resource 'urn:pulumi:test-stack::test-project::alicloud:fc/service:Service::qianfeng-pulumi-component-test' without also deleting child 'urn:pulumi:test-stack::test-project::alicloud:fc/service:Service$alicloud:fc/function:Function::my-function-1'.

    pulumi:pulumi:Stack test-project-test-stack  
 

Diagnostics:
  alicloud:fc:Service (qianfeng-pulumi-component-test):
    error: Cannot delete parent resource 'urn:pulumi:test-stack::test-project::alicloud:fc/service:Service::qianfeng-pulumi-component-test' without also deleting child 'urn:pulumi:test-stack::test-project::alicloud:fc/service:Service$alicloud:fc/function:Function::my-function-1'.
 
Outputs:
    functionUrn: "urn:pulumi:test-stack::test-project::alicloud:fc/service:Service$alicloud:fc/function:Function::my-function-1"
    serviceUrn : "urn:pulumi:test-stack::test-project::alicloud:fc/service:Service::qianfeng-pulumi-component-test"

Resources:
    ~ 1 updated
    2 unchanged

many-salesmen-89069

07/28/2021, 8:36 AM

Hi, I'm wondering if Pulumi has first class support for Packer like the Docker.Image resource? I'd like to set up a bastion instance as part of my Pulumi stack and I'd like to build the AMI for it with Packer

great-sunset-355

07/28/2021, 1:25 PM

Hi, I have a problem with renaming resources with aliases. I've read both articles: https://www.pulumi.com/blog/refactoring-iac/ https://www.pulumi.com/docs/intro/concepts/resources/#aliases But I'm not sure how to apply it for my use case and prevent deleting resources After creating several component resources and deploying them I noticed that the parent-child relationship is not correct due to the bug in my code where I merged the

opts

from

parent

into

child

- but

parent_opts

overridden

child_opts

but I wanted it the other way around where I can override

parent_opts

with

child_opts

during the merge. For that, I created a sample code: https://gist.github.com/1oglop1/dcb258471cd33f572bedf67c63b7fe00 with 2 merging methods: -

merge_opts_a

child_opts.merge(parent_opts)

- current & wrong -

merge_opts_b

ResourceOptions.merge(parent_opts, child_opts)

- expected & correct When I change from

merge_opts_a

merge_opts_b

and run

pulumi preview

it says that I'll delete some resources which I need to prevent. How can I correctly apply aliases to prevent the deletion of the resources? Assume all components are supposed to be reusable in another project that does not suffer the current problem. How is this going to behave when I deploy a different stack with Aliases? Can the same alias be assigned to multiple components/resources? Is it possible to pass the alias from the parent without modifying the children's code? Thank you Attached pictures: left - current & wrong, right - expected & correct After trial and error, I managed to solve it by editing the

AppComponent

Copy code

merged_opts = pulumi.ResourceOptions.merge(
            parent_opts,
            pulumi.ResourceOptions(
                parent=self,
                aliases=[
                    Alias(parent=self),
                    Alias(parent=pulumi.ROOT_STACK_RESOURCE)
                ]
            ),
        )

✅ 1

little-whale-73288

07/28/2021, 1:39 PM

Hello, how can I generate a diff file between the actual state and the pulumi state?

pulumi refresh --diff --non-interactive

complains with:

Copy code

error: --yes must be passed in to proceed when running in non-interactive mode

I'd rather pass a

--no

if it was available