pulumi-community #general

Join the conversation Join Slack

general

ambitious-optician-69807

02/18/2021, 8:34 AM

Also with the interactive prompt, how can I even automate this with CI/CD?

ambitious-optician-69807

02/18/2021, 8:36 AM

After the project files are generated, I was HORRIFIED when I see

Pulumi.yaml

. The whole point is I don’t want to write CloudFormation yaml or K8s yaml or Helm Chart yaml. I say get rid of it if you can

ambitious-optician-69807

02/18/2021, 8:40 AM

Just found this at almost bottom of FAQ https://www.pulumi.com/docs/troubleshooting/faq/#how-does-pulumi-depend-on-pulumi-com

better-actor-92669

02/18/2021, 10:38 AM

Hello guys! I want to understand the best approach to tackle my use case. I have a Pulumi stack for one of my GCP projects. Within that stack, I have a GKE cluster and a Provider class (pulumi_kubernetes python module), via which I apply manifests and connect to the cluster itself. As for now, I apply several helm charts within the same pulumi stack. I want to move all helm-related code/workflows to another stack, with the idea that infrastructure will be in one stack, and helm workflows that significantly increase pulumi execution time will go to another stack. I am trying to understand how to reference my cluster and k8s_provider in another stack. Of course, I can do pulumi import, which means that I will have to keep the code updated in two stacks whenever I want to change either cluster or provider. Are there any other options, e.g., inter-stack dependencies or something similar? Can someone please recommend how to accomplish that?

red-lighter-44012

02/18/2021, 10:43 AM

you can try to use a stack reference: https://www.pulumi.com/docs/intro/concepts/stack/#stackreferences

👍 1

broad-hairdresser-1495

02/18/2021, 4:35 PM

Hi, I just installed Pulumi on win10 and trying to login to a pulumi server:

>pulumi login <https://app.pulumi.com/>
Manage your Pulumi stacks by logging in.
Run `pulumi login --help` for alternative login options.
Enter your access token: <Access Token from <https://app.pulumi.com/><username>/settings/tokens >

error: problem logging in: getting user info from <https://app.pulumi.com/>: unmarshalling response object: invalid character '<' looking for beginning of value

it seems like I'm missing something.

mammoth-honey-6147

02/18/2021, 8:18 PM

If I were to create a stack dependency, is it expected that if I reference an output from one stack into another, Pulumi will run that stack to generate that output? For example, I have a stack that creates and exports an AWS VPC, which I reference in another stack

early-balloon-35820

02/18/2021, 10:47 PM

Hi all! Is it possible to use Pulumi automation to deploy a container to Google Compute Engine? I have not found any GCE examples in Github.

ambitious-father-68746

02/19/2021, 1:50 AM

Hi, is there a way to force Pulumi showing secrets when checking out diffs? I don't want this permanent, just on an ad-hoc basis.

ambitious-father-68746

02/19/2021, 2:46 AM

Hi, is there a way to force a replacement of a resource instead of having an update? To clarify I'm talking about the code itself, not the usage of

--target-replace

on the CLI. At least I couldn't find anything in the ResourceOptions. Thank you.

ambitious-father-68746

02/19/2021, 3:25 AM

Another one: is there a way to mark an Output as not a secret? There's a complex structure that I'm getting from a resource and the whole thing is marked as a secret. I want to be able to extract some data using .apply and then mark it as non secret, so that it can show up in diffs.

gifted-student-18589

02/19/2021, 9:52 AM

A CI/CD and state-storing question… Does it make sense to use

file://

as a backend for local development, and have

s3://

in CI/CD? So basically, different backends in different contexts. Thanks!

mammoth-honey-6147

02/19/2021, 12:29 PM

I've got a go based Pulumi project leveraging the aws providers, when running the first

pulumi preview

to download and compile the go packages, it seems to use all my RAM (16GB) and will eventually crash. Specific details in thread:

jolly-lunch-12979

02/19/2021, 1:38 PM

What's the best approach for changing providers with already imported resources? For example changing from the Azure provider to the AzureNextGen provider, using the same resource names seemingly will still result in a delete of the original Azure resources, followed by a create under AzureNextGen. Is there a simple way to do an in place swap without having to delete each resource in the state manually, then add an ImportId to reimport everything?

great-dog-65117

02/19/2021, 1:52 PM

Hi there! Im planing to use Pulumi in a benchmarking environment. The general flow would be like: • Create resources (computes, etc) • Execute benchmarks • Store results • Destroy resources Is there some sort of

Pulumi.Listener()

to, say send a signal (after benchmark execution) to trigger resource destruction?

red-lighter-44012

02/19/2021, 5:27 PM

I am unable to

pulumi destroy

a stack that has a PostgreS database with a created role that owns resources.

role "{role name}" cannot be dropped because some objects depend on it

is the error im getting. I need to reassign owned resources or somehow delete the database before the role that owns resources in it. How can I achieve this? I thought that setting

skipReassignOwned

on the role would help, but even after applying this and re-running destroy I get the same error.

sparse-winter-38469

02/19/2021, 9:24 PM

Hello everybody, I've run into something unexpected. I am using pulumi to create and configure resources in GCP using for an organization for which I have an IAM role. (I don't know what my role/roles are because I don't have permission to view them when I got the IAM section in the GCP console) I ran pulumi up to deploy an httpCallbackFunction however when I hit the endpoint and run

pulumi logs -f

I get an error:

error: failed to get logs: 1 error occurred:
        * rpc error: code = PermissionDenied desc = The caller does not have permission

Is this related to my IAM role/how do I fix this issue?

stocky-parrot-75654

02/20/2021, 12:40 AM

I have a natgateway created by a new awsx.ec2.vpc. Now it is necessary to remove the natgateway and use a transit gateway. Is it possible to change the route table and remove the natgateway with pulumi?

colossal-australia-65039

02/20/2021, 3:10 AM

pulumi up

is taking a reallly long time to provision my infrastructure (the preview step is fine, taking only 30 sec). I have about 150 resources in this stack and I'm not sure if that's above the upper limit that it's supposed to reasonably handle. Any change, even just a minor change to a kubernetes resource annotation is taking several minutes. Has anyone else run into something like this? Unfortunately the trace doesn't give me any information on why it takes so long (this is for a 6min 29 sec

up

step)

[{
  "ID": {
    "Trace": "4eb4fcc5ac88eb53",
    "Span": "78a16bb236ea45fb",
    "Parent": "0000000000000000"
  },
  "Annotations": [
    {
      "Key": "Name",
      "Value": "cHVsdW1p"
    },
    {
      "Key": "_schema:name",
      "Value": null
    },
    {
      "Key": "Span.Start",
      "Value": "MjAyMS0wMi0yMFQwMzoxNTo0NC42NzY4ODczWg=="
    },
    {
      "Key": "Span.End",
      "Value": "MjAyMS0wMi0yMFQwMzoyMjoxNC4wNDc4MTZa"
    },
    {
      "Key": "_schema:Timespan",
      "Value": null
    }
  ],
  "Sub": null
}]

I'm on version

v2.21.1

by the way

wonderful-river-94448

02/20/2021, 5:52 AM

Hey folks, I am using the "azuread" plugin and I'm running in to trouble setting some properties on applications (https://www.pulumi.com/docs/reference/pkg/azuread/application/). I've worked around this by shelling out in an

Output

but unfortunately this makes me run into another bug that makes the

pulumi destroy

command fail. Ideally I'd like to hook some custom code into the

destroy

flow but it seems the my C# stack doesn't get invoked at all upon delete. Is it possible to hook into the delete flow of a resource? I tried looking into making a custom plugin but they seem to be Go (?) binaries and dynamic providers are not yet available on C#

✅ 1

steep-baker-41148

02/20/2021, 10:04 AM

Hey @white-balloon-205, I've been looking into getting you the traces that you've been asking for, but man, they are so contaminated with passwords and tokens and what not. Is there any scrub command readily available to clean this stuff up? I could try to write a script to scrub stuff myself, but it will most likely take much more time than I'm able to invest at this point... and obviously we don't have any production-sized projects without tokens etc. because that's the whole point of using pulumi to set them... 😞

wide-boots-22590

02/20/2021, 11:47 AM

Hello, everyone! Sorry, but i didn't find, how to create cloudfront using pulumi from scratch. Maybe someone can help me?

early-intern-90238

02/20/2021, 7:51 PM

hey guys, is there a way to defined BackendConfig for GCP as defined here: https://cloud.google.com/kubernetes-engine/docs/how-to/ingress-features

early-intern-90238

02/20/2021, 7:51 PM

I can't find anywhere where a type called BackendConfig exists

early-intern-90238

02/20/2021, 8:55 PM

so I just went around this issue by using a yaml file and deploying that with Pulumi instead. let me know if there is a better way.

crooked-exabyte-92919

02/20/2021, 9:42 PM

I need to manage GCP FireStore. For a few days, the link https://www.pulumi.com/docs/reference/pkg/gcp/firestore/index has been returning a 404 error.

chilly-night-36370

02/21/2021, 9:39 AM

Is it just me or is https://app.pulumi.com/ offline?

wet-noon-14291

02/21/2021, 11:13 PM

How do I create a repository for a github organization? Do I need to authenticate the provider differently than setting the github token?

straight-cartoon-24485

02/22/2021, 5:07 AM

How do you organize your cluster-level stacks vs. app stacks? For instance, I want to install the Linkerd helm chart before the other apps (so they get auto-injected the Linkerd sidecar) - realizing now that now Pulumi won't be aware of these sidecars, so what gives? Does simply ordering the steps in your programing language of choice suffice? Or is there a more elaborate dependency-between-stacks mechanism where I could declare to first install the cluster-level resources, then the namespace-level apps?

broad-hairdresser-1495

02/22/2021, 11:08 AM

Hi, it seems like Pulumi python API client is have issues with win10 permissions im running an example from https://github.com/pulumi/automation-api-examples/blob/main/python/inline_program/main.py

D:\GIT\GIT\git_lab\pre-prod_system_test\pulumi\PyClient>python myPulumiClient.py
Traceback (most recent call last):
  File "D:\GIT\GIT\git_lab\pre-prod_system_test\pulumi\PyClient\myPulumiClient.py", line 61, in <module>
    stack = auto.create_or_select_stack(stack_name=stack_name,
  File "C:\Python\Python391\lib\site-packages\pulumi\x\automation\local_workspace.py", line 398, in create_or_select_stack
    return _inline_source_stack_helper(stack_name, program, project_name, Stack.create_or_select, opts)  # type: ignore
  File "C:\Python\Python391\lib\site-packages\pulumi\x\automation\local_workspace.py", line 416, in _inline_source_stack_helper
    return init_fn(stack_name, ws)
  File "C:\Python\Python391\lib\site-packages\pulumi\x\automation\stack.py", line 188, in create_or_select
    return Stack(stack_name, workspace, StackInitMode.CREATE_OR_SELECT)
  File "C:\Python\Python391\lib\site-packages\pulumi\x\automation\stack.py", line 214, in __init__
    workspace.create_stack(name)
  File "C:\Python\Python391\lib\site-packages\pulumi\x\automation\local_workspace.py", line 205, in create_stack
    self._run_pulumi_cmd_sync(args)
  File "C:\Python\Python391\lib\site-packages\pulumi\x\automation\local_workspace.py", line 276, in _run_pulumi_cmd_sync
    return _run_pulumi_cmd(args, self.work_dir, envs, on_output)
  File "C:\Python\Python391\lib\site-packages\pulumi\x\automation\cmd.py", line 75, in _run_pulumi_cmd
    os.remove(stderr_file.name) <<<<
PermissionError: [WinError 32] The process cannot access the file because it is being used by another process: 'C:\\Users\\romlaz\\AppData\\Local\\Temp\\tmp8o_qs82u'

file is created but cant delete it self due to it is still open by another process.

Title

broad-hairdresser-1495

02/22/2021, 11:08 AM

Hi, it seems like Pulumi python API client is have issues with win10 permissions im running an example from https://github.com/pulumi/automation-api-examples/blob/main/python/inline_program/main.py

D:\GIT\GIT\git_lab\pre-prod_system_test\pulumi\PyClient>python myPulumiClient.py
Traceback (most recent call last):
  File "D:\GIT\GIT\git_lab\pre-prod_system_test\pulumi\PyClient\myPulumiClient.py", line 61, in <module>
    stack = auto.create_or_select_stack(stack_name=stack_name,
  File "C:\Python\Python391\lib\site-packages\pulumi\x\automation\local_workspace.py", line 398, in create_or_select_stack
    return _inline_source_stack_helper(stack_name, program, project_name, Stack.create_or_select, opts)  # type: ignore
  File "C:\Python\Python391\lib\site-packages\pulumi\x\automation\local_workspace.py", line 416, in _inline_source_stack_helper
    return init_fn(stack_name, ws)
  File "C:\Python\Python391\lib\site-packages\pulumi\x\automation\stack.py", line 188, in create_or_select
    return Stack(stack_name, workspace, StackInitMode.CREATE_OR_SELECT)
  File "C:\Python\Python391\lib\site-packages\pulumi\x\automation\stack.py", line 214, in __init__
    workspace.create_stack(name)
  File "C:\Python\Python391\lib\site-packages\pulumi\x\automation\local_workspace.py", line 205, in create_stack
    self._run_pulumi_cmd_sync(args)
  File "C:\Python\Python391\lib\site-packages\pulumi\x\automation\local_workspace.py", line 276, in _run_pulumi_cmd_sync
    return _run_pulumi_cmd(args, self.work_dir, envs, on_output)
  File "C:\Python\Python391\lib\site-packages\pulumi\x\automation\cmd.py", line 75, in _run_pulumi_cmd
    os.remove(stderr_file.name) <<<<
PermissionError: [WinError 32] The process cannot access the file because it is being used by another process: 'C:\\Users\\romlaz\\AppData\\Local\\Temp\\tmp8o_qs82u'

file is created but cant delete it self due to it is still open by another process.

did a workaround for this issue, by editing in

pulumi\x\automation\cmd.py

try:
        os.remove(stderr_file.name)
    except:
        pass

billowy-army-68599

02/22/2021, 3:42 PM

good morning! Could you kindly open an issue for this, it looks like a bug

broad-hairdresser-1495

02/22/2021, 4:23 PM

@jaxxstorm im new at this, where do i create a ticket for this?

billowy-army-68599

02/22/2021, 4:25 PM

https://github.com/pulumi/pulumi/issues

broad-hairdresser-1495

02/22/2021, 4:44 PM

thanks, created https://github.com/pulumi/pulumi/issues/6402

billowy-army-68599

02/22/2021, 4:45 PM

thank you!

View count: 1