This message was deleted Pulumi Community #python

Join Slack

This message was deleted.

# python

sparse-intern-71089

01/03/2024, 10:44 PM

This message was deleted.

miniature-musician-31262

01/03/2024, 10:55 PM

Would something like this work?

Copy code

import json
from pulumi_aws import s3

with open("buckets.json") as bucket_data:
    buckets = json.load(bucket_data)

for bucket in buckets:
    s3.Bucket(bucket)

... where

buckets.json

just contains a JSON array of strings:

Copy code

[
    "one",
    "two",
    "three"
]

miniature-musician-31262

01/03/2024, 10:55 PM

When I run this, I get this, for example:

miniature-musician-31262

01/03/2024, 10:57 PM

If you want the actual working directory, you can probably get that from Python directly -- like with

os.getcwd()

. But based on what you've described, I don't think you'll need it.

miniature-musician-31262

01/03/2024, 11:02 PM

If you wanted to read the file path from a stack-config file, then, it'd just be something like this:

Copy code

import json
import pulumi
from pulumi_aws import s3

config = pulumi.Config()
bucket_list = config.get("bucket_path")

with open(bucket_list) as bucket_data:
    buckets = json.load(bucket_data)

for bucket in buckets:
    s3.Bucket(bucket)

with a config file like:

Copy code

config:
  aws:region: us-west-2
  python-json:bucket_path: ./buckets.json

miniature-musician-31262

01/03/2024, 11:10 PM

Hope that helps and that I've understood you right!

swift-king-1490

01/03/2024, 11:26 PM

• I looked into using

os.getcwd()

but unfortunately, pulumi changes the current directory to the program directory so it does not give an accurate value 😞 Using the project structure below, if I am inside the

configs/dev

directory when I run

pulumi up

, if I add

print(os.getcwd())

inside the

__main__.py

, it returns the path to the

src

folder and not the configs folder • Your example works because the

Pulumi.yaml

and the python program are in the same folder. I guess that's on me for not being more detailed 😄 This is my project structure:

Copy code

├── configs
│   ├── dev
│   │   ├── Pulumi.main.yaml
│   │   ├── Pulumi.yaml
│   │   └── auth0-users.yaml
├── requirements.txt
└── src
    ├── __init__.py
    ├── __main__.py
    ├── __pycache__
    ├── auth0_database.py

and the

Pulumi.yaml

file has

main: ../../src

attribute

miniature-musician-31262

01/03/2024, 11:33 PM

There may be options for adjusting some of this at the project file level -- e.g., here: https://www.pulumi.com/docs/concepts/projects/project-file/#attributes

miniature-musician-31262

01/03/2024, 11:36 PM

If the users yaml/json file is truly infra config, you might also consider just putting that data right into one of the Pulumi YAML files

miniature-musician-31262

01/03/2024, 11:37 PM

That'd get you around having to work around the default behavior and standard conventions

miniature-musician-31262

01/03/2024, 11:41 PM

Also curious what error(s) you're getting

miniature-musician-31262

01/03/2024, 11:50 PM

I think I have something that works with your directory structure though

miniature-musician-31262

01/03/2024, 11:56 PM

This seems to work: https://github.com/cnunciato/python-json

🙏 1

swift-king-1490

01/03/2024, 11:56 PM

> If the users yaml/json file is truly infra config, you might also consider just putting that data right into one of the Pulumi YAML files I thought about this but I did not want to bundle all the configuration inside the one yaml file because it'd make it quite big and difficult to maintain 😕 --- so far the only option I found is the use

os.getcwd()

inside

__main__.py

and manually compute the path back to the configs folder like:

../configs/dev

where

dev

would be stored in a variable so I can dynamically adjust the path

swift-king-1490

01/03/2024, 11:57 PM

your example seems similar to what I had in mind looks like: manually compute the path between the pulumi program and the initial config folder

miniature-musician-31262

01/03/2024, 11:59 PM

Yeah -- I mean the Python program isn't running in the

configs

folder, it's running in the

src

folder, so this makes sense, relative to where the program code is

💯 1

swift-king-1490

01/03/2024, 11:59 PM

I'm sad that pulumi clearly knows this path (it uses it to compute the absolute path when using

FileAsset

resource) but does not expose it anywhere 😞 Maybe I could open a feature request for this

swift-king-1490

01/04/2024, 12:00 AM

I do very much appreciate the time you spent trying to figure out a solution with me 🙏

miniature-musician-31262

01/04/2024, 12:03 AM

You bet! Always fun trying to make these things work 🙂

2 Views

Open in Slack

Previous Next