Hi I ve got a question reagarding the apply function in Pulu

Question

Hi I ve got a question reagarding the apply function in Pulumi Python as I assume I have a problem with concurrent execution of my stack My code does similar things as the example of < hallowed animal 47023> from Sunday I create a VPC and the the whole network setup Including the attachment of the the newly created vpc and it s subnet to our TransitGateway For the aws ec2transitgateway VpcAttachment I need the private subnets in my vpc as there is the ec2 get subnet ids function I call it to filter my subnets ```private subnet ids = aws ec2 get subnet ids vpc id=vpc id created as the first resource in the stack tags= visibility private filter by tags for the correct subnets ``` But this consistently fails with the error message of ```Exception invoke of aws ec2 getSubnetIds getSubnetIds failed Missing required argument The argument vpc id is required but no definition was found ``` This worked before while developing the code as the VPC was created some days ago but then we deleted the stack and now everything should be created in a single run I guess the call to aws ec2 Vpc hasn t returned yet with an vpc and its id when the call to get subnet ids is being issued

sticky-bear-14421 · Answer

I tried to enforce the code to wait for the vpc by encapsulating the whole vpc attachment calls in a function and invoke the function like this ```vpc id = vpc id apply lambda x x create transitgateway attachment tgw config paramenters vpc id tags ``` Same error

sticky-bear-14421 · Answer

Even doing some printf debugging with ```vpc id = vpc id apply lambda x x print vpc id after apply vpc id create transit gateway attachment tgw config parameters vpc id tags ``` Leads to the astonishing output of ```vpc id after apply lt pulumi output Output object at 0x7fa5c8475400 gt error Program failed with an unhandled exception error Traceback most recent call last lt snip gt Exception invoke of aws ec2 getSubnetIds getSubnetIds failed Missing required argument The argument vpc id is required but no definition was found ``` The error still exists

hallowed-animal-47023 · Answer

< sticky bear 14421> even if your depends on

hallowed-animal-47023 · Answer

Oh wait wait sorry misreading your code

sticky-bear-14421 · Answer

The get subnet ids call has no opts field

sticky-bear-14421 · Answer

sadly

hallowed-animal-47023 · Answer

Yeah

sticky-bear-14421 · Answer

my current approach is to encapsulate the tgw create my stuff wrapper inside the vpc id apply lambda id tgw create my stuff wrapper id

sticky-bear-14421 · Answer

And this did work

purple-plumber-90981 · Answer

are you creating a new vpc and subnets in it as part of this pulumi stack or importing existing ones

sticky-bear-14421 · Answer

Hi < purple plumber 90981> The intention for this stack is to create a vpc with nat igw and TransitGateway setups Its the base deployment of a full network setup

sticky-bear-14421 · Answer

The codebase is split into different files and the function call to collect the subnets is in an function where I do the whole TGW setup process

sticky-bear-14421 · Answer

I thought about something like in the example of < hallowed animal 47023> with `private networks= ` and then put these as parameter in my transitgateway function but the code base has a second use intent as an example for new pulumi users in our organisation So I put the get subnet ids call in this as an example for querying resources from the api with the use of proper tagging

sticky-bear-14421 · Answer

This would become then something like this ```vpc id = vpc id apply lambda x x create transitgateway attachment tgw config paramenters vpc id private networks tags ``` But other resources inside this function need the vpc id aswell so the concurrency problem would remain

purple-plumber-90981 · Answer

right i have been having similar experience when trying to reference future output objects pulumi output Output object outside of a resource definition

purple-plumber-90981 · Answer

so i was wondering if you were referencing pulumi resources not created in the same stack

sticky-bear-14421 · Answer

Yepp I have experienced this with Pulumi and Go aswell it s just that with Go and maybe even more with TypeScript this concurrency behavior is more promiment obvious

purple-plumber-90981 · Answer

im only python so i cant speak across languages

purple-plumber-90981 · Answer

the bit which caught me out is that i was trying to do the transforms outside a resource object but then use the result as input to another resource

purple-plumber-90981 · Answer

i have since learned this is not the pulumi way

purple-plumber-90981 · Answer

and that the transforms need to be encapsualted in a pulumi resource else transformation operations on them fail

purple-plumber-90981 · Answer

wondered if this was similar to what you were experiencing

sticky-bear-14421 · Answer

yeah these boxed types are a complex thing