gentle-application-59272
11/09/2023, 7:12 PMlimited-rainbow-51650
11/09/2023, 8:40 PMgentle-application-59272
11/10/2023, 7:07 AMaws
provider, a couple bits using aws-native
(which is buggy as heck with media services resources, lots of 500 errors from the aws api) and some using cloudformation.Stack. I'd say about 9 mediapackage channels, 9 medialive channels, 30 or so mediaconnect flows, as well as 2 cloudfront distributions, some roles, some secrets. With all the bits & pieces that wire up the major parts it comes to 250 resources, i'm sure 1/5 to 1/10 of those are my custom components.
Most interesting is that the same thing takes 1.5 minutes on my coworkers machine, who is in australia. Our backend is an s3 bucket in australia.
I timed a call to fetch the state json file and it takes 6.5 seconds to fetch it on my machine
i'm not ready to make a strong statement on what i think i'm observing, take the following with a grain of salt because I don't trust my memory. I have noticed that, depending on what i'm trying to update, the preview portion of pulumi up
can take anywhere from a minute to 5, then on yes
the preparatory phase up to 15min where nothing is updated, then finally it begins updating resources and that part appears to go reasonably well although ive noticed that resources may have updated and then pulumi can sit another 20-60 seconds extra. I did notice that when I was fiddling with the cloudformation.Stacks the times swung quite a lot, and somehow I think when it had nothing to update it got slowerpulumi v3.92.0
@pulumi/pulumi: 3.91.1
@pulumi/aws: 6.6.1
@pulumi/aws-native: 0.82.0
@pulumi/awsx: 2.0.3
@pulumi/random: 4.14.0
great-sunset-355
11/10/2023, 7:44 AMgentle-application-59272
11/10/2023, 8:06 AMgreat-sunset-355
11/10/2023, 8:10 AMechoing-dinner-19531
11/10/2023, 8:51 AMthat goofy thing where it writes to the state file for each resource in series, downloading & uploading it each time
was a bug in previes versions of pulumi, wondering if it's regressed somehowThat is still the case. You can disable it with an envvar PULUMI_SKIP_CHECKPOINTS.
gentle-application-59272
11/10/2023, 2:40 PMechoing-dinner-19531
11/12/2023, 3:24 PM😞 sadly not. It's come up a few times of building a new state system that does this, but it's a lot of work to get right.I guess we don't have any sort of 'active' state system that can exchange diffs instead of the whole state file hey
gentle-application-59272
11/15/2023, 11:54 AM? You can have state in as many backends as makes sense for your use cases. Not sure what the question is here?I'm not sure what I was asking either lol
sadly not. It's come up a few times of building a new state system that does this, but it's a lot of work to get right.indeed it is definitely not trivial
cuddly-magician-97620
11/30/2023, 5:35 PM