Is there a straight forward way to profile a refre...
# generala
acceptable-army-69872
10/07/2019, 8:29 PMIs there a straight forward way to profile a refresh? This stack has like 20 some odd vpcs, and some of them are peered, but I can't help but feel it's refreshing the same resources several times. It's upwards of 30 minutes to run a refresh. I've done equally complex resources layouts in other IaC languages and even 10 minutes is long.
w
white-balloon-205
10/07/2019, 8:38 PM
You can grab a trace with the command at https://github.com/pulumi/pulumi/issues/3257#issuecomment-534629119 (the same should work for a
refresh👍 2
w
worried-city-86458
10/07/2019, 8:40 PMI'm finding my patience is being test as well so I'm really looking forward to any perf improvements
w
white-balloon-205
10/07/2019, 8:41 PM
@worried-city-86458 On what operations exactly (refresh, up, other)? And I forget - have you shared a trace yet?
w
worried-city-86458
10/07/2019, 8:42 PMUp operations, using Helm charts in particular.
worried-city-86458
10/07/2019, 8:43 PMIf you can make the Istio chart fast that should cover most bases 😛
w
white-balloon-205
10/07/2019, 8:43 PM
Got it - if you haven't yet shared a trace - it would be great to see one that is typical of where things feel particularly slow - just so we can verify. Though for large helm charts - I'm guessing this is related to the issues discussed at the bottom of https://github.com/pulumi/pulumi/issues/3257. I'm hoping we'll be able to tackle both of those very soon.
w
worried-city-86458
10/07/2019, 8:43 PM(I'm not using it yet but heading that way)
a
acceptable-army-69872
10/07/2019, 8:44 PMI'm running again with trace. The last refresh bombed out, which could have been my keys expiring.
acceptable-army-69872
10/07/2019, 8:44 PM Copy code
Resources:
+ 1260 to create
~ 130 to update
- 179 to delete
+-290 to replace
1859 changes. 256 unchanged
error: failed to complete update: [403] Forbiddenw
white-balloon-205
10/07/2019, 8:44 PM
BTW - encourage anyone seeing perf issues to upvote 3257, and share traces or details of their use cases - we're actively working on improvements here - so the more data we have to guide this work the better.
w
worried-city-86458
10/07/2019, 8:45 PMI'm watching for any k8s changes and happy to try anything in alpha
a
acceptable-army-69872
10/08/2019, 1:59 PM@white-balloon-205 the trace is 305 megs
305M up.traceg
gentle-diamond-70147
10/08/2019, 3:08 PM@acceptable-army-69872 can you send us the file (s3 url?)?
a
acceptable-army-69872
10/08/2019, 3:10 PMIt compressed down to 29 megs.
👍 1
g
gorgeous-egg-16927
10/08/2019, 8:14 PMReleased version 1.2.1 of the k8s provider that significantly improves performance of preview on stacks with a lot of k8s resources
gorgeous-egg-16927
10/08/2019, 8:15 PMWe’re working on several related PRs that should help out a lot