This message was deleted.
# generals
sparse-intern-71089
10/12/2018, 1:08 PMThis message was deleted.
b
bright-motherboard-93404
10/12/2018, 1:09 PMb
big-piano-35669
10/12/2018, 3:14 PM
Unfortunately, until https://github.com/pulumi/pulumi/issues/1063 is implemented, Python programs cannot be parallelized; so they always run serially. I think we have a reasonable idea of the design there -- it's "just" a matter of work (which we can prioritize higher to unblock you for sure).
Are all of your programs in Python, or do you also use Java/TypeScript?
b
bright-motherboard-93404
10/12/2018, 3:21 PMAll in python, but that's only because we run Python apps with wallaroo. For consistency. I guess there's not reason not to do it in typescript if that means true parallelism
bright-motherboard-93404
10/12/2018, 3:22 PMLet me rewrite the stack definition in typescript and see the difference
👍 1
b
big-piano-35669
10/12/2018, 3:23 PM
In general, TypeScript is a bit further along than Python -- in this regard and in the richness of higher level libraries like https://github.com/pulumi/pulumi-aws-infra, but we are committed to supporting them both at the same level long-term, it's just a moment in time thing.
big-piano-35669
10/12/2018, 3:23 PM
Definitely eager to hear what you think after rewriting.
b
bright-motherboard-93404
10/12/2018, 3:24 PMHmm, there's one thing that I forgot about. I generally wanted to keep the number of dependencies low -- if we keep the stack definition in Python, that means the entire wallaroo deployment system is just a
pip install -r requirements.txtb
brave-angle-33257
10/12/2018, 4:54 PMextra vote for python3x support as well!
i
incalculable-sundown-82514
10/12/2018, 4:57 PM@brave-angle-33257 come join #CDE799L1M! I’
incalculable-sundown-82514
10/12/2018, 4:57 PM’d love to hear about people’s python 2x vs 3x requirements
b
bright-motherboard-93404
10/12/2018, 5:27 PMat Wallaroo, we've currently got python3 support on our plate. python2 will retire soon: https://pythonclock.org/
bright-motherboard-93404
10/15/2018, 5:09 PMWell, the rewrite in JS resulted in lighting-fast spin-up times regardless of cluster size 🎉
bright-motherboard-93404
10/15/2018, 5:09 PMbut cluster shutdown is still serial
i
incalculable-sundown-82514
10/15/2018, 8:36 PMStarting with the 0.16 SDK (which should be released soon!) we will delete clusters in parallel too!
b
bright-motherboard-93404
10/15/2018, 8:38 PMThat's awesome news!