Is it possible to dynamically configure AWS GCP or K8s

Question

creamy-potato-29402 · Answer

< quiet wolf 18467> what do you mean when you say dynamically

quiet-wolf-18467 · Answer

I m trying to setup Pulumi Packs that provide reusable components for people to use

quiet-wolf-18467 · Answer

I want to allow passing different GCP or other accounts to the function

creamy-potato-29402 · Answer

Hmm I still am not sure I understand You mean passing service accounts around

creamy-potato-29402 · Answer

maybe it would help if you had an example of the code you d like to write

quiet-wolf-18467 · Answer

Say I want to deploy an pod to 2 different Kubernetes clusters Is that possible

creamy-potato-29402 · Answer

yeah sure In the case of Kubernetes you have two options

creamy-potato-29402 · Answer

1 the k8s provider picks up whatever is in your kubeconfig file so if you can tell the kubernetes provider to use a different context which points at a different cluster For this to be sensible you d need one stack per cluster though

quiet-wolf-18467 · Answer

And if I wanted it in a single stack

creamy-potato-29402 · Answer

2 in the case of a high order provider you d just specify two different providers So say you boot up an AKS and GKE cluster in the same app You d write a `for` loop over both

quiet-wolf-18467 · Answer

So providers can be configured in code That s what I m after Can the same be done for AWS Azure and GCS

quiet-wolf-18467 · Answer

GCP sorry

creamy-potato-29402 · Answer

hmm you d probably want to have 2 providers one for each cluster

creamy-potato-29402 · Answer

yeah

creamy-potato-29402 · Answer

That I do not know

quiet-wolf-18467 · Answer

creamy-potato-29402 · Answer

< microscopic florist 22719>

quiet-wolf-18467 · Answer

It s super early But I want to provide something that is configurable like that

creamy-potato-29402 · Answer

I d love to help

creamy-potato-29402 · Answer

Pat is the guy to ask though

quiet-wolf-18467 · Answer

I plan to provide for TypeScript Python and Go

quiet-wolf-18467 · Answer

And I want to write functions for Kubernetes deployments to check InfluxDB and Prometheus for linear regression and automated rollbscks

quiet-wolf-18467 · Answer

So it s all plug and play

creamy-potato-29402 · Answer

oooo have you seen our staged rollout example for k8s

creamy-potato-29402 · Answer

creamy-potato-29402 · Answer

if not check it out

glamorous-printer-66548 · Answer

< quiet wolf 18467> funny to see that I actually built a pulumi package to setup gitlab runner as well In my case it s setting up a gke cluster from scratch and installs an auto scaling gitlab runner onto it Maybe I should open source it it s pretty generic already

quiet-wolf-18467 · Answer

I ve seen the stages roll out But it s not that reusable

creamy-potato-29402 · Answer

that s true

creamy-potato-29402 · Answer

you mean in the sense that it s not built like a library

quiet-wolf-18467 · Answer

Exactly

creamy-potato-29402 · Answer

maybe I should make it a library

quiet-wolf-18467 · Answer

I d like to just import the function smile

creamy-potato-29402 · Answer

yeah

creamy-potato-29402 · Answer

it was meant as an example but maybe it s worth doing as a library

quiet-wolf-18467 · Answer

< glamorous printer 66548> I d love to see it

quiet-wolf-18467 · Answer

I think there s many thing that can be shared this way I think Pulumi can replace Helm While I know Pulumi can deploy Helm charts it s also much better to codify than Go Templates

quiet-wolf-18467 · Answer

I hope I m thinking things that are already on the teams minds and not going too far down the crazy path smiley

microscopic-florist-22719 · Answer

Late to the party here but yes you can do this

microscopic-florist-22719 · Answer

With one catch neither Python nor Go expose first class providers yet

creamy-potato-29402 · Answer

< quiet wolf 18467> well on the k8s side my goal is to make this situation really easy yes

microscopic-florist-22719 · Answer

In TypeScript you just do `new aws Provider name inputs ` like with any other resource

glamorous-printer-66548 · Answer

< quiet wolf 18467> absolutely agree Would love to have a helm like ecosystem for pulumi packages slightly smiling face

creamy-potato-29402 · Answer

i e to make it really easy to author libraries you can use anywhere

microscopic-florist-22719 · Answer

Same for GCP Azure etc

quiet-wolf-18467 · Answer

Perfect So the first argument to `createGitLabRunner` could be that provider

microscopic-florist-22719 · Answer

Yes

creamy-potato-29402 · Answer

I thought about just porting the top 20 charts over winter break

glamorous-printer-66548 · Answer

use of static types is so handy for reuse packages

quiet-wolf-18467 · Answer

Shame there s no pattern matching in TypeScript

creamy-potato-29402 · Answer

lol I know

creamy-potato-29402 · Answer

seriously

microscopic-florist-22719 · Answer

< quiet wolf 18467> if you re not yet familiar with component resources you should take a look at them

quiet-wolf-18467 · Answer

I had a quick look but need to spend more time researching

quiet-wolf-18467 · Answer

I didn t think components would be cloud agnostic but perhaps I didn t play enough

microscopic-florist-22719 · Answer

eks Cluster is a good place to look <https github com pulumi eks blob master nodejs eks cluster ts>

microscopic-florist-22719 · Answer

They can definitely be cloud agnostic See e g cloud Service which runs on AWS or Azure

microscopic-florist-22719 · Answer

In principle they can even span multiple clouds

quiet-wolf-18467 · Answer

Thanks < microscopic florist 22719> +1

microscopic-florist-22719 · Answer

np

quiet-wolf-18467 · Answer

Is there a preferred templating system in TypeScript land

quiet-wolf-18467 · Answer

Slight segue

microscopic-florist-22719 · Answer

Beyond interpolated strings

microscopic-florist-22719 · Answer

< white balloon 205> might know

glamorous-printer-66548 · Answer

I used this for a few things <https mozilla github io nunjucks >

creamy-potato-29402 · Answer

What do you mean by templating system

glamorous-printer-66548 · Answer

although I prefer to simply use ES6 template literals

quiet-wolf-18467 · Answer

I ll want to render the GitLab toml from my struct configuration

quiet-wolf-18467 · Answer

Into a ConfigMap or user data

quiet-wolf-18467 · Answer

I think template literals would make configuring the executor in the toml difficult < glamorous printer 66548>

glamorous-printer-66548 · Answer

oh yeah toml

glamorous-printer-66548 · Answer

toml sucks btw

glamorous-printer-66548 · Answer

but

glamorous-printer-66548 · Answer

in my package i m simply using <https www npmjs com package iarna toml>

glamorous-printer-66548 · Answer

to convert the config from a JS object to a toml file

glamorous-printer-66548 · Answer

so no need for template literals or whatever

glamorous-printer-66548 · Answer

`TOML stringify obj ` does the job

quiet-wolf-18467 · Answer

Awesome Thank you < glamorous printer 66548>

quiet-wolf-18467 · Answer

This may be a silly question

quiet-wolf-18467 · Answer

When I do `new k8s apps v1beta1 Deployment`

quiet-wolf-18467 · Answer

Does that create the deployment there and then or are all the references collected and run later

glamorous-printer-66548 · Answer

wdyt of creating a common github organization for some pulumi reuse packages

quiet-wolf-18467 · Answer

I notice your example < creamy potato 29402> uses an annotation to check latency

glamorous-printer-66548 · Answer

something like `pulumi components` or `pulumi packages`

quiet-wolf-18467 · Answer

But could it just be a normal code block before deploying more

quiet-wolf-18467 · Answer

< glamorous printer 66548> I created `pulumu packs` on GitLab

glamorous-printer-66548 · Answer

i noticed but honestly gitlab sucks for open source

glamorous-printer-66548 · Answer

their search is so bad you just can t find anything

quiet-wolf-18467 · Answer

Their search is awful

quiet-wolf-18467 · Answer

True

quiet-wolf-18467 · Answer

But it s open source and transparent

quiet-wolf-18467 · Answer

I m happy to use GH instead if you think GL would ruin traction

glamorous-printer-66548 · Answer

well it transparently sucks smile

quiet-wolf-18467 · Answer

We can always mirror to GitHub heart eyes

quiet-wolf-18467 · Answer

GitHub the closed sourced profit sucking company behind the success of open source rolling on the floor laughing

glamorous-printer-66548 · Answer

yeah i think it would definately hinder traction it s just nobody will find it I bet that gitlab repos also tend to have a lower Google search rank because gitlabs page score is certainly lower

glamorous-printer-66548 · Answer

yeah I mean sometimes you just gotta be pragmatic It d be more than happy to use gitlab and simply mirror to github if gitlab would at least fix their search and site speed but not until then slightly smiling face

quiet-wolf-18467 · Answer

I would use GitHub more if they supported groups Some orgs have thousands of packages

quiet-wolf-18467 · Answer

But this is irrelevant

quiet-wolf-18467 · Answer

Why don t you create the org and we can take it from there smile

glamorous-printer-66548 · Answer

oh yeah that is interesting

glamorous-printer-66548 · Answer

but until we have 1000 pulumi packages there s a long way smile

glamorous-printer-66548 · Answer

yeah sure but let s discuss the name first

glamorous-printer-66548 · Answer

pulumi packs pulumi packages pulumi components

glamorous-printer-66548 · Answer

< creamy potato 29402> any thoughts

glamorous-printer-66548 · Answer

pulumi charts joy

quiet-wolf-18467 · Answer

Yeah maybe someone from Pulumi has some input If we go with pulumi packs I ll transfer the npm org hugging face

glamorous-printer-66548 · Answer

ok i m gonna create pulumi packs for now we can rename it a couple of days later if we want to Pulumi packs is not bad because it s descriptive unlike charts but still distinctive enough to be recognized as own brand compared to packages slightly smiling face

quiet-wolf-18467 · Answer

Sweet

quiet-wolf-18467 · Answer

Got the invite Cheers +1

glamorous-printer-66548 · Answer

and we have the first repository tada <https github com pulumi packs pulumi packs typescript>

glamorous-printer-66548 · Answer

gonna add my gitlab stuff to it in a few mins

quiet-wolf-18467 · Answer

Would all the typescript packs live in the same repo or should they be separate

glamorous-printer-66548 · Answer

i would keep them in the same repo for now

glamorous-printer-66548 · Answer

planning to start out with a similar structure as the helm chart repo

glamorous-printer-66548 · Answer

to have `stable` and `incubator` as top level dirs

glamorous-printer-66548 · Answer

we can turn this into seperate repos after some time when there s enough content but for now it s easier to keep this as a monorepo for automation etc

glamorous-printer-66548 · Answer

we probably want auto publishing via CI etc

quiet-wolf-18467 · Answer

Helm have been trying to use separate repos for almost a year and have no idea how to do it

quiet-wolf-18467 · Answer

Because it s too late smiley

glamorous-printer-66548 · Answer

lol

glamorous-printer-66548 · Answer

ok

glamorous-printer-66548 · Answer

hmm

glamorous-printer-66548 · Answer

but technically helm is a slightly different story

quiet-wolf-18467 · Answer

One repo is fine as we have no code We can change in a few weeks once we understand the scenario more

glamorous-printer-66548 · Answer

the problem they re facing with helm is I believe that there is a single central registry built in and the only way to publish to that registry is via the single helm charts repository

glamorous-printer-66548 · Answer

with npm instead anybody can publish to the standard npm registry

glamorous-printer-66548 · Answer

without having to go through our pulumi packs repo slightly smiling face

quiet-wolf-18467 · Answer

Though if there s a GitLab Runner pack and we segregate by language we can t share config templates across languages

glamorous-printer-66548 · Answer

hmm

quiet-wolf-18467 · Answer

But if the GitLab Runner pack is a repo and there s a directory for each language we can share templates

glamorous-printer-66548 · Answer

true

glamorous-printer-66548 · Answer

but what do you mean as sharing here

glamorous-printer-66548 · Answer

i e what parts of the package are shareable between languages

quiet-wolf-18467 · Answer

File based configuration

glamorous-printer-66548 · Answer

hmm

quiet-wolf-18467 · Answer

`gitlab rb` or `runner toml` or if it s MySQL then `my cnf`

glamorous-printer-66548 · Answer

I m not even sure if I want to configure those things via files

glamorous-printer-66548 · Answer

Honestly I personally try to do just everything in typescript

quiet-wolf-18467 · Answer

That won t work for Go and Python

glamorous-printer-66548 · Answer

even config is in typescript files for me lol

glamorous-printer-66548 · Answer

We have files like `prod ts` `dev ts` and `config ts` etc

glamorous-printer-66548 · Answer

well you can configure your app via an object a literal in a ` py file or ` go` file I assume

glamorous-printer-66548 · Answer

anyways

glamorous-printer-66548 · Answer

let s discuss is another time

glamorous-printer-66548 · Answer

it s friday stuck out tongue

quiet-wolf-18467 · Answer

It s 2am Saturday rolling on the floor laughing

glamorous-printer-66548 · Answer

I ll try to spend the next 30 mins on getting my current code up on github and then I gotta find a beer somewhere lol

quiet-wolf-18467 · Answer

Enjoy

quiet-wolf-18467 · Answer

Speak later

glamorous-printer-66548 · Answer

where are you based

quiet-wolf-18467 · Answer

Scotland

glamorous-printer-66548 · Answer

whiskey then

glamorous-printer-66548 · Answer

stuck out tongue

creamy-potato-29402 · Answer

< glamorous printer 66548> < quiet wolf 18467> sorry just catching up you re making a GH org for pulumi apps

glamorous-printer-66548 · Answer

yep

creamy-potato-29402 · Answer

I have asked for this internally for my entire tenure here

quiet-wolf-18467 · Answer

For reusable Pulumi libraries

quiet-wolf-18467 · Answer

Which we aren t calling charts smile

creamy-potato-29402 · Answer

honestly I m kinda done with nautical analogies

glamorous-printer-66548 · Answer

< quiet wolf 18467> fyi I also have some fairly reusable libs for fyi slightly smiling face

creamy-potato-29402 · Answer

cc < white balloon 205> < big piano 35669>

creamy-potato-29402 · Answer

we really should probably have a place for this kind of thing at least IMO

quiet-wolf-18467 · Answer

ExternalDNS and cert manager rely on CRDs though

quiet-wolf-18467 · Answer

You deploy them with Pulumi and kubectl your own manifests

glamorous-printer-66548 · Answer

external dns does not rely on CRDs it relies on annotations

glamorous-printer-66548 · Answer

and cert manager can partially be used also via annotations

creamy-potato-29402 · Answer

Pulumi can handle CRDs right

glamorous-printer-66548 · Answer

my packages are also not to consume them they are meant to set them up as cluster wide services addons which then can be used by any app running on the cluster How the app does that is their own choice if they use kubectl annotations or CRD objects deployed via kubectl or pulumi doesn t matter

glamorous-printer-66548 · Answer

and yes as hausdorff is right pulumi supports CRDs

quiet-wolf-18467 · Answer

ExternalDNS uses CRDs on master Stop running releases rolling on the floor laughing

creamy-potato-29402 · Answer

we have some work to make them type safe though

quiet-wolf-18467 · Answer

CRD maintainers have some work todo also They don t all provide an OpenAPI spec

creamy-potato-29402 · Answer

that s right

creamy-potato-29402 · Answer

how can we build nice tools if they aren t publishing schemas or OpenAPI specs

glamorous-printer-66548 · Answer

< quiet wolf 18467> there you go

glamorous-printer-66548 · Answer

I think <https github com pulumi packs pulumi packs typescript blob master incubator gitlab runner on gke src gitlab kubernetes runner ts> could be turned into a seperate pack which is just responsible for deploying gitlab runner on kubernetes so it s GKE independent The other things are more gke specific in there