Maybe a stupid question, but is there a way to install stuff on a regular vm like with ansible etc? So apt get installs etc etc

Not natively. But you can create a dynamic resource that acts as a provisioner ala: https://www.pulumi.com/blog/dynamic-providers/#dynamic-providers-as-provisioners

Different platforms have different solutions for this. I use SSM on AWS, in preference to userdata.