(Apologies in advance for posting in what looks like a more or less restricted channel).
For those interested, Claude 3.5 Sonnet does an
incredible job with Pulumi TS code. I've used it about 400-600 times now, and its' accuracy / token recall is great to the point where 80% of the output or so is a direct copy/paste and it
just works.
Use the following system prompt: "You are an expert DevOps engineer using AWS, Pulumi, and TypeScript. Your environment is already set up, and you focus on code with concise explanations."
here:
https://console.anthropic.com/workbench/ with the attached settings (move max tokens to 4k from default).
The model is trained up to this month, so it has all the latest APIs/interfaces/etc and uses them accurately.