This message was deleted.

Blackbox testing your infrastructure? Like testing that queries can be made between two machines, without knowing about NACLs and security groups? That's not really in Pulumi's domain..

Runtime API will eventually provide a way to programmatically drive pulumi programs. Feel free to drop some notes in the issue: https://github.com/pulumi/pulumi/issues/3901

Thanks guys. I'm looking for something exactly like this doc: https://www.pulumi.com/docs/guides/testing/integration/ but with some js || ts || python examples, as I'm not versed in Go.

Yes, we don't currently have language specific integration testing frameworks. The runtime API will probably be the answer for this. Here's an example (in Go) of what the API for running pulumi over a remote repo in github might look like: https://github.com/pulumi/pulumi/blob/45ed471a7d55c10c91b3104b3be52cecc52300c8/sdk/go/x/auto/stack_test.go#L92-L166 We don't have any dates to share on when this might be available for ts/js. If you need something immediately, you can take a look at this example test harness and adapt for your purposes: https://github.com/pulumi/examples/tree/master/aws-ts-serverless-datawarehouse/testing/integration and it's usage: https://github.com/pulumi/examples/blob/master/aws-ts-serverless-datawarehouse/__tests__/serverless.integration.test.ts

Cool. Thanks a lot guys, really appreciate it.

Just wanted to follow up and mention that we merged the first PR for the Automation API Go SDK! https://github.com/pulumi/pulumi/pull/4977 It's in alpha and there will be (mostly additive) breaking changes in the coming weeks. There are complete godocs here that you can check out: https://godoc.org/github.com/pulumi/pulumi/sdk/go/x/auto In addition, there are still a bunch of holes that we'll be plugging over the next few weeks. Here's a list of known issues that we're tracking: https://github.com/pulumi/pulumi/issues?q=is%3Aissue+is%3Aopen+label%3Aarea%2Fautomation-api If you'd like to try it out, you'll need to build pulumi/pulumi as there are CLI changes. We'll cut a CLI release early next week that will make it easier to try all of this out. I'll be updating https://github.com/pulumi/pulumi/issues/3901 with instructions and a call for feedback early next week, but I thought I'd let ya'll know in the mean time in case you're eager to kick the tires. If the feedback on the design is positive, we'll follow up with all of the supported pulumi languages.