Hello, I happened to notice this repo today: https://github.com/pulumi/providertest. I would like to understand how it is intended to work. i.e. I see it generates a log of the grpc calls as well as a stack state file, but not quite sure how that works on the next run of the tests. For instance, does it just check that the sequence of grpc calls remains consistent?

Ah! that repo is a bit experimental with some things we're trying to improve our internal testing of providers. I'd consider it rather alpha, (vs the programtest library described here: [Integration Testing for Pulumi Programs | Pulumi Docs](https://www.pulumi.com/docs/using-pulumi/testing/integration/)), but if you're interested in following along, the current state of the art from our perspective is in [providertest/pulumitest at main · pulumi/providertest](https://github.com/pulumi/providertest/tree/main/pulumitest)

Cool, I’’ll give this one a go (programtest). Just looking to build confidence that a provider release isn’t going to cause an outage.

Unfortunately, I don't think there's any paved path for forcing the provider to rebuild as part of the test framework (worth filing an issue on that providertest repo though). With pulumitest, you can specify the path to the provider binary in the test: https://github.com/pulumi/providertest/tree/main/pulumitest#configuring-providers I'm not sure that any of the other variants support specifying a provider binary other than the one that's already on your path

I know this package is unannounced and isn’t really intended for general consumption yet so I appreciate you humoring my questions. This was my last attempt btw, seems something weird with the ResourceProviderServer that the pulumi-go-provider returns as the error here is

rpc error: code = Unimplemented desc = Check is not implemented

.

package provider_test

import (
	"testing"

	"<http://github.com/pulumi/providertest|github.com/pulumi/providertest>"
	pp "<http://github.com/pulumi/pulumi-go-provider|github.com/pulumi/pulumi-go-provider>"
	pulumirpc "<http://github.com/pulumi/pulumi/sdk/v3/proto/go|github.com/pulumi/pulumi/sdk/v3/proto/go>"
	"<http://github.com/pulumi/pulumi-foo/provider/pkg/provider|github.com/pulumi/pulumi-foo/provider/pkg/provider>"
)

func TestUpgradeLocalCommand(t *testing.T) {
	t.Run("simple", func(t *testing.T) {
		test(t)
	})
}

func test(t *testing.T) {
	t.Parallel()

	test := providertest.NewProviderTest("testdata/simple",
		providertest.WithProviderName("foo"),
		providertest.WithResourceProviderServer(startProvider()),
		providertest.WithDiffValidation(providertest.NoChanges()),
	)

	test.Run(t)
}

func startProvider() pulumirpc.ResourceProviderServer {
	fooProvider := provider.NewProvider()
	server, err := pp.RawServer("foo", "0.0.1", fooProvider)
	if err != nil {
		panic(err)
	}
	return server
}

Anyway, I will leave it alone for now.