Is it possible to configure a stack to use an alternative secrets provider after initial creation?

Currently no. It must be set when the stack is first created with

pulumi stack init