The code for the Azure Native provider is actually auto-generated from Azure's published ARM API spec! If they haven't published an updated spec for this feature, then there's no way for Pulumi to make use of it. That said, if there
is a published version of the API, even a preview one, then you can address it directly. (The default ARM API spec that Azure Native targets is not going to be bleeding edge, which is why you may not see the ability to target this feature in your code).
In C#, which I am most familiar with, you'd do it like so:
// The default provider version doesn't have the feature I want
using Pulumi.AzureNative.Database;
// This explicit version has the one I want!
using Pulumi.AzureNative.Database.V20230731Preview;
(This is an imaginary example; you'll need to check the available versions of your provider to see if it's there. If not, try updating your Azure Native dependency!)