Does it delete the VM ok? Can it delete the NIC if you retry after the VM is gone?
I'd guess the engines probably deleting in the right order but might be it takes a while for the NIC to actually dissociate after the VM deleting, probably worth raising an issue at
https://github.com/pulumi/pulumi-azure about this.