> Is it possible to use Pulumi to provision and manage infrastructure locally on a VM running inside Oracle VirtualBox?
Do you mean "deploy software" locally on the VM? Infrastructure doesn't get deployed to a VM: VMs are the infrastructure that get deployed. Along with things like load balancers, firewalls, storage devices, etc.
Pulumi isn't intended for deploying software onto VMs, though it can do that since Pulumi programs are also general programs. If you're looking for tools to manage software deployed to computers, try Ansible, Puppet, Chef and SaltStack.