I think I figured it out. It appeared at the same time YAML was introduced and it seems the current templating engine doesn't deal with resources in

Pulumi.yaml

correctly so Pulumi just appends that append file onto the resulting one. What confused me was that there were resources defined in both files and there's no documentation about it whatsoever.