Looks like setting the ObjectOwnership to BucketOwnerEnforced will do the trick, but Pulumi doesn't seem to support that.