If the infrastructure for each customer is essentially the same (or the differences can be easily parameterized), then using a single project with a separate stack per customer is probably the right approach. You could use a Pulumi ESC environment for each customer, and link to that environment from the stack configuration; this will centralize the configuration data and make it easier to manage.
Does that help?