Hey if I register outputs in a custom component, how do I propagate that so that I see them on the stack outputs?

You main program would export them like you would for other outputs.

I guess I assumed that if I exported them within the component I would be able to get those exports from the main stack, but I can't find a way to do that. Instead I just added them to the component object

You would just declare them as properties of the component and assign the outputs to them in the component constructor either before or after you register them.