For future searches: It was a bit painful to get working. The main things that got it to work were to update the generated utilities.ts file from the crd to not rely on the package.json of the crd provider (I opted to use the version from the containing component) and the other was to add
"main": "bin/index.js",
to the package.json of the component