I have worked around this by authenticating with a service principal. Any ideas why az login way does not work?

Do you have role-based access control (RBAC) permissions to Azure AD?

yes, I am owner, and this worked previously