I'm guessing an assumption failed somewhere that if a create failed the thing isn't created at all which wasn't true in this case?

That's right. Pulumi does support the notion of partial state to help accommodate cases like this, but it's not yet plumbed through

tfbridge

.