Ah, no, I wasn't using it right. It should have been

sec_rule_api = openstack.networking.SecGroupRule(
  "name",
  __opts__=pulumi.ResourceOptions(provider=REGIONS[dc],
        delete_before_replace=True))