I once had normal ChatGPT telling me to install some "custom resources" for Chef InSpec from a GitHub repository and documentation website that didn't exist. I prompted it, it figured out key bits of information I said to it, and used the models it has to produce something intelligible based on what it knows about other resources following that pattern.

It's a great tool in that it can fill gaps in reference documentation and examples, but there is no interpreter involved in running/analyzing/testing the solutions.