I had a first hand look this week at someone using it... shall we say under less than ideal circumstances.It’s a good tool
My work had a 'Christmas quiz' where the questions were sourced from ChatGPT. More than one of the questions managed to have the answer in the question, and one of the questions about a fictional snowman managed to confuse which particular snowman it was 'thinking' of.
I've also had to wrangle with other developers writing code using Copilot and Gemini where what they've got out of it is for much older versions of Laravel than we were using (e.g. Laravel 5.5 versions of code, on a Laravel 10 codebase) which was... frustrating.
I haven't actually seen that many cases of it being a good tool, at least on its own, but as part of a larger workflow I could possibly see that... one day.