What worries me is people using it for safety-critical things without appreciating the danger, for a test some of my friends who sail for a living asked various chatbots some questions like ‘how would you approach a berth under sail when the wind is against the tide?’ and every single one but Claude got it dangerously wrong, and Claude wasn’t 100% either it just refrained from suggesting a sail plan that would lead to you crashing into the pontoon.

Will give a shout out to Mistral which got the sailing element of the question very wrong but did sensibly suggest ‘turn your engine on and perform the manoeuvre under power’ which of course is what you should do if you can.