Post

A study of eight AI search engines found they provided incorrect citations of news articles in 60%+ of queries; Grok 3 answered 94% of the queries incorrectly (Columbia Journalism Review) Main Link | Techmeme Permalink

272 reposts665 likes

On local news stories I have actually known something about they are invariably wrong. Maybe reporters make more efforts to be factual with big stories but inaccurate news is not unique to AI.

Not unique sure, but incorrect citations muddy the waters even further It makes the information look more reliable than it is. Instead of making search easier it makes it harder as you have to click on the citations and see if they actually say what the LLM summary claims

It's the future. Get on that train or you will be left sitting in the station. Realize how useful AI is right now with all its faults and imperfections. Imagine as it gets better and better every year. In 10 years it will be in EVERYTHING.

Except the car gets worse and worse as technology changes and your car ages. I don't see how that relates well to what I posted. AI as a product is always innovating, and quickly. Imagine selling people on the IDEA of cars the same way, now that makes sense. Such a small post limit. Ridiculous.

Does it have use cases? Yes. But those cases are a very small subset of what it is being used for. It will **never** be able to do half the things they're trying to force it into right now. The sooner we stop trying to make this specialized tool do everything, the better.

I’ve recently used the paid version of ChatGPT and was shocked at the simple errors. I’d ask it to correct them & then it would do so but make other errors & forget previous corrections. It was actually worse than useless which really surprised me.

it can be, but only if people are willing to improve it. discovery and progress cannot be erased - but it can be stalled and obselesced if we can't collectively validate its utility. i do foresee a future collabing w ML, but only if the intent of its purveyors align with us and the planet itself

The original article is devastating. In particular: "Premium chatbots provided more confidently incorrect answers than their free counterparts." "More than half of responses from Gemini and Grok 3 cited fabricated or broken URLs that led to error pages."

I have caught incorrect information produced by Gemeni, and I likely would have only caught it because I already knew what I was asking it. They tend to correct if you point it out, but it's gonna be rough for people looking for information but aren't treading lightly.

Tough week for comrade Musk. His rocket blew up, Tesla's stock is falling faster than planes out of the sky under Secretary Duffy, and now to hear that Grok is dumb, just like him and the Toddler in Chief. He needs to jump around some more to get his energy back.

when i was trying to look up drug interactions a while back it mixed advice from the american veterinary medical association in with all the texts for humans there was a very fine print warning under it that it wasn't to be used for medical information 🫠 BAD technology, it's gonna kill someone

I've read a lot about AI making up sources but never experienced it first hand until I tried using ChatGPT to suggest some references for a blog post I was writing. I wrote up a very non-scientific report on what happened. It was ridiculous how ChatGPT "found" exactly what I was looking for.

nicholasorsillo.comMy Experience with AI Hallucinations: ChatGPT's Perfectly Titled Sources :: Orsillo Language ServicesPost about Communism, Socialism, history, leading to AI hallucinations and ChatGPT fabricated sources.

Good piece, and pretty much what I would've expected. Your instincts about the shape of its reader bias feel right, too. But I think you've formatted one of your paragraphs as if it was written by ChatGPT? Close to the end.

Thanks! I intentionally avoiding using ChatGPT to write, edit, or otherwise critique that post. So it could be a coincidence. Or as a new blogger, I might have been influenced by reading other pieces that were unbeknownst to me generated by ChatGPT. That's a wild thought!

No, I just mean that one of your own paragraphs is showing as if it's quoted (ie, in line with the LLM's paragraphs): it still sounds like you But yes, we do all start sounding like whoever or whatever we're reading!