Post

In spot tests I've done, I see this happen *all of the time*, such as with my own papers. The LLM would often rather hallucinate a male scientist than get my name right. 🤷‍♀️ It's kind of unsurprising that models trained unscrupulously on the entire internet are misogynistic

Mel Andrews@bayesianboy.bsky.social

When utilized in literature review, LLMs consistently 1. fail to mention female authors in female-led literatures, 2. insist that men are more influential or more heavily cited when this is contradicted by objective citation counts, and 3. attribute women’s work to hallucinated male scholars.

205 reposts583 likes

receipts ⤵️

Emily Hunt@emily.space

thought I'd give it another chance. now i'm an andrew lol (and I have never written a paper about Kepler before so it's wildly wrong)

The most insufferable people I've encountered regarding LLMs act like the bigotry is just objective reality. AI companies know that they can't get rid of this behavior. They can only partly mitigate it. And it's not always going to be easy to tell when it has affected the output.