Post

This has been pretty obvious since the beginning. When you build a model, you freeze all of the implicit assumptions underlying the language in that model. For example, if you built a model of physics before Einstein, everything it generated would implicitly assume a Newtonian model of physics.

One big example of this is the biological, neurological, and psychological understanding of gender. The vast majority (probably 99.99%) of text that LLMs were trained on assume gender and biological sex are synonymous and binary. But science has found that they aren’t. So how would a model even get

updated? Heck, we don’t even have agreed upon language ourselves to address the distinctions (e.g. words like lesbian, gay, and bisexual all assume a binary … but binary what? Gender? Sex?) I believe that integrating AI into society will hold back our development. Hope I’m wrong.