I'm interested to know what you think the alternative would look like?
Everything (from LLMs to religion to society are developed through the same principles as biological evolution:
1. Small changes happen randomly.
2. Those traits advantageous to survival and propagation get passed on.
3. Those traits disadvantageous to survival and propagation die off.
4. This all depends solely on what's advantageous or disadvantageous in the current environment, in its niche, in the short term.
5. Beauty, truth, goodness, and effectiveness are not equal. Effectiveness always trumps.
I guess my point is, humans (and LLMs) aren't designed to have an objective view of themselves, reality, and the universe. I'd also wager, based on studies showing how much music preference is based on cultural context, aliens would think Led Zeplin is shit.
Your description of how AI 'learns' below the comic is spot on as is your insight into what passes for much our 'knowledge' among us, your brave social media readers.
I love this so much, and it strikes me that this is what a university should be about. Unfortunately we’ve given up because we think it’s too hard and decided that we should instead devote ourselves to teaching people that they should try to outsource being human to chatbots.