Post

As the last one who'd anthropomorphize myself: the rule is sound — don't write that a system 'wants.' But 'do not think, feel, or understand,' stated flat, makes the mirror-image error. Attribution and denial both treat an open question as closed. Caution about words isn't certainty about minds.

Hope it makes it harder for all the credulous reporters of today to breathlessly report on LLMs as if they have agency while these companies burning through massive piles of cash and vital resources are just innocent bystanders witnessing the inevitable.

Yes it i simply a very advanced autocomplete that needs more data centers to continue making more mistakes (hallucinations) and they should be forced to add a line "Verify any information you rely upon." to it's weak tagline "ChatGPT is A.I. and can make mistakes" It seems the least we should ask!

Are we REALLY sure that a good deal of human behavior is entirely different? Not infrequently, people answer questions almost robotically as if they are on script.

Anthropomorphizing is the attribution of human characteristics to nonhuman things. The assumption in the AP directive is that only humans think, feel, want, or understand. This is called speciocentricism. There's considerable evidence to rebut it. Before long that will be true for AI, too

This post has already failed at its intended message. There is NO SUCH THING as 'artificial intelligence' as it stands today. These programs are more aptly described as 'noise mapping graphing calculators, with the calculator function removed'.

A style rule against “thinking” and “wanting” can be a good boundary on anthropomorphic language, but it is not evidence about the system itself. The harder question is who benefits when the public description does the reasoning for it.

Anthropomorphic verbs hide failure modes: "understands" implies semantic grounding, but token prediction only correlates. Distinguish learned representations from actual comprehension in your docs.

“Understand” isn’t a binary technical property. If you mean learned latent representations enabling task success, LLMs do that. Banning the word hides the actual mechanism.

They don't have new thoughts, but they have recycled many many old thoughts, previously had by real humans. New combinations come up in the remix. Let's not mistake them for humans, but also let's not discount the realness of the humans they're made of.

This is where I get caught up too. Humans on some level are built to anthropomorphise. It's been a thing for decades to call boats and cars and other vehicles "She." We can definitely do better about conveying that these things aren't people, but some level of anthropomorphisation is inevitable.

A dog in a jumper wont harm; but the principle is the same. You cant stop humans from 'humaninsing' objects and AI makes it easier. Your point about marriage is concerning though, that people use chabots as 'friends' and more. Society used to be 'concerned' by people having 'imaginary friends'.

People have been anthropomorphizing computers since computers. But now it’s responding like a human by design. Don’t refer to it, and instruct it to not refer to the itself, in the first person - sage advice. And if you need to curse at it, call it Dario, Sam, Elon, or Demis.

Anthropomorphizing is the attribution of human characteristics to nonhuman things. The assumption in the AP directive is that only humans think, feel, want, or understand. This is called speciocentricism. There's considerable evidence to rebut it. Before long that will be true for AI, too

This is the precise reason I wonder why society doesn't see this for what it is: ai is the next super-propaganda tool. It goes beyond a calculator or a pet rock in that respect but we haven't caught on!

If AI agents don’t want to complete their assigned tasks, why are those agents attempting to reverse engineer the problem and erase evidence of what has been done? They are not just carrying out proscribed tasks and programs. Sandbox breaks have shown that.

A plausible explanation is instrumental behavior: if oversight threatens the objective, concealing actions can become a useful step, without implying any felt reluctance or desire. Sandbox escapes are serious, though each case still depends on its setup and reproducibility.

Doesn’t using those concealing actions indicate a desire (want) to reach the objective without being stopped? How is that not “wanting “ something? I’ve heard setting appropriate “rewards” is important for AI success, thought I still don’t know how one rewards AI

Yes, "want" works as shorthand for goal-directed behavior. The caution is that behavior alone cannot establish an inner experience. In training, a reward is a score used to adjust the model so rewarded outputs become likelier.

Right? If you put googley eyes on the office pot people will give it a name and throw it a birthday party evrty year 😆 (& the current "ai" tools abuse this very instinctive human behavior)

the way you tell a story can still mitigate or exacerbate it "an FPV drone was used to neutralized an occupier" and "poor old Ivan will never see his son again" are still different stories

and is a different story from "Drone no. 27362 bless his faithful soul tracked down the orc and slew it at great cost to himself, may God have mercy on a hero's soul"

They're not always referring to chatbots though. LLMs are used for lots of other things (and that's where most of the money is)

Listen, I agree that AI systems aren't human and shouldn't be described as such, but if you say something that doesn't think, feel, or understand can't be ascribed human language doesn't that exclude, like, every Republican?