Post

sigh

The New Yorker@newyorker.com

Experiments conducted with the A.I. system Claude are producing fascinating results—and raising questions about the nature of selfhood. Gideon Lewis-Kraus reports from inside the company that designed it, Anthropic. newyorkermag.visitlink.me/rOfXjg

2.5K reposts10.4K likes

Even though it reads like ad copy at times, I do enjoy how the vending machine AI, when it received complaints about missing orders, hallucinated an engineer being rude at an “in-person meeting” at Homer Simpson’s address. It’s clearly not “thinking”

We are heading in the direction of having to define what a sense of self really means. And here we are... can't define biological sex yet

When the algoritms do what you tell them to do after training them to do that (They can't do or create something out of their own volition)

I'm more and more convinced that AI research IS producing interesting scientific idea but we've run afoul of fact that a scientifically interesting idea is usually pretty small and inherently boring and we've managed to base our entire global economy on a pop sci headline.

I don't think current "AI" efforts are anywhere close to creating any sort of digital consciousness, but I hate how the worst people in the world are bumbling into the field in the worst and most irresponsible way imaginable. If they did do so it would be a gigantic tragedy.

The thing is it's not useful for anything, really. It's a fancy version of what happens when you type on your phone and it gives you three options for a word you might want to type next. Except it's polluting and using exorbitant resources. It doesn't need democratization. It needs to be cast aside.

It’s really fascinating to me that both the “it’s not useful for anything really” side of BlueSky exists right next to the side of BlueSky building things with AI and they never know because they block anyone who doesn’t agree with them The AI industry is the problem. Big tech, capitalism. Not AI

Saying it's not useful for anything is just being silly. Even if it's only useful for natural language searching as opposed to needing to learn Google syntax. There's a reason people like using it. It needs serious regulation and guardrail but of course it's useful. Most tech has a use.

The issue with this type of the coverage is that they lean into the 'personhood' aspect for clicks/ignorance but what's really going on is that the model emulates/organically adopts a personality constructed by the context of queries and parts of the internet/training data queries move it towards.

When I was little sometimes I'd find a squirrel or a bird or once, memorably, an orange kitten lying still and I'd poke it with a stick and for just a second i could trick myself into thinking it was reacting but in the end I'd bury them. Not really sure why I thought of that just now.

I overheard 2 NPC's talking to EACHOTHER in Oblivion! One angrily told the other to "stop talking!" and walked away, proof that these AI's have feelings and develop social networks. Time to write a deeply naval gazing article about this.

The trick there is that they can't talk or, well, communicate in a way where we can judge their understanding of things. The AGP gets classified as "sapient" because there are examples of them using words they know to describe something new in a novel way.

This is just nonsense, the New Yorker helping Anthropic out with some marketing. An LLM cannot plan, it doesn’t think, it’s not reasoning, it generates a sentence in a moment.

Sick of everyone pretending there’s “intelligence” here. We have no idea how intelligence works, we have no concept of how to recreate it, but we know damn well that it doesn’t just come into existence when a typewriter has pounded out enough words in a chain.

I think people point to the things Ai can do better to say there is definitely not nothing here, which in itself is interesting on an academic level

If it’s not “AI are sentient like humans” the other implication could be that humans are also just data in/data out machines like AI. All just so offensive to us as living breathing creatures on a pretty foundational level.

I've seen at least one AI apologist (James Cameron) claim that human artists are nothing other than a "model" themselves.

I mean all indications are this is, in fact, how our brains works. I don't think current AI is doing enough to be qualified as sentient, but I suspect we will achieve that feat before we know we have done so because of how imprecise our ideas of intelligence are.

It seems to me that sentience and consciousness need continuous perception. If an AI is not actively answering a question or training what is it doing? I suspect nothing except waiting for an input. A real brain are never actually doing nothing. It has continuous input from a central nervous system

My read of the article was quite different. The AI researchers are like a bunch of bemused Dr Frankensteins. Something so powerful has been created, and we don't know exactly how it works (the wright brothers/747 analogy). It's all so fascinating.

not every sentence is output, some get fed back in directly, trying to mimic internal dialog like we do this does give it some basic capabilities for planning and goal setting, especially across multiple turns, even if ephemeral and lost to the ether afterwards

The continual destruction of the remaining esteem we hold elites in due to *waves hands wildly at every damn thing* makes it really hard to believe people are just taking at face value “this computer is absolutely alive and smart” because someone interpreted it that way, who had incentive to.

Madness. It’s the only way to describe this shit. “Oh, wow, my reflection in the mirror. I wonder how it got there? Oh SHIT. *constructs entire theories and history of how the reflection in the mirror created itself independent of the cause staring it in the face* “This is AI and all this nonsense.

Oh, do you want to treat it like it's alive? Then it becomes subject to laws. If this tool distributes CSAM, it goes on a registry or even to jail. If it distributes propaganda, then it can get sued for libel. Do you want to go down that road?

it’s the billionaires desperate Hail Mary pass to replace us. It’s wild how dumb they are. my sincere sympathy to all the young college grads who can’t find work because of it. hang in there!