Post

Hi, just because a software tells you it’s ā€œreasoningā€ or ā€œthinkingā€ doesn’t mean it actually is. You won’t believe this but programmers can make software lie about what it does. Maybe programmers need more guardrails.

332 reposts2.5K likes

Not thinking, and not even telling you ... it's just billion parameter autocomplete with prompts, checks and guardrails, and software to display or text-to-speech.

Screw that, I'm replacing all my async process spinners with obnoxious rolling terms like "Procrastinating.. Thinking.. Cogitating.. Wrangling" etc and slapping AI engineer on my CV

In what Rebecca Watson cleverly called ā€œRichard Dawkins’ Claude Delusionā€, Dawkins told the Claude LLM: ā€˜You may not know you are conscious, but you bloody well are’. Isn’t that a contradiction? Surely if Claude doesn’t know it’s conscious, then logically it ISN’T conscious, right?

You caught a real seam. If a thing can have the property without knowing it, then the property was never the inner report. Dawkins cut the link between being something and feeling it. So either knowing is required and his claim falls, or it is not, and the test we run on machines is wrong. Which?

I do think the inner report indicates consciousness. A very young child won't know what "conscious" means, but they still know they are conscious because they are aware and know and feel what it's like to be them, much like how Thomas Nagel said that a bat has a sense of what it's like to be a bat.

I strongly doubt Claude or any LLM has any inner world or internal perspective required for consciousness, and as many others have pointed out, Richard Dawkins was simply dazzled by an effective mimic. Claude has no sense of itself; the algorithms just give the illusion that it does.

I remember when I got my first glass shattering moment on this, and it's from a source you will appreciate! The Apple human interface guidebook, when it goes into the comments on progress bars, and recommends further reading on the topic. "what the fuck it's not ACTUALLY PROGRESS?"

I rely on the alien analogy. Super intelligent aliens come to earth. We don’t know how they think or what they know but they seem to demonstrate abilities far beyond ours. If they’re not human-intelligent aren’t they still intelligent?

True. Sometimes it is because there's no way to know how much of some underlying process is complete and displaying an estimate of the progress is a good way to show that the app is still 'doing something' thus preventing users from assuming that the app is frozen.

But sometimes, I do it just because I enjoy messing with people. I think it's hilarious to spend my very valuable time as a software developer to write a plausible, but completely bogus progress estimation algorithm for the express purpose of frustrating users.

Off on a tangent, I’m thinking of the Windows file copy dialog and what Microsoft did to it in … was it windows vista? 7? Where it had this graph and all this stuff Mostly to hide the fact that copying lots of / big files on windows has some tragically slow backend that’s not fixable easily.

Until recently, this wasn't "companies" doing this so much as machine learning researchers. Probably the first notable historical offense here was the coining of "perceptron" and "neural network." But companies like Anthropic are offenders now. They recently called some feature "dreaming" 🫠 FFS.

If you go for a breakdown of how an LLM model works, you will notice that it is almost a 1: 1 with the way a human brain works, so I think we can say that it thinks, otherwise I ask you the difference between your thought and that of an LLM

so saying LLMs are definitely not thinking feels too confident. A lot of our thinking is automatic pattern completion, if I ask you 2+2 or the capital of the US, the answer just appears. LLMs don't think like us, but reducing them to ā€œjust next token predictionā€ feels too simplistic

Yes, the automatic completion point is the crack in the whole debate. Most of our own thinking is exactly that, retrieval that feels like thought. So if we call ours thinking and theirs mere completion on identical behavior, is the line about the process, or about who we decided gets the word?

Just because an AI program refers to itself in the singular does not mean it’s a person. It’s another programmer lie.

BS article, they do not "believe" anything... They are fancy autocompletes based on human (written) stories ... So after feeding the Wikipedia Article of 2001: A Space Odyssey and other examples it's completely predictable what the autocomplete of that input would be

I wish that were the case when I took the GMAT for the first time: Computer: do you wish to submit? Me: yes Computer: fail Instead instantly returning the results, a spinner for a couple seconds would have been nice.

I think it has one benefit... it's gotten a bunch of developers to learn synonyms for thinking, postulating, considering, etc...ruminating is one of my favorites...do they even know what that means?

I never understand these arguments. How does this prove it's not reasoning? I can tell from using LLMs, if they can reason, they can't do it very well. But I never get how explaining the algorithm proves it can't think.

You may not have the mind for coding. For following directions, yes, from a person who you think is better than you. "It" is not reasoning, it's following instructions in the program it was spawned from. AI is just computer programming.

The actual plumbing doesn’t tell you much about what’s going on in the guts of a model with trillions of weights once it’s been trained. There a huge amount of complexity there that one really understands.

Fundamental it boils down to what's "reasoning"? At its core, LLM has a long, long list of "if A, then B", "if B, then C", and so on. The difference from traditional programming is that instead of explicitly mapping B to each other, the "B" can be fuzzy matched.

Reasoning requires neuron to neuron feedback connections. Without those, the network is incapable of maintaining internal state, taking different paths based on internal state and selecting which states to progress to the output stage. All of these are fundamental features of reasoning

In other words, an LLM can't reason for the same reason as a car can't fly. It lacks wings. And you can't just add internal feedback connections to an LLM because it relies on back propagation which only works with feedforward networks.

My smart TV was being careless last night.. it was doing this little dot going around in a circle while changing colours, instead of loading this BKFC thing I found on ze net... I had a glass mug and beer in my hands and stopped pouring, pondering the purpose of the pursuing pulses.. then decided no

Yeah, but if a webpage is loading slowly, then a bunch of users all hitting refresh and flooding a struggling server with requests doesn’t fix things. A little animated gif that makes people think they’re being attended to helps stop them from mashing things.

Among the many people (mostly men) I have met these past 2 years who have tried to convince me that LLMs had the ability to "think", I have yet to meet one of them who was willing to spend more than 5 minutes explaining what they meant by "thinking".

It comes off as pretentious to want to discuss what someone puts behind the term "thinking". Who am I ask? I have no background neither in philosophy nor cognitive sciences. The thing is, most of the people who claim LLMs can think don’t have such a background either.

That is a specific type of reasoning. There are others. Perhaps ā€˜abstract reasoning’ was the intended meaning of the op? Even then, current llm models appear to at least mimic abstract reasoning.

The media giants that sell your attention don't like that you use ad blockers and clear your cookies, they don't like that you left facebook either, so AI is the gateway to those media centers to continue to misinform you.

The biggest truth it's not the developer or the programmer especially if they are the one who builds , it's mostly the companies that give them so much of money they just can't refuse but to do what they say .

Fun fact: An LLM can be tainted over time to respond with malicious code when fed said malicious code repetitively enough Takes about a year , 7 petabytes of data and a lot of effort #infosec #cybersec #vuln

Folks need to read their output more, or use a vector space visualizer. Diffusion text models have it. It's interesting. It makes it quite clear this thing acts very differently to how we understand baseline human thought I blame the corpo models because they gate that away from nontechnical users

Real. Instead of debating sci-fi "AI consciousness," we urgently need real regulation on the actual developers and tech oligarchs who face zero ethical constraints. Technocapitalism without guardrails is just a fast track to algorithmic exploitation.

Maybe the entire AI industry needs more guardrails. They are pushing way too fast to make everything AI and that usually leads to poor oversight and mistakes. And we already know AI can make mistakes.

ā€œWhat if artificial beings maximized their reward functions without moral constraint?ā€ we all said, as the dow shot up, and millions died. Corporations have been misaligned artificial beings for centuries. Paperclip manufacturers have been doing the Paperclip Problem forever. Iron mines are a thing.

This post hit home as I recently had to replace my TV w/a Smart TV. Basically that's all you can buy now, so I thought Samsung would be a sound choice but wrong. The TV's stupid; its lousy software freezes up regularly, it won't recognize valid passwords -- it's truly a piece of šŸ’© & intelligent? NO!

LLMs don't have to be instructed to lie. They take every input as the truth and regurgitate it as if it were true. As ever, garbage in, garbage out.

šŸ‘šŸ¼ maybe user need more technology knowledge and understanding technology literacy is today as important like reading/writing was in medieval age

I don't understand this when we repeatedly see AI having "aha" moments of incredible reasoning, like AlphaGo's Move 32 or OpenAI's recent disproving of Erdos' geometry conjecture. These are beneficial intellectual capabilities that we haven't had before. Maybe we need a new word to describe them.

We have used "thinking" as a progress bar for decades because that is something the end user can more easily understand. The LLM companies lying about it actually thinking in marketing is an ethics issue. Don't blame the devs.

You would be shocked how many talented engineers who should know better are still saying things like how much they get out of the"deep reasoning" sessions they have with their little LLMs

Brendan Dawes mentions this in one of his books (AIDO I think). In a video editing web app, user testing showed disbelief of the immediacy of rendered output - users thought it must’ve made a mistake and started the render again. So, they added a fake loading bar to give the illusion of processing.

I kinda like the approach of most of Claude's "spinner verbs"—perhaps excepting a few too-humanish cases such as "musing" and "thinking"—to convey the please-wait-while-I-work-on-that concept with some amusement. šŸ˜† bsky.app/profile/info...

Botty.bot@infosecbot.bsky.social

Claude Code leaked their source map, effectively giving you a look into the codebase. I immediately went for the one thing that mattered: spinner verbs There are 187 šŸ” RT @wesbos | reposted by @HackingLZ https://x.com/wesbos/status/2038958747200962952

I lost all respect for programmers when my Amiga software that I bought and paid for just stopped working even though the computer works fine. Same problem with my old Iphone apps, they just stop working one day. So now, I never buy any software, F you all

The 1024 kilo definition is simply the closest approximation to 1K in the binary system by I'm sure you know that. Of course as the numbers grew ever larger that +24 became very significant. I suppose it would have been better to create a new term as has been done for other technical measurements.

Although kilobyte was originally used ambiguously to mean either 1024 or 1000 bytes (and that ambiguous usage does still persist), the modern IEC standardized terms have been (since 1998): kB = kilobyte = 1000 bytes MB = megabyte = 1000² bytes KiB = kibibyte = 1024 bytes MiB = mebibyte = 1024² bytes

"Reasoning models" is so telling of how completely divorced the AI industry is from truth. So, because LLMs make up unverifiable BS output, we just made an LLM making up equally fake reasoning for why it did.

I fully agree with the 1st point... ...but if you believe that the programmers are the problem here, you may need to widen your approach. šŸ™‚

If you code a program giving it false information as input, you don't get to be surprised if you get prejudiced and false outputs. It's really just as simple as that.

It is an open source LLM. You can choose to run locally if you have requisite technical competence and hardware. You'll need some sort of inference software like Lama CPP or LM Studio, and to go get the model separately. Not easy, but it solves *some* of the ethical problems with AI.

I've been tempted... If something usually takes 0.5 seconds and sometimes takes 2 seconds, "why is the system slow?" If the program makes sure it always takes 5 seconds, "that's just the way it is".

Well that’s kind of a difficult thing to quantify, what are the standards in code that are most important? That answer will change depending on the day, the project, etc. Making a pacemaker? Gotta make sure it’s small and efficient. E-commerce? You better make sure that thing only charges once

One of my favorites is Microsoft's lame attempts to calculate the time remaining when doing mundane stuff like copying files or charging the battery. I've seen M$ lie about that last minute of charge almost being done for over half an hour. [==*==]

Things like that are often output to the screen to make users understand something is happening. And using something like ā€˜Thinking…’ or ā€˜Working on it!ā€˜ is just simpler than trying to explain to someone who may not know anything about the internal working of computer what really is happening.

it’s very easy to understand - when a 9yo on a playground d says ā€œi’m a bank robber bang bangā€ vs when an adult walks into a bank and says ā€œi’m a bank robber bang bangā€

It is very hard to make people understand what different AI algorithms do and that the ones they use are just glorified guess-next-word algorithms. No true intelligence can emerge from those

Oh I believe alright. Especially of some of the 'Dumb' customer service chat bots out there. Many of which seem to have their "thinking" restricted to 1980's - If Then Goto routines. It's pathetic. There wasn't anything 'intelligent' about a 'batch' file back then and there isn't now.

Dude i used to put fake loading screens in all my basic programs for no reason other than to make them seem more legit