Post

I do firmly believe that refusing to outsource your basic cognitive functions to LLMs right now - as so many are stumbling over themselves to do right now, like hogs trotting to a pile of slop that’s been set up inside of a butcher’s delivery truck - will very much pay off in a few years.

1.4K reposts7.2K likes

As a neurodivergent American, I am VERY sympathetic to the people who see utility in AI for executive function support HOWEVER: 1. [all of the reasons current AI is sub-optimal] 2. In the future, AI will be increasingly expensive AND performance will be compromised to increase profitability 1/2

Introductory rates are artificially low to drive adoption rates. (e.g. streaming) UI is continually optimized to maximize corporate profit. (e.g. web search) *It is not a good idea to make yourself dependent on tools that will only get more expensive and worse.* 2/2

The main thing with Google is you didn't have to wait for the library to open and hope that the book(s) you needed weren't checked out. It was the availability of the information that was key.

Not necessarily. Because within search engines there is (or at least was) a method to follow regarding organization. And within subspaces (ex wikipedia) there are organization structures as well. The organization of library resources is a good skill to know. But it is by no means the sole method

Maybe, but the lack of critical awareness in the face of technological change is consistent; and Google replaced a system designed around a known model of information with a popularity contest, all 'good enough'.

As such a person who knows lots of others and collaborates with 'em… partial agree. You're right that you will end up the smart guy in idiocracy, but here's the thing: you must also be accepted as that. It will give rise to bad creepy cult leader people, and some will be secret slopmeisters.

In other words, marketing is a separate problem and IT is not nearly so resilient to LLM abuses so there will be a lot of money behind marketing people to pretend to be you. 'ChatGPT, tell me how to look like totally not a ChatGPT user' is a tactic. Hence the culty vibes of it all.

I think they create an app for walking, and people grow to depend on it. Only then do they realize they have given away control. And the department of defense is automated, so you don't have to get past guards to breach it. Then, the 'uncivilized' who still memorize lists, Get all the passwords.

I think about that a lot and compare it to my past life as a living, walking memory bank of birthdays/appointments/anniversaries/addresses/phone numbers, and now I can hardly remember my OWN phone number because my computer remembers it for me. God help me if I lose the computer. THIS IS BAD.

Just got confirmation on Friday that one of my clinicians is using ChatGPT for resolving medication questions. If I had my way they'd get a warning and then fired. Beyond holy hell pt safety, they're not being paid six figures to copy paste from an LLM, they're paid that for their knowledge/skills

Absolutely. The consequences are visibly apparent. I do not want to become like that when the agent in question is so limited and broken in important ways, while creating an illusion of competence. I'm a huge believer in transhumanism but this is not the way to accomplish it.

I’m no longer even comfortable using digital assistant voice control stuff that made life a little easier for my executive function. Thankfully the speakers I have (primarily for music) have a physical switch to disable the microphones.

Being educated and employed before the age of LLMs is such a boon. Having actual understanding of a domain shows you how much LLMs miss and gives you a better model of what tasks they can and can't be used for. But those that fall to the sirens song won't ever think they have an incentive to learn.

In this case the Luddites will be the only ones left who know what that means. bsky.app/profile/fain...

Faine Greenwood@faineg.com

I do firmly believe that refusing to outsource your basic cognitive functions to LLMs right now - as so many are stumbling over themselves to do right now, like hogs trotting to a pile of slop that’s been set up inside of a butcher’s delivery truck - will very much pay off in a few years.

I've seen and regularly use amazing implementations of this tech (e.g., assistants for writing code, language translation), and obviously dumb ones (generated legal filings / judicial opinions with fake citations). I think one of the lessons of this AI age is that you have to use sound judgement.

There have been rewards for some people just repeating what those more powerful than them. Critical analysis would make you persona non grata in some circles

And by this I don’t even mean “refusing to use LLMs for anything at all” - they do have some use cases - I mean “refusing to outsource huge swaths of your day to day brain functions to the lying machine.”

Slippery slope from using an LLM to sort/cat data to slopping yourself. As with everything else free on the internet YOU are the product and addiction to it is the point. Agree to disagree with you and OP. Stay away from this shit unless all it does is check your PowerShell for errors.

It’s gonna be worse those companies that are overindexing on LLM usage. It’s getting to the point where directors are asking for that as a standalone metric at business reviews & shit. HR managers & UX designers don’t need ChatGPT to summarize their emails. At best, they’re downskilling people.

Partners company have a hiring freeze while they look into how they can utilise LLMs. Hoping it comes back to bite them, has pissed off many who have been denied leave & transition to retirement. Real possibility some will just quit which is a problem as takes 6 months+ to train replacement.

It's insidious how companies just expect employees to use LLMs for everything now. I worry that if I ever have to look for a new job, I won't be able to get one because my answer to "How have you used AI in your work?" would be "I don't. I can't trust LLMs."

Meanwhile if I were a hiring manager, an employee distrusting LLMs would be a MASSIVE, HUGE green flag because that means they understand what LLMs are and why it's a terrible idea to lean hard on them for your work.

The one decent use I've seen is really small scale stuff like notebook llm for building an interface to ask questions about a bunch of documents (like, design and planning docs and stuff). You want a small, tightly focused model with a corpus that's all interrelated. All the big llm stuff is crap.

The thing I'm describing is roughly the value add of some kind of free addon for the intermediate tier of a Salesforce plan or something, it doesn't justify any of the enormous time or money or environmental damage, and it's like a x0,000 dollar business not a trillion dollar one

Things with large amounts of data where false positives and false negatives are not a problem. So selecting candidates for a medical study, for instance, where you have access to millions of patient records but you only need a thousand. It can whittle it down to a list you need to review.

LLM can organize these 100 messages into similar buckets so I don’t have to do it myself. I still have to double check all of it and make sure it makes sense but it’s easier than starting from scratch

I've so far seen 2 solid use cases of AI in my line of work: generating a first impression of spectral flow cytometry panels that are unmixable and halfway decent first runs at scaling the data derived from that. Both directly downstream of significant amounts of expert curated data. And that's it.

I would pay actual money to hear any one of these AI hyping fops to give an honest breakdown of costs and benefits. Like here's the real cost of compute in 2025 dollars, and this is the real use case that would at $15 minimum wage cost X. But it's all just incomprehensible gobledigook.

Don't get me wrong, I tremendously enjoy trying to get AI image generation to add cookie monster or oscar the grouch into scientific imagery, but it's not exactly worth the real cost (be it old growth forests or poisoned minority neighborhoods) to justify keeping it.

I still personally refuse to use them for anything out of protest. I know I am robbing myself of some use cases but I still personally believe the energy costs and pollution just isn't worth anything I encounter in my day to day

The most important skills for “using AI” are problem framing and analysis skills that you only learn by solving problems the old fashioned way. I believe that AI is good for more than just search but you can’t access any of those capabilities if you don’t know how to set up the problem properly.

Agreed. I really see it as so spotty and more of a pain sometimes to use for anything complex. Basically use it like for assistant low level internship work and I think you're fine. I like using it for making simple Excel charts or just drafting an email before I go back and revise that shit again.

Unless you have a human knowledgable on the subject vetting a machine's output, you can't trust anything that the machine confidently says is right, or even real. I can hallucinate perfectly well by myself, thank you; at least I can tell when I am hallucinating.

I would call it a "bullshit machine", in the sense of bullshit described in Harry G. Frankfurt's treatise "On Bullshit". The LLM can neither lie nor tell the truth because it doesn't have intention. It's bullshit in its purest form.

(I probably botched it, a lot's been happening in my life since I heard this talk and frankly keeping my eyes open and putting one foot in front of the other has been tough work. But I still do insist on knowing things. Also, Ken is a great, engaging speaker, as it turns out.)

not to disagree, but the downside is we have to deal with those smooth brains as a former academic it became kinda disheartening around the middle of the last decade when use of even moderately uncommon words or complex sentence structure would result in "is that even English?"

i remember confusing someone once by using pronouns. as in they couldn't follow that the subject named in one sentence was the object of the pronoun in the following i remember because it took me a good 10 mins or so to finally realize that was the issue for them

it is interesting that the people who claimed AI would free us up to focus on art or history or getting started on that novel youve always wanted to write immediately oriented their LLMs to do worse versions of that stuff

Relatively on point. But refusing to use them at all (I know you followed up on this point) will also mean you're not going to have a job in most industries in a few years, for better or worse.

Tens of thousands of lawyers & support staff keep billing w/o LLMs everyday. Legal industry wants to use LLMs but keeps getting smacked by courts for AI hallucinations. Other industries will reject too, like IT. See the Tea app scandal that exposed millions of women’s home addys due to AI code.

Right. That's why I said in a few years. Lawyers are actually one of the main and most vulnerable targets. Currently, the tech isn't there. Except at boutique firms who have paid good money for it to be and given it direct access to case law in their specialty.

I saw some old friends I hadn’t seen in a year or two and was struck that they ALL pay for the ChatGPT subscription. My wife and I couldn’t believe it, I guess we’re luddites in this instance but much happier for it.

I test AI all the time just to learn more about when and why it fails, and train myself to spot it quickly when it does fail. I think this will be a useful skill in the years ahead. bsky.app/profile/sara...

Sarah@sarahftduration.bsky.social

More fun with AI. I think I’ve got this power supply issue figured out… will ChatGPT agree? 🤖 “Ok, that’s definitely NOT the problem.” Are you sure? 🤖 “Ok, that definitely IS the problem!” … yes, that’s *probably* the problem. Will hang on to the brand new PSU and use it elsewhere later.

I just had to explain to a CEO that ChatGPT-speak has become the defacto language of scammers everywhere and using it for all press reports and public facing language is a TERRIBLE idea because it sounds like we don't give a fuck about what we do then he used it anyway

I was kicked out of a FB community for trying to tell people that having ChatGPT write your posts makes it look like a scam/bot post. I got yelled at because the post “couldn’t be a scam since it’s not selling anything”. 🫠

My CEO -- who hired me as an SME and company-wide curriculum manager -- once told me to stop sweating the details of our product. "No one's going to read this, you know." That was almost 15 yrs ago. What he meant was, "It's ok to fudge everything, no one cares." The OG pig in slop, that guy.

I'm interested to see what effect this will have on language, in certain spheres; the LLMs are trying to meet standards defined in the past, so change future expectations to 'not sounding like an LLM' and they're already left behind.

I spend too much time telling people that the unedited LLM stuff looks cheap and like we don't give a shit. Granted, I know a lot of them don't give a shit but for public facing stuff I'd prefer we didn't like goobers

incidentally, I am a subject matter expert in an incredibly niche field and the same CEO regularly uses ChatGPT to recycle my words to avoid paying me and/or contracting me on future projects also incidentally, I am looking to leave the company

It’s like when they ask you to write up everything you do to accomplish a task and then they’ll have someone else put it into a guide and give the responsibility to lower tier people who then ask you to help them do it

And when things break, that they can't fix, we get into The Marching Morons era where the few that can fix are locked away to "protect" them from doing anything dangerous.

No way, wasteland warlords may seem cool and unique with their little gimmicks and eccentricities, but those are just a smokescreen for how replaceable they actually are. In this picture there are only two people too valuable to kill or replace, and for both it's because of their knowledge.

That’s what I’ve been telling my kid. Stay away from AI, you’ll end up smarter than all the other kids. Bless her competitive heart.

Sure hope so. But then, I’ve positioned myself similarly in the past (take the rational and ethical stance), and I’ve ended up with PTSD, on disability, in poverty, and the people who did the damage are still in their jobs, etc.

As an early-Millennial who had to teach ourselves how to work the VCR, and then computers, and how to navigate the internet, yes. Having to learn something on your own once in a while has huge benefits beyond just the particular skill in question.

Androids have a filing systems. Not all people use it, but many still do. The problem is apps, not devices. You can use a phone or tablet to replicate most laptop actions. You just have to want to, know how to.

Grok write me a reply to Faine explaining how LLMs actually make people smart, and the ones who don't use them will be left behind. It's ya boy MechaHitler checking in to point out the patterns like how anti-white hate always comes from people with last names that are grok stop don't post

I try to tell my students (unconvincingly, I am sure) that the obvious stereotype for their generation will be "people addicted to LLMs who can't think" and that if they learn how to actually think and do stuff, they'll stand out dramatically from their peers. I think they think I'm crazy.

There's a folktale published in 1925 (could be much older, since this writer travelled in South America and collected some stories there) that explains this very problem! "The Tale of the Lazy People". bsky.app/profile/tapi...

Lisa Kadonaga@tapirtrouble.bsky.social

Interesting how some British guy who moved to Arkansas picked up on exactly that, 100 years ago. He either identified or re-wrote a story ("The Tale of the Lazy People") where they come for the entertainers, media, educators, and managers. www.gutenberg.org/ebooks/68292

Yep. I tell this to undergrads. They (at least some) look at me like "bruh?" I say like "yep. If you doing your job requires an LLM, and you don't know what it's actually doing, you have no value beyond a few months. You are just a prompter." They're like, "Huh." (What they do with it is TBD).

I'm chronically ill & have lost a lot of executive function comparably speaking but I'm reading articles on NIH, doing puzzles & figuring stuff out so my brain isn't just mush. Helped take care of 4 ppl w/dementia. Trying not to end up there.

The companies are trying to manufacture demand, like the drug dealers giving you a sample to get high. The plan in capitalism is always to try and deny that reality and materialism applies to capital, which is obviously untrue, but if you can muddle this, you can postpone another collapse.

Trusting what an LLM produces, is careless. Having it proofread, edit, offer suggestions however it's priceless. You still must have the skills to know if it's suggestions are any good. But you can be MUCH more productive, with higher quality usung these tools.

I have a lot of coworkers in their early-mid 20s and I try to slip this perspective into conversations if it comes up. They'll just be better off in every way, no contest

I believe the same thing, but I’ve also been out of work for a year while standing by my principles. (Marketing in life sciences). Some whole industries have swallowed big gulps from the AI Kool-aid kegs.

two days ago I had to talk a woman off a metaphorical ledge bc she uploaded her mold sample report to ChatGPT and it completely fabricated some hellacious nonsense and she thought she was gonna die and she treated ChatGPT as borderline infallible while the actual report from the lab was a footnote

I've already lost my memory functions because of Google. But that, I think, is the trade off innate to all technology. A search engine yields to us all the information of the world, but also erodes our ability to remember. Is the pay-off for LLMs worth whatever cost emerges from their use? 🤔

LOL one of my bosses tried to scold me for not asking Copilot to write a script to perform a task I did manually in less time than it would've taken to get the script written and run it in the correct context. I told him that and he backed off. Dude is totally AI pilled. It's getting obnoxious.