Post

This is another great, approachable explainer on “the rationalist wackos who have managed to take over much of the AI industry, and who now have tons of money and political power.” www.iankduncan.com/personal/202...

iankduncan.comSex, AI, and the Apocalypse - Ian DuncanHow a community devoted to thinking clearly incubated salvation stories, abusive experiments, race science, and an affection for autocracy, and why that history matters now that its alumni are asking ...

469 reposts1.9K likes

i'd like to add from personal knowledge: one of the doge boys from that infamous Wired article (who appear to have mostly been recruited from that same silicon valley milieu) used to run a small effective altruism blog

My main question is now, how long until someone turns this movement and all its sub-organizations into an Illuminati expansion set?

somewhere Yud explains that he wrote his Sequences because he was trying to tell people that AI x-risk is a problem, and he kept seeing the same poorly-thought-out counterarguments which makes it darkly ironic that the primary argument against AI risk now is just "look how weird Yudkowsky etc are"

Gotdamn, I read the whole thing. My takeaway is to *still* tax billionaires out of existence (see my pinned comment). That amount of money comes with way too much power (until CU is nixed & real campaign financing reform is passed, but even then too) & hubris. There is a #BillionairesDisease afoot.

A mostly accurate blend of history lesson and push piece with the aim of discrediting coxon by association. Lot of terrible weirdos out there, but a lot more decent people too.

graf 3 leads: "In order to realistically evaluate the gravity of this warning, we need to understand the people who are making it." we do not and to even suggest that we should start there is a brazen ad hom that's quite frankly insulting to the reader's intelligence.

before launching into an exploration of HPMOR we get: "you were not misanthropic, the masses genuinely are running corrupted firmware; you were not arrogant, you genuinely are a hero in the fight for the species." not missing my notice is the implication all these people are arrogant misanthropes!

Before launching into a yellow journalism deep dive on debauchery we get "While I’m not here to pass judgement on people’s sex lives," the classic "I'm not a bigot... but!"

If you read carefully, you'll see that the problem here is not the sex (not the consensual activities, anyway) but the way in which having the network of romantic interrelationships almost totally overlap with the network of professional relationships creates adverse conflicts of interests

The stuff on the Thiel and the "Thiel thing" is just deeply incongruous, and suggests either a deep misunderstanding or more likely is the biggest evidence that this is deliberately constructed as a bad-faith hitpiece, inserted as an adjuvant to trigger the anti-Trump anti-bodies in the reader.

Waitwaitwait, is your implication here that Yud is not an arrogant misanthrope, because like, you know, huh?

My man, assessing someone’s credibility, whether they are incentivized to lie/exaggerate, etc. as part of evaluating the usefulness of their opinion is not ad hominem.

Maybe the funniest part of this is that it appears to be the fourth graf. You're pounding the table and yelling at everybody and getting the absolute basics wrong.

I didn’t, wrote this whole thing up in a helluva hurry. But it was too funny to change when I realized what I’d done

anyway, it'ssome kind of funny that 10 years ago i found this need for community rituals alienating & arguments for them offputting; but now that i turned out to be (accidentally?) right about these people's creepy need to recreate religion, i also have come to agree that humans need social ritual

This is evidently a definition of "rational" with which I am unfamiliar. I love science fiction as much as anyone, but I recognize the "fiction" part of it.

as an "eldest daughter" i viscerally understand a desctructive act of boundary enforcement while simultaneously being intensely skeptical that his were ever encroached on meaningfully enough to trigger it as a trauma response and not just childish tantrum

Bub, I don’t think that “I once broke my favorite toy rather than have to share it” is the shining example of rationality that you think it is.

I have my one thing I always need to bring up about Yudkowsky, because I think we don't talk enough about the short story he wrote ("3 worlds collide") where in the future humanity legalizes rape and it unlocks a golden age or whatever. It's not even core to the plot, just some world building.

here we find Eliezer Yudkowsky engaging in the classic 90s and 2000s genre of “insecure straight guy getting really defensive about liking Buffy the Vampire Slayer”

they called themselves the scoobies because there were like 4 or 5 of them. In the series finale she makes all potential slayers actual slayers by sharing the power. These people can't read.

Holy shit. I’ve known “intensely dorkly.” There were plenty of times I’ve BEEN “intensely dorky.” This paragraph isn’t nearly cute or harmless enough to qualify. This is a libertarian personality disorder at best. Delusional messiah complex at worst. (and we haven’t gotten to the race science yet)

lol "his favourite squirt gun". Was he wearing a propeller hat and striped overalls too? Not only is it pathetic but he thinks it's bad ass and it's also probably completely entirely made up which makes it even funnier that he thinks it sounds cool.

What an... Odd way too tell everyone reading your autobiography that you're a selfish little twat. Since when has "if I can't have it, no-one can" been the attitude of a hero? I must have missed that memo.

I hope I never meet this person in real life because if I heard him speak for more than 30 seconds I would be overcome with the urge to punch him in the nose and he probably has enough power and influence to have me disappeared.

The image gets the story a little wrong, it's not that his parents lent it to another child, it's that they took it away from him and thus demonstrated that they didn't consider him to really own the toy as opposed to it just being on loan from them. So he asserted his ownership by destroying it

There’s a sad piece to Eli’s supervillain origin story that’s not very talked about, and that’s when his brother was senselessly murdered during a mugging. He was already well on his way to becoming who he is, but it seemed to turn his transhumanist bent up to 11.

21 year-olds writing autobiographies should be illegal. Also, and I cannot explain why, but I read a portion of it. I had that Blonde Guy WTF face the whole time. But it had the whiff of this masterpiece - and would probably sound the same... bsky.app/profile/jsar...

Jill Sargent Russell, PhD@jsargentr.bsky.social

There are very few O-5s whose work you should follow 🤣. If you'd like to really laugh about bad ideas in officer development... youtu.be/mwV7s4SBKR4?...

This is the sort of probably-made-up anecdote that demonstrates, despite protests to the contrary, just how much all these movements owe to Ayn Rand, high priestess of convicing dorky white teen boys they're the future philosopher-kings of the world

like, all of this doomer shit used to be a lot _less_ overt, they'd hit you with it once you got far deep enough into it, but initially it was "yeah, these people care about effective giving and re-examining biases and science"

many such cases

like i think philosophically there are two kinds of leftist, distinguished by the directionality of how they’d like to achieve equality — one kind wants oppressed people to be more privileged, and the other kind wants privileged people to be more oppressed. the latter essentially believes in sin

I’m less concerned with AI wiping out humanity than I am with people allowing it to seriously fuck shit up to the point where we might wish we’d been wiped out. But that’s still on humans.

I've bookmarked dates for some of the most breathless hype claims ("all white collar work will be fully automated in 12 to 18 months" was, like, 8 months ago or something) but it actually would be pretty good to collect all of them in a Calendar of Doom & then just laugh as we blow past each one lol

Maybe this was just falling back on our Gen X priors, but me and my friends just used the winter solstice to get wasted around a giant fire in the snow. Who knew that would sound healthier that what ever this is.

It's a strong reminder that they didn't reject the concepts of blind faith or zealotry: they just wanted those in wrapped in a context with justifications that they felt more comfortable with, and in which they'd get to set the baseline norms by virtue of being in the founder/leadership roles.

So basically, white Christian evangelical theocrats were invited in as funders & staff by the Repubs & took over the party in the 80's & 90's & then Randian Scientology sci-fi mystic tech autocrats were invited in as funders & staff & took over the Repub party & later Trump's admin in the 10's-20's.

I do think that it's important to emphasize ziz's radical veganism as a motivation. In particular because I think people attribute some of this stuff to her being trans, no, that's incidental, she was motivated by being vegan and being willing to use violence to achieve vegan ends.

So all the talk from AI companies that to the rest of us seemed to be taking on a religious tone as if AI is going to Save them in Rapture called the "Singularity" isn't a joke??? They really are a religion???

Yeah that's what I don't get. See I assumed the techbros were eager to have AI magically cheat death by uploading their consciousness or something. Now it seems like all these "AI will end humanity" statements they see as a positive? Like how is it "rational" to work towards death?

Highly recommend reading God Human Animal Machine by Meghan O'Gieblyn on this topic which tracks some od the specific mutations in theology and philosophy that got us here.

Speaking from experience, a lot of smart young white men don't get enough pushback in their lives and conclude that ideas that sound good to them must be True. If they're True, there's no need to check them against reality; only extraneous circumstances could prevent them from being proven correct.

Then these guys cross-reinforced each other and started convincing each other that if those ideas were True, then other ideas built entirely off of those ideas were also True, and ideas built off of those were also True, etc. Repeat ad infinitum until they've laddered their ideas to the eschaton.

Hah, have owned this book since forever, still never read it. I've read every book to the left/right, some multiple times. Older lawyer fam friend gave it to me when it came out as a kid (also pushed me to go work for Id). Def can't say why although I have suspicions. Perhaps bullet missed. 🤔

They didn't take anything over, they created it. They had no opposition to overcome, they're run it from the start.

We've taken a bunch of people half of whose brain works much better than average, while the other half is all but missing altogether, and invested them with virtually infinite money and power. This will turn out to have been a very bad idea.

I'm also annoyed that those highly irrational wackos have been allowed to take over the term "Rationalist", and the press are going along with it. I'm sorry, but their cult is less "rational" than Ayn Rand's Objectivists were "objective".

Between 6 and 8, my daughter used to hang out with a bunch of boys who are now Berkeley Math Circle/ D&D-ish 11yos, still obsessed with Harry Potter. They all live close to Light Haven. I’ve been wanting to give their v nice parents hints to screen any math camp/summer camp invitations.

I still see them from time to time, but we’re not close since our kids grew apart. This is the first piece that *might* help me explain why their math-loving, Harry-loving sons are targets, without sounding full-on Pizzagate insane.

Rather than special/chosen these eschatological cults are drearily familiar. They all indulge a theological/psychotic desire to make it all make 'sense' but mask what is essentially a fear of death and being utterly ordinary under a comforting arrogance that only they have access to the 'truth'.

This is why China is thrashing the US in every technology race. China has no qualms about prosecuting and imprisoning its leaders for corruption. And tbc, the more power and privilege, the more corruptible and corrupt <anyone> can become.

I hate all of this and I am now sad and it’s your fault. These…I don’t even know what to call them, what words properly convey their nature? But these are the individuals capable of fundamentally changing all of our lives in an instant.

Lots of good names to add to the Death Note in this article. They should do another silly little reboot where a jilted member of this creepy cult gets a Death Note and simply eradicates them all. Maybe they could use the Shinigami powers in some way to help bring about the AI Apocalypse