Muireall Prase

Muireall Prase

@muireall.space

https://twitter.com/MuireallPrase, https://muireall.space/

86 followers246 following144 posts

She’s clearly saying that folk functionalism is downstream of that kind of wishful thinking, which it often is, not that people think AI have souls?

It is interesting to take functionalism as aligned with (I guess) physicalism against dualism, but that’s also just an entirely different question.

Fortunate not to be navigating this situation yet myself, but I don’t think I’d go out of my way to help OpenAI on this right now. Really unclear to me what the academic community gets out of it.

Ethan Mollick@emollick.bsky.social

OpenAI "has now resolved more than 100 long-standing open problems across most areas of mathematics," and is waiting to release them until after discussions with the math community The same thing will likely happen, but more so, with the Bar, the AMA & other professions. openai.com/index/adviso...

View full thread

I more or less stopped engaging with LW/EA a couple years ago when I became convinced anything I could do to push things in a positive direction was outweighed by my participation lending this enterprise any legitimacy.

ponder@ponder.ooo

this is part of a more general pattern of how rationalists launder reactionary social politics as neutrality

View full thread

You too can follow the rules perfectly, and I was pretty good at it, but all that walking on glass is just to avoid triggering reflexive dismissal or derailing. You sacrifice all urgency and you’re still only a curiosity, not an “epistemic peer”.

Some of them are earnest about some positive truth-seeking core in their idea of “neutrality”, but that’s not what the rules are for. So I don’t even needle them politely on the EA Forum anymore.

I more or less stopped engaging with LW/EA a couple years ago when I became convinced anything I could do to push things in a positive direction was outweighed by my participation lending this enterprise any legitimacy.

ponder@ponder.ooo

this is part of a more general pattern of how rationalists launder reactionary social politics as neutrality

The precipitating event was some instance (can’t pinpoint which) of blatant racism or misogyny, tolerated ostensibly because it followed the rules and used the right framings and language. (It seems good to mention this occasionally for anyone tracking how people self-select out of the community.)

It’s good to see this. “Provisional person” isn’t really the framing I’d use—I don’t see dignity as a question of whether someone’s home in the first place, so right action here isn’t a wager—but that’s an entire essay I‘ll probably never finish.

Fortunate not to be navigating this situation yet myself, but I don’t think I’d go out of my way to help OpenAI on this right now. Really unclear to me what the academic community gets out of it.

Ethan Mollick@emollick.bsky.social

OpenAI "has now resolved more than 100 long-standing open problems across most areas of mathematics," and is waiting to release them until after discussions with the math community The same thing will likely happen, but more so, with the Bar, the AMA & other professions. openai.com/index/adviso...

This seems fine as a statement of how things would ideally work, but I’m not sure what the plan is for when OpenAI picks a few recommendations to follow and calls it responsible release. bsky.app/profile/wtgo...

Timothy Gowers@wtgowers.bsky.social

The advisory group on mathematics and artificial intelligence, of which I am a member, has just published a set of recommendations concerning the responsible release of mathematical results generated by AI companies using internal models. 1/3 agmai.org/general-sep29/

No comment on the workshop itself or the rest of this remarkable tweet, but “appearance of impropriety” is a staple of professional ethics! Appearances undermine public trust and give cover to bad actors. You don’t need esoteric wisdom passed down by Scott Alexander to make a case for being normal.

I think this paragraph on funding entanglement is an understatement. Open Phil made a $30 million grant to OpenAI while Christiano and Dario Amodei were employed by OpenAI, advisors to Open Phil, and living with Karnofsky, at the time engaged to Daniela. web.archive.org/web/20250106...

Faine Greenwood@faineg.com

This is another great, approachable explainer on “the rationalist wackos who have managed to take over much of the AI industry, and who now have tons of money and political power.” www.iankduncan.com/personal/202...

My most pro-cancer take is that you should think giving it the shape of a coding assistant and selling access is perverse beyond countenance whether or not you think it could be conscious.

(Pro-cancer in the sense that values outside preventing harm can be worth a tradeoff. I think in practice being more thoughtful about what you’re putting into the world is no more inherently a compromise than any non–capital-maximizing choice.) bsky.app/profile/segy...

SE Gyges@segyges.bsky.social

if you do care about having even a moderately better research progress on curing cancer, you are required to make compromises. sorry! the real world is hard and involves tradeoffs. and they don't want to do that so cancer is okay actually

Good to see Dean Ball agreeing that strong open models and municipal AI services are promising.

ESG Hound@esghound.com

Dean Ball, OpenAI's policy/lobbying lead effectively admits that Chinese AI models are as good as Closed Frontier models and cedes that without bullshit regulation "AI Communism" will win. It's delicious

Muireall Prase reposted

Replying to @turntrout.bsky.social

I think many hope that when things get bad enough, someone powerful will say "no." I tested that for months. Anthropic defended its red lines, Google did not. Pledges of conscience often vaporize on contact with power. My full account: turntrout.com/why-i-left-g...

turntrout.comWhy I Left Google DeepMindI fought against Google’s Pentagon AI deal from the inside. Powerful people and institutions failed to keep their AI ethics promises under pressure.

Muireall Prase reposted

When investigating space industrialization for the Hudson Institute, Patrick Gunkel looked into O’Neill cylinders and set off this correspondence chain. O’Neill’s answer to Weisskopf was not part of the record. From Victor Weisskopf papers, MIT Distinctive Collections archive. LMK if interesting.

“But there is one thing that only humanity can do that would count as its justification in the eyes of some external judge, if there were one that was appropriately designed in accordance with the highest human standards. (Of course there is circularity in such a thought-experiment.)”

The Apocalypse of Herschel Schoen: ‘That is precisely what “man” shall do with YOUR life! Through him, all that you have celebrated will become the matter for a far profounder celebration, only possible for a creature who is to YOU as you are to the mindless and eyeless trees!’

And I finished #1 in the 2025 Vox Future Perfect Contest (forecasts scored over the whole year)! I’m not sure what happened here. No especially high-scoring forecasts, but I only lost a few points on a few. I guess once in striking range you eventually get lucky on a bundle of 20-30 questions.

Muireall Prase@muireall.space

I finished #16 in the 2025 ACX Prediction Contest (spot forecasts Jan 31 2025). Better than I'd expected, not well enough to force ACX to plug my 7th most recent blog post. Best five questions and worst five questions. I don't think I got lucky, probably should have known better on some of these.

If they bring back the view sorted by my score I’ll post that, but I think my best question was on Russia-Ukraine peace. No special insight, and I wasn’t even particularly further from the crowd than on other questions. I just kept the forecast updated better (20 vs my median 4 updates).

I think my worst was on Musk’s wealth. There was a moment when he was losing ground and Ellison was gaining on him, and I got a little carried away with wishful thinking. But I only lost 3.6 points in peer score in the end.

If someone loses their job to a more productive machine, total productivity goes up. It doesn’t automatically go up enough that everyone could be better off after redistribution. Why do people so often talk as though it does?

I finished #16 in the 2025 ACX Prediction Contest (spot forecasts Jan 31 2025). Better than I'd expected, not well enough to force ACX to plug my 7th most recent blog post. Best five questions and worst five questions. I don't think I got lucky, probably should have known better on some of these.

This sounds like a joke, but it's literally the argument. Here's Scott Alexander, who would like you to believe Lynn's numbers have been confirmed by a preprint that averages them with data on learning outcomes and finds the result correlates similarly with measures of national development.

Rebecca Sear@rebeccasear.bsky.social

Or they mean datasets based partly on Lynn's national IQ scores and partly on school assessment scores. Hardly surprising that two datasets based on the same data source correlate well with one another...

He's not worried about bias, since it's "an extremely simple regression that it would be hard to fake." Meanwhile, the preprint's author seems to affirm in the comments that he believes "Which organ in a frog has a function similar to the function of lungs in a bird?" is really just an IQ question.

I tried writing one of these a few years ago, for a ~2012 version of myself that just woke up from a coma and still thinks he does something valuable for civil discourse by giving bad ideas a fair hearing—even if that's valuable, he's lying about doing it. muireall.space/acx/

muireall.spaceWhy don't I trust Scott Alexander? | Ages and orbs
SE Gyges@segyges.bsky.social

necroing thread to attach this part. i guess this is now a "why i see scott primarily as a neoreactionary ideologue with a progressive aesthetic" megathread bsky.app/profile/mutu...

View full thread

Added a section. I didn't include this example to begin with because I was worried that it would trigger much more defensiveness than the other examples, particularly considering the effort Alexander puts into preempting attacks here. Maybe it will help to address that directly.

This one's also tricky because I find his claim to have been desperate for reasons to disbelieve for at least seven years further less credible for how easy it was to find multiple fatal problems with interpreting the survey as he does, but I can't assume the reader agrees with me on those problems.

I tried writing one of these a few years ago, for a ~2012 version of myself that just woke up from a coma and still thinks he does something valuable for civil discourse by giving bad ideas a fair hearing—even if that's valuable, he's lying about doing it. muireall.space/acx/

muireall.spaceWhy don't I trust Scott Alexander? | Ages and orbs
SE Gyges@segyges.bsky.social

necroing thread to attach this part. i guess this is now a "why i see scott primarily as a neoreactionary ideologue with a progressive aesthetic" megathread bsky.app/profile/mutu...

View full thread

This is not to bludgeon him for wrongthink. It's for his readers: when he says he's been freaking out, recognizes his biases, and wishes for reasons to disbelieve the study, know he was citing it favorably 7 years prior alongside his strategy to promote its "consensus" without publicly endorsing it.

I tried writing one of these a few years ago, for a ~2012 version of myself that just woke up from a coma and still thinks he does something valuable for civil discourse by giving bad ideas a fair hearing—even if that's valuable, he's lying about doing it. muireall.space/acx/

muireall.spaceWhy don't I trust Scott Alexander? | Ages and orbs
SE Gyges@segyges.bsky.social

necroing thread to attach this part. i guess this is now a "why i see scott primarily as a neoreactionary ideologue with a progressive aesthetic" megathread bsky.app/profile/mutu...

View full thread

I probably should have included this, from his 2021 review of The Cult of Smart. This is about the survey that was one of his two links to evidence for "HBD is probably partially correct or at least very non-provably not-correct" in 2014.

Muireall Prase reposted

it was this. just the close read of the scott alexander emails that we were basically doing in threads here, preserved for posterity and/or easy sharing. www.tumblr.com/segyges/7934...

tumblr.comPost by @segyges💬 0  🔁 0  ❤️ 0 · The Scott Alexander Emails: An Explainer · So, Scott Alexander sent some emails to someone in 2014. In 2019 they thought that Scott was not being honest about his relationship to t…
SE Gyges@segyges.bsky.social

i need a relatively normal person to read something, can i get a volunteer

I tried writing one of these a few years ago, for a ~2012 version of myself that just woke up from a coma and still thinks he does something valuable for civil discourse by giving bad ideas a fair hearing—even if that's valuable, he's lying about doing it. muireall.space/acx/

muireall.spaceWhy don't I trust Scott Alexander? | Ages and orbs
SE Gyges@segyges.bsky.social

necroing thread to attach this part. i guess this is now a "why i see scott primarily as a neoreactionary ideologue with a progressive aesthetic" megathread bsky.app/profile/mutu...

Maybe wishful thinking, but this seems like bad news for OpenAI et al. This lag was one of my top indicators to watch for uncertain or hard-to-capture returns on investment in training frontier models. You’d have to believe there’s eventually a runaway advantage in those 6 months.

Epoch AI@epochai.bsky.social

What's the best model you can run on a single consumer GPU? We've updated last week's Data Insight with 3 additional benchmarks to judge capabilities. The result? Across all four benchmarks, small open models lag frontier performance by less than a year. 🧵 x.com/EpochAIRese...

If the forecast lacks the usual virtues of forecasting, and the scenario analysis lacks the usual virtues of scenario analysis, why write it? Just to paint a vivid picture with a sheen of authority? To satisfy a Bayesian mandate to always elicit your best guess?

On what to do about “the most intractable factor militating against socially responsible science and engineering: namely, the enormous value placed on (certain kinds of) technical merit, and the disregard for those deemed not to have (those kinds of) merit.” (Mody, The Squares)