Max Kleiman-Weiner

Max Kleiman-Weiner

@maxkw.bsky.social

professor at university of washington and scientist at Google DeepMind. computational cognitive scientist. working on social and artificial intelligence and alignment. http://faculty.washington.edu/maxkw/

4.3K followers383 following441 posts

Excited by our new work on AI contracting! Now that we each have our own agents, they need to be able to find mutual benefit with each other and honor their agreements. This is a promising route to supercooperators!

Bhavyesh Sajja@sbhavy.bsky.social

AI agents could transform the economy by slashing the costs of making deals. But can they actually negotiate and honor agreements? Turns out they negotiate badly under uncertainty and break deals on purpose! We study AI contracting in our new paper: 🧵👇 arxiv.org/abs/2608.10475

Everyone is excited about recursive *self* improvement (RSI) but human progress is social and driven by cumulative culture. Individuals stand on the shoulders of past giants. Our new paper tests whether LLM swarms benefit from an alternative RSI: recursive *social* improvement.

Kunal Jha@kjha02.bsky.social

LLM agents are evolving their own skills and working together in swarms. But how well do they learn from each other? Our new paper on Recursive Social Improvement finds that copying peers’ discoveries can come at the expense of exploration. 🧵 arxiv.org/abs/2609.38516

Our newest work unifying game theoretic ideas about the evolution of cooperation with the emergence of computation itself. Self-replicating programs first emerge through random mutation and then spread by cooperating.

Kunal Jha@kjha02.bsky.social

Can self-interested, self-improving, self-replicating agents learn to cooperate? Our new paper, Tapes Together Strong, shows they can: when social behavior, computation, and reproduction share one energy budget, cooperation evolves from scratch. arxiv.org/abs/2609.10817 🧵

New lab preprint! AI assistants are myopically helpful. Unlike caregivers that want to empower people and grow their long term autonomy, AI assistants interrupt independent thinking and jump right to the answer.

Verona Teo@veronateo.bsky.social

Deciding when to jump in and help someone—and when to hold back and let them work through it—is something humans navigate constantly. How do AI assistants handle this tradeoff? We introduce Int-Bench, a framework for evaluating interventions during problem-solving tasks.

Excited about our new work measuring multi-turn persuasion in AI-human interactions and how to simulate human persuadability!

Jared Moore@jaredlcm.bsky.social

LLMs can shift people's beliefs. But most persuasion studies only check beliefs before and after a conversation. We built PersuasionTrace to measure beliefs turn by turn, so we can study how belief updates actually unfold.

Max Kleiman-Weiner reposted

LLMs can shift people's beliefs. But most persuasion studies only check beliefs before and after a conversation. We built PersuasionTrace to measure beliefs turn by turn, so we can study how belief updates actually unfold.

Max Kleiman-Weiner reposted

Task diversity is supposedly key to generalization in RL. But what does it do to continual RL, where agents face one new task distribution after another? We find that past a point, more diversity actually inhibits continual reinforcement learning 🧵

Max Kleiman-Weiner reposted

Really excited to have the opportunity to give a talk on this work @cogscisociety.bsky.social !!! last year was a blast can’t wait to go back to Rio in July 🇧🇷 HUGE thanks to my collaborators for the support @aydanhuang265.bsky.social @EricYe29011995 @natashajaques.bsky.social @maxkw.bsky.social 🙏

Kunal Jha@kjha02.bsky.social

Forget modeling every belief and goal! What if we represented people as following simple scripts instead (i.e "cross the crosswalk")? Our new paper shows AI which models others’ minds as Python code 💻 can quickly and accurately predict human behavior! shorturl.at/siUYI%F0%9F%...

Our new short piece in TiCS on intuitive theories of truth: how people judge whether statements could be true, whether statements are true, and whether to assert them as true. A great collab with @keremoktar.bsky.social @ihandleyminer.bsky.social @kevinzollman.com @lianeleeyoung.bsky.social

Kevin Zollman@kevinzollman.com

New paper: Intuitive theories of truth We connect philosophical theories of truth with cognitive science. We suggest new avenues for research around questions of how people judge statements as truth apt, what makes them true, and whether to assert something as true. Check it out!

Max Kleiman-Weiner reposted

Can't wait to present this work @iclr-conf.bsky.social this year!!! Looking forward to hearing everyone's thoughts on the paper and learning more about peoples' research! Thanks again to my collaborators for all of their help on this project!

Kunal Jha@kjha02.bsky.social

Forget modeling every belief and goal! What if we represented people as following simple scripts instead (i.e "cross the crosswalk")? Our new paper shows AI which models others’ minds as Python code 💻 can quickly and accurately predict human behavior! shorturl.at/siUYI%F0%9F%...

Max Kleiman-Weiner reposted

🤔💭What even is reasoning? It's time to answer the hard questions! We built the first unified taxonomy of 28 cognitive elements underlying reasoning Spoiler—LLMs commonly employ sequential reasoning, rarely self-awareness, and often fail to use correct reasoning structures🧠

Max Kleiman-Weiner reposted

Forget modeling every belief and goal! What if we represented people as following simple scripts instead (i.e "cross the crosswalk")? Our new paper shows AI which models others’ minds as Python code 💻 can quickly and accurately predict human behavior! shorturl.at/siUYI%F0%9F%...

New paper challenges how we think about Theory of Mind. What if we model others as executing simple behavioral scripts rather than reasoning about complex mental states? Our algorithm, ROTE (Representing Others' Trajectories as Executables), treats behavior prediction as program synthesis.

Kunal Jha@kjha02.bsky.social

Forget modeling every belief and goal! What if we represented people as following simple scripts instead (i.e "cross the crosswalk")? Our new paper shows AI which models others’ minds as Python code 💻 can quickly and accurately predict human behavior! shorturl.at/siUYI%F0%9F%...

When values collide, what do LLMs choose? In our new paper, "Generative Value Conflicts Reveal LLM Priorities," we generate scenarios where values are traded off against each other. We find models prioritize "protective" values in multiple-choice, but shift toward "personal" values when interacting.

Andy Liu@andyliu.bsky.social

🚨New Paper: LLM developers aim to align models with values like helpfulness or harmlessness. But when these conflict, which values do models choose to support? We introduce ConflictScope, a fully-automated evaluation pipeline that reveals how models rank values under conflict. (📷 xkcd)

Excited by our new work estimating the empowerment of LLM-based agents in text and code. Empowerment is the causal influence an agent has over its environment and measures an agent's capabilities without requiring knowledge of its goals or intentions.

Claire's new work showing that when an assistant aims to optimize another's empowerment, it can lead to others being disempowered (both as a side effect and as an intentional outcome)!

Claire Yang@claireyang.bsky.social

Still catching up on my notes after my first #cogsci2025, but I'm so grateful for all the conversations and new friends and connections! I presented my poster "When Empowerment Disempowers" -- if we didn't get the chance to chat or you would like to chat more, please reach out!

Max Kleiman-Weiner reposted

Still catching up on my notes after my first #cogsci2025, but I'm so grateful for all the conversations and new friends and connections! I presented my poster "When Empowerment Disempowers" -- if we didn't get the chance to chat or you would like to chat more, please reach out!

Max Kleiman-Weiner reposted

lol this may be the most cogsci cogsci slide I've ever seen, from @maxkw.bsky.social "before I got married I had six theories about raising children, now I have six kids and no theories"......but here's another theory #cogsci2025

Our new paper is out in PNAS: "Evolving general cooperation with a Bayesian theory of mind"! Humans are the ultimate cooperators. We coordinate on a scale and scope no other species (nor AI) can match. What makes this possible? 🧵 www.pnas.org/doi/10.1073/...

pnas.orgEvolving general cooperation with a Bayesian theory of mind | PNASTheories of the evolution of cooperation through reciprocity explain how unrelated self-interested individuals can accomplish more together than th...
View full thread

Finally, when we tested it against memory-1 strategies (such as TFT and WSLS) in the iterated prisoner's dilemma, the Bayesian Reciprocator: expanded the range where cooperation is possible and dominated prior algorithms using the *same* model across simultaneous & sequential games.

Quantifying the cooperative advantage shows why humans, the most sophisticated cooperators, also have the most sophisticated machinery for understanding the minds of others. It also offers principles for building more cooperative AI systems. Check out the full paper! www.pnas.org/doi/10.1073/...

pnas.orgEvolving general cooperation with a Bayesian theory of mind | PNASTheories of the evolution of cooperation through reciprocity explain how unrelated self-interested individuals can accomplish more together than th...

Our new paper is out in PNAS: "Evolving general cooperation with a Bayesian theory of mind"! Humans are the ultimate cooperators. We coordinate on a scale and scope no other species (nor AI) can match. What makes this possible? 🧵 www.pnas.org/doi/10.1073/...

pnas.orgEvolving general cooperation with a Bayesian theory of mind | PNASTheories of the evolution of cooperation through reciprocity explain how unrelated self-interested individuals can accomplish more together than th...
View full thread

In dyadic repeated interactions in the Game Generator, the Bayesian Reciprocator quickly learns to distinguish cooperators from cheaters, remains robust to errors, and achieves high population payoffs through sustained cooperation.

Our new paper is out in PNAS: "Evolving general cooperation with a Bayesian theory of mind"! Humans are the ultimate cooperators. We coordinate on a scale and scope no other species (nor AI) can match. What makes this possible? 🧵 www.pnas.org/doi/10.1073/...

pnas.orgEvolving general cooperation with a Bayesian theory of mind | PNASTheories of the evolution of cooperation through reciprocity explain how unrelated self-interested individuals can accomplish more together than th...
View full thread

Instead of just testing on repeated prisoners' dilemma, we created a "Game Generator" which creates infinite cooperation challenges where no two interactions are alike. Many classic games, like the prisoner’s dilemma or resource allocation games, are just special cases.

Our new paper is out in PNAS: "Evolving general cooperation with a Bayesian theory of mind"! Humans are the ultimate cooperators. We coordinate on a scale and scope no other species (nor AI) can match. What makes this possible? 🧵 www.pnas.org/doi/10.1073/...

pnas.orgEvolving general cooperation with a Bayesian theory of mind | PNASTheories of the evolution of cooperation through reciprocity explain how unrelated self-interested individuals can accomplish more together than th...
View full thread

Classic models of cooperation like tit-for-tat are simple but brittle. They only work in specific games, can't handle noise and stochasticity and don't understand others' intentions. But human cooperation is remarkably flexible and robust. How and why?

Our new paper is out in PNAS: "Evolving general cooperation with a Bayesian theory of mind"! Humans are the ultimate cooperators. We coordinate on a scale and scope no other species (nor AI) can match. What makes this possible? 🧵 www.pnas.org/doi/10.1073/...

pnas.orgEvolving general cooperation with a Bayesian theory of mind | PNASTheories of the evolution of cooperation through reciprocity explain how unrelated self-interested individuals can accomplish more together than th...

Max Kleiman-Weiner reposted

As always, CogSci has a fantastic lineup of workshops this year. An embarrassment of riches! Still deciding which to pick? If you are interested in building computational models of social cognition, I hope you consider joining @maxkw.bsky.social, @dae.bsky.social, and me for a crash course on memo!

Cognitive Science Society@cogscisociety.bsky.social

#Workshop at #CogSci2025 Building computational models of social cognition in memo 🗓️ Wednesday, July 30 📍 Pacifica I - 8:30-10:00 🗣️ Kartik Chandra, Sean Dae Houlihan, and Max Kleiman-Weiner 🧑‍💻 underline.io/events/489/s...

Very excited for this workshop!

Cognitive Science Society@cogscisociety.bsky.social

#Workshop at #CogSci2025 Building computational models of social cognition in memo 🗓️ Wednesday, July 30 📍 Pacifica I - 8:30-10:00 🗣️ Kartik Chandra, Sean Dae Houlihan, and Max Kleiman-Weiner 🧑‍💻 underline.io/events/489/s...

LLMs learn beliefs and values from human data, influence our opinions, and then reabsorb those influenced beliefs, feeding them back to users again and again. We call this the "Lock-In Hypothesis" and develop theory, simulations, and empirics to test it in our latest ICML paper!

Excited to speak about some new work on Bayesian Cooperation at this workshop! Join us virtually

Daniel Cooney@danielcooney1.bsky.social

I am really happy to share information about the 2nd Workshop on Modeling and Applications of Evolutionary Game Theory, which will be held virtually on Thursday, May 8, and Friday, May 9. sites.google.com/view/2nd-evo... I enjoyed organizing this workshop with Olivia Chu and Alex McAvoy.

Max Kleiman-Weiner reposted

Our new paper (first one of my PhD!) on cooperative AI reveals a surprising insight: Environment Diversity > Partner Diversity. Agents trained in self-play across many environments learn cooperative norms that transfer to humans on novel tasks. shorturl.at/fqsNN%F0%9F%...

Awesome new work from my lab led by @kjha02.bsky.social scaling cooperative AI! True cooperation requires adapting to both unfamiliar partners and novel environments. Agents trained with CEC get us closer to agents that can act with general cooperative principles rather than memorized strategies.

Kunal Jha@kjha02.bsky.social

Our new paper (first one of my PhD!) on cooperative AI reveals a surprising insight: Environment Diversity > Partner Diversity. Agents trained in self-play across many environments learn cooperative norms that transfer to humans on novel tasks. shorturl.at/fqsNN%F0%9F%...

How AlphaGo like architectures can explain human insight. Out now in Cognition!

Alice Zhang@licezhang.bsky.social

my paper with max, @maxkw.bsky.social, tuomas, and @fierycushman.bsky.social out in cognition at long last www.sciencedirect.com/science/arti... We explain why humans and successful AI planners both fail on a certain kind of problem that we might describe as requiring insight or creativity

Max Kleiman-Weiner reposted