Neil Traft

Neil Traft

@ntraft.bsky.social

PhD student at the Vermont Complex Systems Institute. Interested in ML, evolution, self-organization, & collective intelligence. http://ntraft.com https://t.co/ja3fdtRLdM

442 followers260 following292 posts

Neil Traft reposted

I just had an odd thought: AI "alignment" is like the Halting Problem. Alignment at model training time is obviously not possible, in the same way that a halting decider is not possible: you can't magically know ahead of time whether or not an algorithm will "make a boo-boo".

Neil Traft@ntraft.bsky.social

I was quite bothered that Huggingface didn't sue or seek reparations or anything (afaik?) upon the original event. It's so backwards to think we can guarantee security at model training time (a.k.a. alignment), rather than at deployment time. Security can only come from making ppl accountable.

Neil Traft reposted

Screw-ups should be costly. There should be a high government fine on top of it, plus paying to clean-up and re-secure the systems hacked. These are equivalent to industrial accidents and should be treated as such, imo

Clément Canonne@ccanonne.github.io

"Oh, poor thing, it's costing you *money* to go through the unacceptable mess you have created, unprompted, out of sheer negligence?" www.theguardian.com/technology/2...

Modifying an NCA phenotype with LoRA adapters (showing there are low-dimensional modifications that can scale/skew the resulting image). Bringing together two of my favorite AI concepts, NCAs and PEFT (parameter efficient fine-tuning). 🙂

Mike Levin@drmichaellevin.bsky.social

new #preprint: t.co/eE1qqGSflK Ben Hartl explains: In 1917, D'Arcy Thompson drew Cartesian grids around different anatomical shapes & showed that deforming the grid could change one species' shape into that of another. We find that "reusable regulatory handles control phenotypic variation" in NCAs

Neil Traft reposted

Hilarious anecdote at the end of "Patterns, Predictions, and Actions": Since an income tax appeared too unpopular, King William III created a property tax based on the number of windows in one's house. This worked at first... until people started to brick up their windows. 🙈

Neil Traft reposted

Replying to @stellaathena.bsky.social

A common issue with position papers is that they leave the reader wondering “okay, but what should I actually do”? To address this we provide open problems on a wide variety of topics throughout to illustrate our perspectives and guide future research

Neil Traft reposted

claude code is fucking insane i know literally NOTHING about Hegel. ZERO. and it just built me a complete system of German idealism

Fascinating story: 1. Fear-mongering about peanut allergies multiplies in the late 90s. 2. AAUP advises "no peanuts til age 3", despite NO evidence. 3. This advice CAUSES a massive spike in peanut allergies! 4. They had to do a large study just to undo the damage & convince everyone it was safe!

Ben Recht@beenwrekt.bsky.social

The LEAP RCT on peanut allergies: A randomized trial in which equipoise arose from parental anxiety, not scientific uncertainty.

Astonishing: the default behavior of Chrome's "Listen to this page" feature is NOT to simply read you the page, LIKE YOU WOULD EXPECT, but instead to make one of those goofy NotebookLM AI podcasts... and I had to search the Help docs to figure out how to change it. Thanks, Google.

This is a travesty!! Also I have questions... for the branches that aren't terminated, where will they move? Will they be in the same building, under a different name? In which case, will it all be functionally the same thing (but with lots of political disruption)?

Kim Cobb@kimcobb.bsky.social

It is hard to overstate how critical @ncar-ucar.bsky.social is to climate science in the US and around the world. It's the beating heart of our field. Generations of scientists have trained there, and almost everyone I know relies on deep collaborations with NCAR scientists. It's end is unthinkable.

Gov't labs can't say "climate change" in papers, "climate security" is allowed. Maybe those planes that drop sensors into the hurricane can be "cyclone bombers", forecasting is "climate AI", and cap & trade should be called "CarbonCoin". All key tools in the "War on Climate".

Random observation: did you know this?! I knew about how Einstein's general relativity is required to make GPS navigation work, but I'm not as familiar with how quantum mechanics factors into semiconductor technology. Remarkable.

[In considering candidates] "I actually view publication volume completely negatively... I've learned, from experience, that those with a really high volume [don't have a depth of knowledge]." —@abeirami.bsky.social #slowscience FTW

This post is unavailable.

I thought this was a fascinating way to motivate model merging: to be able to *interpolate* between model classes, rather than be forced into discrete choices. (models trained on different datasets, models of different sizes, etc.) "Interpolation and alignment are two sides of the same coin."

This post is unavailable.

Did you know that you could create hybrids across different neural net architectures—*without* updating the weights?? Come check out my poster at the UniReps @unireps.bsky.social workshop at 3:45pm today at #NeurIPS! (Or you can already browse the posters on the wall in 20D throughout the day.) 😃

This post is unavailable.

So stoked to be going to my first #NeurIPS!! It’s crazy that in 10+ years of robotics and AI, I've never been to the great Lollapalooza of Machine Learning. 🥳🎆 I’m presenting my Frankensteinian efforts to stitch together parts of different neural networks! 🧪

Neil Traft reposted

Check out our new work on using low-rank perturbations to make evolution strategies work for billion-parameter models.

bidiptas13.bsky.social@bidiptas13.bsky.social

Introducing 🥚EGGROLL 🥚(Evolution Guided General Optimization via Low-rank Learning)! 🚀 Scaling backprop-free Evolution Strategies (ES) for billion-parameter models at large population sizes ⚡100x Training Throughput 🎯Fast Convergence 🔢Pure Int8 Pretraining of RNN LLMs

What an incredible tool! I think I'll be returning to this a lot over the next month! The most interesting papers might be the ones that seem misclassified or out of place...

Jay Alammar@jayalammar.bsky.social

Inside NeurIPS 2025: The Year’s AI Research, Mapped New blog post! NeurIPS 2025 papers are out—and it’s a lot to take in. This visualization lets you explore the entire research landscape interactively, with clusters and @cohere.com LLM-generated explanations that make it easier to grasp.

It's too easy to write garbage survey papers and get lots of citations. Over time, I've learned to ignore most survey papers and recognize some markers of quality.

Thomas Dietterich@tdietterich.bsky.social

ArXiv has not had an explicit policy on survey papers. In CS we have recently adopted the same policy of requiring successful peer review prior to release. This is because we are inundated with LLM slop surveys intended to boost citation counts.

Neil Traft reposted

The blog post is available: blog.arxiv.org/2025/10/31/a...

blog.arxiv.orgAttention Authors: Updated Practice for Review Articles and Position Papers in arXiv CS Category – arXiv blog
Thomas Dietterich@tdietterich.bsky.social

Arxiv has long had a policy of not releasing opinion pieces (which covers a substantial fraction of position papers). We lack the moderation capacity to assess the quality of individual position papers, so we recently adopted a policy of requiring all such papers to pass peer review first.

Neil Traft reposted

It's been 8 months since I notified @springernature.com of a clear-cut case of fake references in a book chapter which they published. They have still not taken any action as they claim to still be investigating. I will not review for Springer again until this matter is satisfactorily resolved.

"Consider another human difference: financial solvency, which can be measured and quantified, just like IQ. It is heritable in twin studies and (less so) in SNPs. But would you bet that sooner or later we are going to know 'what’s going on' with your bank account at the level of genes?" Same for IQ.

Eric Turkheimer@ent3c.bsky.social

In 2018, Charles Murray challenged me to a bet: "We will understand IQ genetically—I think most of the picture will have been filled in by 2025—there will still be blanks—but we’ll know basically what’s going on." It's now 2025, and I claim a win. I write about it in The Atlantic.

At #AutoML25, Dr. Manuela Veloso calls for 3 major directions for AI research: 1) AI must know what it doesn't know (uncertainty). 2) AI must be able to continually improve (continual learning). 3) AI systems must include humans at all times to be more robust (automation is always only partial).