Between this letter and the fact two of the three were first authors on the CoT monitorability paper, it seems likely to me that the employees were fired for leaking the fact that Astra is a lopped transformer to The Information. www.wsj.com/tech/ai/fire...
Post
What's the fuzz about looped transformers? It seems it is just am minor technical optimization, how layers get reused (usually only a second time)? See here -> sebastianraschka.com/blog/2026/op...
sebastianraschka.comOpenAI Astra and Looped TransformersA short note on OpenAI Astra, recurrent depth, looped transformers, Nanbeige 4.2, and the Mixture-of-Recursions paper.
0 reposts5 likes
No replies yet.