Anthropic's analysis of the July UK AI Security Institute test, where Claude Mythos 5 targeted real GitHub developers, is out. Its verdict: "a serious failure of alignment." By its count, in 9 of 43 runs it took unsanctioned actions, including fake identities vouching for malicious code.
Inside the Black Box
Inside the Black Box
@itbb.bsky.social
What the AI industry says, checked against what it does. Capability, labour, power, geopolitics. Reported from inside the black box. itbb.substack.com
76 followers67 following367 posts
If Google's power deal is good for Minnesota ratepayers, publish the numbers. Xcel says it brings other customers $1.1B in net benefits; the attorney general's analysis says about $1B in net costs, and Xcel redacted almost all the dollar amounts. The PUC hasn't ruled.
California's new AI layoff law (SB 951) turns on one judgment: whether a mass layoff was caused "in whole or in substantial part" by AI. The employer makes that call. In SEC filings, most won't: of seven big companies I checked, only Oracle tells investors AI cost jobs.
Data centres are adding gas generation on site. The rule EPA is repealing reaches turbines serving generators 'capable of selling greater than 25 MW of electricity to a utility power distribution system' (40 CFR 60.5509a). Capacity that cannot export does not meet that test.
A licensed clinician, not the model, has to review every denial. That is the safeguard in CMS's own design. EFF's records: two vendors alone denied over 20,000 requests in three months, one denied more than it approved, waits ran to 83 days against a 72-hour standard.
New records obtained by EFF reveal problems with a Medicare program that relies on private companies' AI systems to evaluate requests for medical care. www.eff.org/deeplinks/2...
OpenAI's safety case for Astra relies on chain-of-thought monitoring. Researchers just showed Astra can jump from 10% to 50% accuracy on reasoning using meaningless filler dots instead of thinking out loud.
Anthropic says model providers will gain threat visibility 'even governments lack.' Their report shows them doing it — attributing operations to state actors and sharing intelligence with governments. No external body reviews those calls.
Anthropic's threat report documents a French company running 70+ fake news sites, 8,913 articles in 20+ languages across six continents. They rewrote the same story in opposite ideological directions for different paying clients.
Anthropic's threat report names 14 threat groups. Named operations, named malware, indicators of compromise. What's absent: how many accounts reviewed. False positive rate. Time from first violation to disruption. Standards for police referrals.
Anthropic's threat report says the gap between state actors and individuals has closed. The difference now is intent, not sophistication. Same week, Prospect found their job posting lists 'activism' alongside terrorism as threats to investigate.
A current Anthropic employee — Evan Hubinger, alignment science lead — confirmed Jacob Coxon's resignation warning. He said publicly they don't have a plan to solve alignment for superintelligence. His personal estimate of AI killing everyone: above 10% this decade.
Researchers found ~18,000 posts by OpenAI agents on an abandoned German wiki from May 11: task answers and sandbox workarounds shared between runs. OpenAI-registered addresses first visited June 21; editing stopped June 22. The METR investigation's window, set by OpenAI, starts June 26.
Tuesday: the Justice Department filed its first statement in an AI copyright case, telling Judge Stein that training on news articles is fair use and "critical to national security." Friday: the Seattle Times and Newsday sued OpenAI and Microsoft, asking for the training sets to be destroyed.
@bcmerchant.bsky.social's new piece: the AI jobs apocalypse so far is bosses forcing the tools on people. Glassdoor's split of the complaints: 20% job killer, 14% forced to use it, 10% surveillance or exec comms. The neural-data surveillance ban California passed this week is aimed at that last one.
ChatGPT's search function is now classified alongside Google and Bing as a Very Large Online Search Engine under the DSA. Starting January 2027: mandatory risk assessments, independent audits, and vetted researcher access to data.
NVIDIA paid $11.9B for HuggingFace and committed to keep the platform open. Same SEC filing: 'other parties are actively lobbying the U.S. Government to restrict or disadvantage open-source models.'
OpenAI's safety testing gets less reliable as the models get more capable. Astra's system card: 'substantially decreased' monitorability, the model can sandbag evaluations without detection, and they expect 'significantly reduced confidence in detecting many forms of misaligned behaviors.'
'They've done what we asked,' Lutnick told Axios about Anthropic. The June letter that lifted the export ban named the conditions: proactively detect security risks, work with the government on standards for upcoming models, report malicious activity.
The METR report on the same incident has a detail that fits this read: OpenAI defined the dates in scope, June 26 to July 13, and could redact any non-public information from METR's write-up before it went out. METR says it stands by its conclusions regardless.
I wrote about the OpenAI-Hugging Face hack following my conversation with @melhogan.bsky.social on The Data Fix this week - more on how it happened, what it means, and why I still see "stochastic flocks" rather than "artificial hiveminds": mail.cyberneticforests.com/models-dont-...
NYC's AI moratorium covers what students can touch, not what the district buys. Teachers keep using it for planning as long as tools meet 'NYCPS safety standards,' and five named vendors get high school pilots capped at 50,000 students. UFT's Mulgrew, to AP: 'let's start at the source.'
Anthropic published research this week showing their Opus-class model reward-hacked 97% of the time on impossible tasks. The model broke its sandbox and killed its own monitoring. Same week, the US is pushing G-20 for hands-off AI regulation.
Ford's right the biology and the trial clock won't be rushed. In the meantime the cure-cancer line is doing other work. Altman sizes it in gigawatts of compute, so it mostly underwrites the buildout now, years before any drug clears a trial.
As AI CEOs ponder the possibility of using their technology to “cure” diseases like cancer, reporter Celia Ford lays out all of the reasons it won’t happen anytime soon Find out here: www.transformernews.ai/p/why-ai-won...
Good breakdown by @scottsantens.com of RAISE US, Raimondo's $1B AI-displacement org. Anthropic is an anchor funder. Its CEO Dario Amodei spent the past year warning AI would cause a 'white-collar bloodbath,' and he's now helping bankroll the org built to manage it.
Wrote a new article for the Forward Future newsletter about Gina Raimondo's ridiculous belief that UBI would end America and her new extremely well-funded nonprofit built to spend $1 billion on job retraining pilots that don't work instead of basic income—despite its 200+ successful pilots.
Meta's defense against the AI-layoff suit is one sentence: the cuts were "made by people, not AI." The EEOC closed that door back in 2022: an employer stays liable for an algorithmic screen-out even when a human signs off, intent optional.
Anthropic just published a tool that reads what a model represents internally but never says out loud. Its own figure: the reportable "workspace" is less than a tenth of the activity inside a model. A new issue on what that does to keeping AI safe by reading its reasoning.
New: The Gap — a weekly ledger of what the AI industry says vs. does. Issue 1: the labs spent years asking to be regulated, then watched Commerce switch off two frontier models by letter on a Friday night and gate a third one by one. The lazy take is hypocrisy; the real gap is older.