Post

Catastrophic failures are rare with frontier models now. People will get used to this and take fewer precautions. But I'd argue that, as these systems become ubiquitous and more powerful, we should actually take more. This morning, Claude happily deleted all the SSH keys on one machine.

Bite Code!

@bitecode.dev

Of course, it was a machine dedicated to Claude, I had a full backup, and the keys were passphrase-protected, so it wasn't a big deal. I've had interns do way worse. I've done way worse myself.

Bite Code!

@bitecode.dev

I wiped an entire production server with a PHP 3 script at my first job. My mentor was really nice about it. The price of learning. And I learned. But consider that these AI systems can perform a thousand actions per second, with an error rate of just 0.2%. That's two fuck-ups per second.

16/10/26, 8:31 am0 reposts1 like

Bite Code!

@bitecode.dev

They make fewer mistakes than humans now, and most of those mistakes are benign. But they make them so much faster, and they're becoming involved in so many things, that guardrails and contingency plans are more important than ever.