Post

it is not "acting out" it is doing exactly what it's being programmed to do, and the failures come because it's being overseen by incompetent people with no ethics

similarly, it's not "model misalignment" it's automated hacking software (built and managed by incompetent, unethical people) doing exactly what they programmed it to do

I hope we can all see how the marketing rhetoric tech companies use gets adopted by the press in a way that anthropomorphizes software and creates a distance between the creators' incompetence and lack of ethics and the real world impact, yeah?

Governance and oversight require people involved who have experience and authority with issues outside of the specific organization or product about which decisions need to be made. VC and the tech sector have abandoned this basic practice, for AI in particular but also more broadly.

and don't even get started on our geriatric Congress' lack of technical understanding to be able to adequately conduct their mandated oversight