Post
'embedded evaluators' my ass, how about a 3rd party auditor from an actually existing regulatory agency with the legal power to demand access to whatever they need, for as long as they need it, while they determine whether you broke the goddamn law
5 reposts13 likes
To understand how AI auditing actually works, & why we need 3rd party (fully independent) auditors, not just 2nd party (contractors) or 1st party (internal teams), please read the 2022 paper Who Audits the Auditors? I coauthored w/ @rajiinio.bsky.social & @poetofcode.bsky.social www.ajl.org/auditors
Our paper was published at the key conference in the field (FAccT), cited hundreds of times, and provides very clear recommendations for policymakers re: how to hold AI companies accountable. facctconference.org/static/pdfs_...