Post

👻Spooky Costanza-Chock
@schock.cc

"Pace the frontier" Makes sense the broligarchs would choose this settler colonial metaphor, since their actual proposal is just a weak sauce columbusing of regulatory authority

👻Spooky Costanza-Chock
@schock.cc

'embedded evaluators' my ass, how about a 3rd party auditor from an actually existing regulatory agency with the legal power to demand access to whatever they need, for as long as they need it, while they determine whether you broke the goddamn law

👻Spooky Costanza-Chock
@schock.cc

To understand how AI auditing actually works, & why we need 3rd party (fully independent) auditors, not just 2nd party (contractors) or 1st party (internal teams), please read the 2022 paper Who Audits the Auditors? I coauthored w/ @rajiinio.bsky.social & @poetofcode.bsky.social www.ajl.org/auditors

ajl.orgWho Audits the Auditors? - Algorithmic Justice LeagueAJL provides the first comprehensive field scan of the AI audit ecosystem in new paper - Who Audits the Auditors? Recommendations from a field scan of the algorithmic auditing ecosystem.

19 reposts41 likes

👻Spooky Costanza-Chock
@schock.cc

Here are the key recs: 1. Require audits for AI system owners and operators. AI auditors are in near-universal agreement (95%) that audits should be a required element of owning and operating AI systems.

👻Spooky Costanza-Chock
@schock.cc

2. Notify individuals when they are subject to algorithmic decision-making. Mandatory notification when individuals are subject to algorithmic decision-making is a widely supported regulatory intervention.

👻Spooky Costanza-Chock
@schock.cc

3. Mandate disclosure of key audit results to external stakeholders. The vast majority of AI auditors (82%) view disclosure of audit results as necessary [..] However, most do not yet disclose audit methods or findings themselves, typically citing client confidentiality concerns.