Post

This type of bias can exist with all automated decision making - jev or no jev. NY and other bodies have created solid laws about proving no bias for automated decision making systems for hiring www.nyc.gov/site/dca/abo...

nyc.govAutomated Employment Decision Tools (AEDT) - DCWP
Matt Hodges@matthodges.bsky.social

Very quick and dirty Jev test for hiring bias. One resume for a Wall Street job; asked whether the applicant should get a first-round interview. 76 evaluations, changing only the first name. 19 of each: White-associated men/women, Black-associated men/women. console.typesafe.ai/playground?s...

the proliferation of automated hiring decision tools (even personal ones) is pretty bad. I think it’ll take a high profile case or two to give people the fear like the Workday seniors one. But also human based hiring decisions have a ton of bias too lets be real. I think good automated tools help

On this particular case - its a really really good practice to strip PII before doing some goodness of fit evaluation. For many reasons!!

0 reposts0 likes

Two big challenges with this: 1) Models trained on existing data have been shown to pick up on proxies when you remove directly-inadmissible criteria - eg. you remove race, they pick up on names. Remove names, they pick up on zip codes. Remove zip codes, they pick up on colleges and high schools.

... In societies with existing racial biases, just about everything correlates with race at least a little bit. So yeah, remove the main data points, definitely, but you are not going to remove all sources of bias. 2) Yes people are also biased, and yes they are also systematically biased in

... particular ways (eg. racially) but their biases are somewhat diverse; eg. not every hiring manager is biased for or against the same attributes to the same degree. Use of centralized services for hiring screening means that applicants meet the same small set of biases everywhere they apply -

... this makes some people basically unemployable in a system where all screening is done by a small number of models, whereas in a system with huge number of humans *may* (but is not guaranteed to) give people a chance.