California suggests taking aim at AI-powered hiring software

Automated HR in the cross-hairs over discrimination law


A newly proposed amendment to California's hiring discrimination laws would make AI-powered employment decision-making software a source of legal liability. 

The proposal would make it illegal for businesses and employment agencies to use automated-decision systems to screen out applicants who are considered a protected class by the California Department of Fair Employment and Housing. Broad language, however, means the law could be easily applied to "applications or systems that may only be tangentially related to employment decisions," lawyers Brent Hamilton and Jeffrey Bosley of Davis Wright Tremaine wrote.

Automated-decision systems and algorithms, both fundamental to the law, are broadly defined in the draft, Hamilton and Bosley said. The lack of specificity means that technologies designed to aid human decision-making in small, subtle ways could end up being lumped together with hiring software, as could third-party vendors who provide the code.

Strict record keeping requirements are included in the proposed law that double record retention time from two to four years, and require anyone using automated-decision systems to retain all machine-learning data generated as part of its operation and training. 

Training datasets leave vendors responsible, too: "Any person who engages the advertisement, sale, provision, or use of a selection tool, including but not  limited to an automated-decision system, to an employer or other covered entity must maintain records of the assessment criteria used by the automated-decision system," the proposed text says. It specifically mentions it must maintain records for each customer it trains models for, too. 

A big target

Applicant tracking systems (ATS) and Recruiting management systems (RMS) are used nearly universally, with one 2021 study finding that more than 90 per cent of businesses use such software to rank and filter candidates. 

That same study suggests that HR software of the kind covered by the proposed California law is one of the reasons why employers are having trouble filling roles, too. The study concluded that data points often serve as proxies for personal traits that an employer may want to filter out, but personality and CV don't always map perfectly, leading to the exclusion of viable candidates. 

Unintentional filtering isn't covered by the newly proposed California law, which focuses on the ways in which software can discriminate against certain types of people, unintentionally or otherwise. 

AI and automation tools have had issues with bias for years. California's newly proposed law offers no solutions, and that could leave California businesses grappling with how to react, if at all. 

Hamilton and Bosley suggest that California employers review their ATS and RMS software to ensure it conforms to the proposal, enhance their understanding of how the algorithms they use function, be prepared to demonstrate that the results of their process is fair and speak with vendors to ensure they are doing what they need to do to comply.

The 45-day public commentary period for the proposed changes is not yet open, meaning there's no timetable for the changes to be reviewed, amended and submitted for passage. ®

Broader topics


Other stories you might like

  • SpaceX: 5G expansion could kill US Starlink broadband
    It would be easier to take this complaint seriously if Elon wasn't so Elon

    If the proposed addition of the 12GHz spectrum to 5G goes forward, Starlink broadband terminals across America could be crippled, or so SpaceX has complained. 

    The Elon Musk biz made the claim [PDF] this week in a filing to the FCC, which is considering allowing Dish to operate a 5G service in the 12GHz band (12.2-12.7GHz). This frequency range is also used by Starlink and others to provide over-the-air satellite internet connectivity.

    SpaceX said its own in-house study, conducted in Las Vegas, showed "harmful interference from terrestrial mobile service to SpaceX's Starlink terminals … more than 77 percent of the time, resulting in full outages 74 percent of the time." It also claimed the interference will extend to a minimum of 13 miles from base stations. In other words, if Dish gets to use these frequencies in the US, it'll render nearby Starlink terminals useless through wireless interference, it was claimed.

    Continue reading
  • DMCA can't be used to sidestep First Amendment, court rules
    Anonymous speech protections apply online too, and copyright can't diminish that

    It's been a good week for free speech advocates as a judge ruled that copyright law cannot be used to circumvent First Amendment anonymity protections.

    The decision from the US District Court for the Northern District of California overturns a previous ruling that compelled Twitter to unmask an anonymous user accused of violating the Digital Millennium Copyright Act (DMCA). 

    The Electronic Frontier Foundation (EFF), which filed a joint amicus brief with the ACLU in support of Twitter's position, said the ruling confirms "that copyright holders issuing subpoenas under the DMCA must still meet the Constitution's test before identifying anonymous speakers." 

    Continue reading
  • Amazon can't channel the dead, but its deepfake voices take a close second
    Megacorp shows Alexa speaking like kid's deceased grandma

    In the latest episode of Black Mirror, a vast megacorp sells AI software that learns to mimic the voice of a deceased woman whose husband sits weeping over a smart speaker, listening to her dulcet tones.

    Only joking – it's Amazon, and this is real life. The experimental feature of the company's virtual assistant, Alexa, was announced at an Amazon conference in Las Vegas on Wednesday.

    Rohit Prasad, head scientist for Alexa AI, described the tech as a means to build trust between human and machine, enabling Alexa to "make the memories last" when "so many of us have lost someone we love" during the pandemic.

    Continue reading

Biting the hand that feeds IT © 1998–2022