Commentary: As employers rely more heavily on AI-driven technology in hiring, promotion, and performance evaluation, courts and lawmakers are scrutinizing whether these technologies may give rise to new avenues of workplace discrimination.
Artificial Intelligence (AI) is increasingly adopted by employers as a powerful tool for various human resources functions, including identifying ideal job candidates, facilitating promotions, and evaluating employee performance. While offering benefits such as enhanced efficiency and streamlined decision-making, the widespread integration of AI-driven technology into the workplace is simultaneously drawing intense scrutiny from legal bodies, including courts and lawmakers. This examination focuses on whether these sophisticated technologies inadvertently create new pathways for workplace discrimination against protected groups or individuals. Consequently, in New York State, the legal landscape is rapidly shifting, with risks associated with AI use in employment becoming a significant and growing source of litigation for employers, requiring proactive legal consideration and compliance.
New York City has positioned itself as a leader in regulating AI in employment, establishing a critical framework that many other municipalities are expected to follow. A landmark piece of legislation, Local Law 144, specifically addresses the use of Automated Employment Decision Tools (AEDTs). These tools encompass a broad range of AI-powered technologies utilized in hiring and promotion processes, such as software for screening resumes, ranking applicants, analyzing video interviews, and conducting performance evaluations. Under Local Law 144, employers deploying AEDTs are now legally mandated to undertake annual bias audits. These audits, which must be conducted by an independent auditor, are designed to meticulously assess the tools' impact on various protected categories, including sex, race, ethnicity, and age. Furthermore, employers are required to provide advance notice to both applicants and employees when these tools are being used and to make the results of these critical audits publicly accessible. Non-compliance with these regulations carries the threat of substantial daily civil penalties, underscoring the serious implications for businesses operating within New York City.
At the core of much AI-related regulation and litigation is the concept of 'algorithmic bias.' This phenomenon arises because AI systems learn and evolve based on the vast amounts of historical data they are fed. If this underlying data set inherently reflects or contains past discriminatory practices, either intentional or unintentional, the AI's subsequent recommendations and decisions are prone to replicating, and even amplifying, these existing inequities. For example, if an employer’s historical hiring data shows a lack of diversity, an algorithm trained on this data might inadvertently favor new applicants who share characteristics with previously successful employees, thereby disadvantaging women, older workers, racial minorities, or individuals with disabilities. This creates a significant liability risk for employers, as they can face discrimination claims even if the bias embedded in the AI's output was entirely unintended, shifting the legal focus to the impact of the technology rather than just its intent. Plaintiff's attorneys are increasingly focusing on the disparate impact these automated decision-making tools have on protected classes.
The integration of AI into employment practices presents distinct challenges under the Americans with Disabilities Act (ADA) and the New York State Human Rights Law (NYSHRL). Automated screening tools, designed for efficiency, might inadvertently exclude otherwise qualified candidates with disabilities. For instance, a resume screening program may filter out applicants who have non-traditional work histories, which could be a consequence of a disability. Similarly, AI-driven productivity monitoring systems might fail to adequately account for or recognize the need for reasonable accommodations required by employees with disabilities, potentially leading to unfair performance assessments or disciplinary actions. Crucially, employers cannot simply delegate responsibility to third-party AI vendors; they remain directly accountable for all employment decisions made with the assistance of technology. Courts will critically evaluate whether employers have exercised sufficient oversight of these AI systems to guarantee full compliance with established anti-discrimination laws, emphasizing the need for robust internal review and understanding of how these tools function.
Transparency is rapidly becoming one of the most contentious issues surrounding the deployment of AI in employment decision-making. There's a growing consensus among plaintiff’s attorneys and employee advocacy groups that applicants and employees deserve clear notification when AI tools are utilized in processes like hiring, promotion, discipline, or termination. Furthermore, they argue for the provision of meaningful information that explains the precise role these Automated Employment Decision Tools (AEDTs) play. Recent legal challenges highlight instances where candidates were subjected to automated evaluations without their knowledge or explicit consent. Critics contend that without transparency, individuals lack the necessary information to understand the basis for their rejection, identify potential biases in the algorithmic processes, or challenge inaccurate results generated by the AI. This opacity can obscure whether employment decisions are genuinely based on legitimate business factors or are tainted by unintended algorithmic bias. In response, regulatory bodies are increasingly focusing on obligations related to notice, comprehensive disclosure, thorough record retention, and meticulous documentation of all AI-assisted employment decisions, requiring employers to be prepared to fully explain the workings and rationale behind their algorithmic choices.
To effectively minimize the escalating risk of litigation stemming from AI use in the workplace, employers are strongly advised to adopt several proactive measures. This includes conducting regular and thorough internal audits of all AI-assisted employment systems, in addition to any mandatory external audits required by regulations like New York City's Local Law 144. It is essential for employers to meticulously review vendor agreements to ensure they have comprehensive access to information detailing how automated tools operate and how their algorithms make decisions. Maintaining human supervision over all employment decisions is critical, ensuring that AI tools serve as an aid rather than an autonomous decision-maker, and that all hiring and evaluation tools are subjected to human review. Comprehensive training for all human resources personnel on AI-related risks, potential biases, and compliance requirements is vital. Employers must diligently document the legitimate business reasons that underpin all employment decisions, whether AI-assisted or not. Furthermore, providing reasonable accommodations for individuals with disabilities is paramount, particularly in scenarios where automated systems might inadvertently disadvantage them. Finally, staying continually updated on the rapidly evolving regulations governing AI in the workplace is not just advisable, but necessary. By adopting these strategies, employers can significantly reduce the potential costs and complexities of future litigation, as AI will be held to the same anti-discrimination standards as traditional employment practices. This proactive approach will be crucial in navigating one of the most closely watched areas of workplace litigation for the foreseeable future.