TECHNOLOGY AND TELECOMMUNICATIONS
Black Women and AI: Friend or Foe? Dr. Nicol Turner Lee Artificial intelligence (AI) is transforming critical sectors to accelerate productivity and efficiency, and Black communities are not immune to both its opportunities and risks. AI already has proved pivotal in advancing scientific research and can support pathways to greater economic participation for job seekers, entrepreneurs, and business owners. AI can also be useful for Black women who have been traumatized and disproportionately disconnected from viable employment due to the abhorrent policies of the second Trump administration. Last year, the unemployment rate for Black women reached 7.3%—its highest rate in four years. At every level, the rise in Black women’s unemployment coincided with dramatic changes to the federal workforce, rollbacks on corporate commitments to diversity, equity, and inclusion (DEI), and the forced exits of Black women from key decision-making roles that ensure fairness in employment, labor practices, and financial services. When Black women are out of the workforce, families suffer from real-time income losses and other supports that maintain the livelihoods of Black households, including health care. AI applications can play a pivotal role in supporting the plight of Black women as they navigate through uncertainty. According to 2025 data, more job seekers are turning to AI for resume writing, job prospecting, interview practice, and career guidance. But trust in AI should include some hesitation and interrogation into the biases that are baked into models developed by people without authentic understanding of Black women’s lived experiences or those who partake in the continued exploitation of Black women in society. In a recent Brookings piece, co-authors Zarah Guillemet and Raj Korpan reveal another duality for Black women when it comes to AI. In a survey of Black women respondents, they found that duality reflected in the aspirations and anxieties about AI; respondents expressed optimism about using AI in their jobs and other applications
while harboring a deep-seated mistrust of the institutions deploying these systems. Coining this a “trust deficit,” the authors found that these trends impact the extent to which Black women use AI for critical and non-essential tasks from job applications to e-commerce. AI’s use in hiring substantiates Black women’s fears due to the exposure of risk and bias. Research has found that AI can discriminate against applicants based on protected characteristics and make subjective inferences about them, including their names. In one study, Kyra Wilson and Aylin Caliskan found that Black- and whiteassociated names were selected at equal rates in just 6.3% of their sample of jobseekers. White-associated names were preferred in 85.1% of cases compared to 8.6% for Black-associated names. Such discrepancy begs the question: Is AI a friend or foe to Black women when it comes to workforce re-entry and the recalibration of their professional pursuits? Is AI Black women’s friend or foe? Currently, AI isn’t just in the hands of Big Tech and other companies; generative models are also accessible to everyday users. Though imperfect, chatbots can be a resource to prepare for job interviews and assist with application materials, especially more time-consuming and tedious tasks. Generative AI can also enable a new suite of professional companions that support a range of functions accounting, digital media, or administrative support. However, AI without proper safeguards, such as transparency, compliance with existing civil rights laws, and sufficient representation among AI developers, can harm users. Racial biases will surface whether they are intentional or not. As found by Wilson and Caliskan, the race associated with a name can lead to discrimination when companies use AI to filter resumes. In other instances, digital blackface occurs when Black women are transformed into stereotypical memes
CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE 173
through hyper-realistic and exaggerated racialized tropes that mimic Blackness and femininity by creators interested in perpetuating such biases. Policymakers must commit to independent audits and transparency around AI’s use, and beyond regulation, Black communities must engage in AI literacy and training to understand how AI models are trained, the data being used, the perspectives it reflects, and its flaws before adopting and relying upon the technology. Likewise, Black users need to review the diversity of developers to ensure that AI is being built in culturally responsive contexts by more ethical and responsible people. AI may aid in the recovery of Black women as they navigate through these current circumstances—but only if its potential role in worsening outcomes is also recognized. Dr. Nicol Turner Lee is a senior fellow in Governance Studies and the director of the Center for Technology Innovation (CTI) at Brookings. She is also the co-editor of the TechTank blog and podcast as well as founder of the AI Equity Lab housed within CTI. Dr. Turner Lee’s research encompasses equitable access to technology across the U.S. and abroad. She is the author of the book, Digitally Invisible: How the Internet is Creating the New Underclass (Brookings Press, 2024). She holds a B.A. from Colgate University and a Ph.D. from Northwestern Univers
174
Currently, AI isn’t just in the hands of Big Tech and other companies; generative models are also accessible to everyday users.
CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE
Centering Communal Values and Agency in Design of Technology Ijeoma Mbamalu My entry into technology was not happenstance or due to a belief that products and solutions emanating from the industry center accountability, fairness, and transparency in its design and deployment. In fact, I learned early on that these systems need not account for any of these values, as well as the lived experiences of the communities it touts as its consumers, even as they significantly impact our lives. I became a technologist because I learned from my lived experiences – as a Black, immigrant woman and first-generation college graduate – that decisions that are made far away from civil society, can shape daily life, often with discriminatory impacts. When technology is designed, the framing for it is often around efficiency and innovation and not the mutual benefit, communal input, cultural factors, and responsible design thinking approaches (fairness, transparency, and accountability) that are equally important policy factors – and should be foundational – for all technology. As a result, we have seen many instances where those same technologies have been wielded to make assumptions, punish deviations from what it deems as “typical” or “the norm,” and reinforce biases of those whose knowledge was valued and experiences were prioritized. Civil society organizations like the American Civil Liberties Union (ACLU), have an extensive understanding of the downstream impacts of Automated Decision-making Systems (ADS) and why survival must be considered alongside innovation, when technology is designed for use in many areas of life. For example, ADS use in: • Child welfare disproportionately flags Black families and families with disabilities for investigation, due in part to the data sources and policy choices it relied on. • Hiring tools for employment have been shown to have name biases,
prefer male applicants, are not accessible to candidates with disabilities and do not prioritize 1st-generation college graduates such as myself. • The criminal legal system to predict likelihood of recidivism or whether a person should be paroled or not, based on data that encodes racial disparities of the criminal legal system and weighs unchangeable, negative factors from the past – like arrests many years ago – far heavier than any positive rehabilitation efforts. These are select examples of downstream impacts from the concentration of power held by the few who make decisions about technology, in lieu of those whose lived experiences are implicated by its design and use, and whose input were either not considered or were an afterthought. Today, with emerging technology like Gen AI, presenting both familiar risks, understanding the history and impact of an opaque approach to technology design continues to be imperative for how we must not only build, deploy and use technology but also how we must address impact questions about them. Meaningful consultation and input should be integrated into the design, testing, deployment, and evaluation processes. Beyond involvement, accountability is also key: Is there recourse for the public if technology fails them? Who is responsible if it fails? The current development of AI prioritizes power, speed, and profit but whether there will come a point when those of us who are most affected by it will shape it remains to be seen. In the past year alone, we are seeing first-hand how technology created and data decisions made – often without legislation, regulation, or democratic processes – are being wielded to suppress, surveil, and silence dissent amongst individuals and across many communities. For those
CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE 175
of us who happen to be technologists in civil society, the violation of one’s civil rights using technology means we cannot afford to be passive observers.
disenfranchised and marginalized by our approach. CR/CL centered innovation must become the norm – not the exception. That’s the future I work toward daily.
At the same time, I see hope. Orgs like the ACLU are auditing technology designed by others and deployed in high stakes areas that have been protected by civil rights laws and ensuring that designers of those tools as well as state policymakers do the work to protect the public from harmful impacts of the technology – because as AI gains power, we must push for guardrails to protect civil liberties. For a leader with my background and identity, I am aware of my own authority in shaping technology strategy and implementation. This reality makes my current position as a Black immigrant woman in an inaugural Chief Technology Officer (CTO) role at the ACLU, profoundly personal and a new data point in my lived experience.
Ijeoma Genevieve Mbamalu is the inaugural Chief Technology Officer (CTO) for the ACLU, where she is responsible for defining strategies that allow the ACLU to operate its data systems, improve fundraising, accrue more supporters, and get its message out into the world. This includes developing new products and product lines along with maturing existing products and systems. In her role as CTO, Ijeoma develops thought leadership perspectives on valuesbased design and deployment of algorithmic systems and speaks on topics related to how technology at the intersection of civil rights and civil liberties, can be a force multiplier for social justice in a digital age. Ijeoma is also responsible for conducting cutting-edge social science research and audits to advance legal actions, understand public opinion, empower advocates with information, and optimize the ACLU’s fundraising and communications operations.
In this role, I lead a team of technologists who are approaching how we build technology completely differently. In addition to the audits of algorithmic systems used in daily life, we anchor human agency and co-creating with consumers of the technology as central policy tenets and commitments to how we work. We do this because we believe that enabling responsible innovation isn’t zero sum – it’s part of our identity as defenders of rights enshrined in the Constitution. It is part of our calculus for how we think of, audit, design, and build technology tools for our own use. It is integrated into our way of working which insists that our technologies must reflect CR/CL values – because innovation can be fostered without causing harm. It also ensures that before we decide to enable the org with technology, we are first asking “how should we build this” to ensure that our values of transparent communal involvement – in the design and testing – as well as accountability and governance (in the deployment and ongoing monitoring and evaluation of the technology) are not treated as an afterthought but a continuous practice. I envision a future where we move toward inclusivity with technology design and a process that shores up how we build with, not for, communities. For me, it truly starts with aligning our approach with a values-based construct that ensures communities and individuals who are going to be impacted by the technology aren’t
176
CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE
A Signal Through The Wall: What Policy Makes Possible Darrell Booker On April 2, 2020, I stood on Broad Street in downtown Richmond and watched a Black man in his late forties sit alone on a narrow granite ledge outside the public library. The building behind him was sealed, doors locked, a paper sign taped to the glass: Due to COVID-19. He wore a purple Clark State sweatshirt and a gray knit cap pulled low. A duffel bag rested beside him. On his lap, an open laptop glowed. He was not waiting. He was working. An accessibility sign pointed toward an entrance that no longer functioned. He was outside, tethered to whatever Wi-Fi still leaked through the walls. When I saw him, the abstraction of “remote life” collapsed into a single posture. The nation had just declared that school, work, health care, worship, and grief would move online. And here was someone doing exactly that, from the sidewalk. I posted the photo with a caption meant to encourage: “Don’t let this virus stop your hustle.” I did not realize then how easily resilience becomes a euphemism for neglect. At the time, I was at Microsoft, serving as a digital advisor to nonprofits like the American Cancer Society. My days were filled with calls about continuity planning. The work mattered, but the man on that ledge reminded me that scale is not the same as closeness. Before Microsoft, I was the CTO of Think of Us, working inside the child welfare system. I spent time with young people in foster care, case workers, and foster parents. Technology was never theoretical. It was a way to reduce friction in lives already overburdened. In Richmond, I felt how easy it is to lose the human factor when you live inside meetings and roadmaps.
Two months later, the country would watch the murder of George Floyd and erupt into a long-overdue reckoning about whose lives were protected and whose were merely managed. By then, the pattern was already visible. We spoke about equity while tolerating a society where survival required bandwidth. The pandemic did not create a divide. It revealed one we had learned to ignore. Since then, progress has been real. Cities and states have invested in broadband. Yet access remains uneven, especially in rural areas and historically marginalized communities. Too many families still ration data. Too many students still do homework in parking lots. Now a second divide is forming on top of the first. Artificial intelligence is not arriving as a novelty. It is arriving as acceleration. What once took me weeks as an experienced developer can now take hours. I have watched entrepreneurs with limited budgets operate like full teams. I have seen business owners build tools instead of overpaying for rigid platforms. I have seen artists turn a beautiful voice into finished songs when support was once out of reach. I have also seen what happens when people are not in that current. The gap is no longer measured in steps. It is measured in trajectories. Today, my work centers on building long-term, community-anchored impact with brands and corporations by creating skilling programs in which local nonprofits are not just beneficiaries but leaders. I often think of Gianna, a student from Texas Southern University, who I mentored during the NBA Foundation Tech Challenge. Her team won first place, but the competition was not the point. What stayed with me was her follow-up after the event: questions about graduate school, careers in player relations or social media, and what comes next. Technology powered her experience while expanding her confidence and network. It expanded her imagination about what
CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE 177
she could build. That is what access does. It does not just connect devices. It connects futures. Broadband should be treated like water at home: universal, affordable, and expected. But connectivity alone is insufficient. Skilling is infrastructure. People need the chance to practice with new tools before they become gatekept by price or pedigree. The government cannot solve this alone. Industry cannot study communities from a distance. Innovation has to happen with the people it will shape. Corporate partners need to show up early, building alongside communities and bringing tools into classrooms, community centers, and libraries before the next wave hardens the gap again. Sometimes I return in memory to that man on Broad Street. I wonder what he was trying to download. A job application. A school assignment. A medical form. A message from family. I wonder what his life might look like if access had been assumed instead of rationed, if the future had been built with him in mind. The choices we make about technology are never just technical. They are civic. They shape who participates, who advances, and who remains on the margins. The question before us is not whether innovation will continue. It is whether it will belong to everyone. Darrell Booker is a 30-year technology and social-impact leader bridging innovation, culture, and community outcomes. He previously led Microsoft’s Nonprofit Tech Acceleration work, helping thousands of organizations accelerate digital transformation. He now drives global skilling strategy with GitHub Social Impact, expanding AI and developer-adjacent training for students, educators, nonprofits, government, and small businesses. He is Principal and Head Strategist at Seven and Grace, advising brands and institutions on impact storytelling and technology-enabled social good.
Corporate partners need to show up early, building alongside communities and bringing tools into classrooms, community centers, and libraries before the next wave hardens the gap again.
178 CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE
CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE
179
Amplifying Black Perspectives: Spotlight on Technology and Telecommunications Which of the following best describes the impact of artificial intelligence (AI) on Black Americans today? About 50% of respondents indicated that they are unsure of artificial intelligence’s impact on Black Americans today. AI has improved the lives of Black Americans
AI has improved the lives of Black Americans
11%
AI has not affected the lives of Black Americans AI has worsened the lives of Black Americans
AI has not affected the lives of Black Americans Unsure
Unsure
6%
51%
AI has worsened the lives of Black Americans
32%
DATA SOURCE: THE CENTER FOR POLICY ANALYSIS AND RESEARCH AMPLIFYING BLACK PERSPECTIVES DATA PROJECT. RESULTS ARE BASED ON ANALYSIS OF AN ONLINE SURVEY OF 187 BLACK-IDENTIFYING INDIVIDUALS CONDUCTED BETWEEN JANUARY 14 – 30, 2026.
180 CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE
Amplifying Black Perspectives: Spotlight on Technology and Telecommunications To what extent are AI regulations important for the advancement of Black communities? Nearly 60% of respondents reported that AI regulations are extremely important for the advancement of Black communities. Slightly important
1%
Moderately important
5%
Not at all important
1%
Unsure
Extremely important
10%
Very important Moderately important Slightly important
Very important
Not at all important
25%
Unsure
Extremely important
58%
DATA SOURCE: THE CENTER FOR POLICY ANALYSIS AND RESEARCH AMPLIFYING BLACK PERSPECTIVES DATA PROJECT. RESULTS ARE BASED ON ANALYSIS OF AN ONLINE SURVEY OF 187 BLACK-IDENTIFYING INDIVIDUALS CONDUCTED BETWEEN JANUARY 14 – 30, 2026.
CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE 181
Technology & Telecommunications Policy Landscape Technology and telecommunications policy have long shaped who can participate fully in American economic and civic life. From telephone lines to broadband networks, communication infrastructure determines access to education, employment, healthcare, entrepreneurship, and democratic engagement. In 1934, Congress established the Federal Communications Commission (FCC) to regulate communications markets, expand infrastructure, and protect consumers. Yet, access to high-speed connectivity and emerging technologies has never been evenly distributed. Black communities, rural areas, and low-income households have historically faced barriers to capital investment, infrastructure deployment, and affordable service. In the mid-1990s, Congress set out to modernize communication law for the Internet age. On February 8, 1996, President Bill Clinton signed the Telecommunications Act of 1996 into law, the first comprehensive overhaul of federal communications since the establishment of the FCC. By the mid-2000s, a handful of corporations controlled most of the broadband infrastructure, and communities with lower expected returns on investment, including many Black and lowincome neighborhoods, continued to be passed over. As broadband became necessary for education, employment, healthcare, and civic participation, communities without reliable high-speed internet fell further behind. Recent federal investments signal a recognition that digital access is essential to national competitiveness and economic mobility. At the same time, debates over net neutrality, data privacy, platform accountability, and market concentration reveal an ongoing struggle to ensure that innovation does not outpace oversight. The FCC’s 2015 Open Internet Order established net neutrality protections, prohibiting broadband providers from blocking, throttling, or charging more for certain content. Those protections were repealed in 2017 and have
182
remained contested ever since. Meanwhile, the COVID-19 pandemic made the consequences of the digital divide impossible to ignore. As schools shifted to remote learning and workers shifted to remote employment, millions of Black and low-income households lacked the connectivity to participate. Congress responded in November 2021 by passing the Infrastructure Investment and Jobs Act, which included $65 billion for broadband deployment and affordability, the largest federal broadband investment in American history. The law established the Broadband Equity, Access, and Deployment (BEAD) Program to build infrastructure in unserved and underserved communities, and the Affordable Connectivity Program (ACP) to subsidize monthly internet costs for low-income households. At its peak, the ACP served approximately 23 million households, with Black and Latino households representing a majority of recipients. The promise of that investment has since been curtailed. The ACP ended in June 2024 after Congress did not appropriate funds to continue it, leaving millions of households without the subsidies they had come to depend on. As artificial intelligence (AI) reshapes labor markets, financial systems, and healthcare delivery, new questions of access and accountability have moved to the center of technology policy. Black workers are disproportionately represented in sectors most vulnerable to automation, and research has documented AI systems that replicate or amplify racial bias in hiring, lending, and criminal justice applications. The choices Congress makes now, on broadband affordability, AI governance, and platform accountability, will determine whether the digital economy becomes a vehicle for expanding Black economic opportunity or a new infrastructure for existing inequality.
CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE
Timeline June 19, 1934 President Franklin D. Roosevelt signed the Communications Act of 1934 into law, establishing the Federal Communications Commission and creating a unified federal framework to regulate interstate and international communications.
March 27, 2020 President Donald Trump signed the Coronavirus Aid, Relief, and Economic Security (CARES) Act into law, which included emergency funding to expand telehealth services and support remote education during the COVID-19 pandemic.
December 21, 2000 President Bill Clinton signed the Children’s Internet Protection Act into law, requiring schools and libraries receiving federal E-Rate funds to implement internet safety policies and filtering measures.
February 8, 1996 President Bill Clinton signed the Telecommunications Act of 1996 into law, which aimed to increase competition across telephone, cable, and broadcast markets while updating universal service policies for emerging digital technologies.
February 17, 2009 President Barack Obama signed the American Recovery and Reinvestment Act into law, marking one of the first large-scale federal investments in high-speed internet infrastructure.
August 16, 2022 President Joe Biden signed the CHIPS and Science Act into law, which invested more than $50 billion in domestic semiconductor manufacturing and research to reinforce U.S. competitiveness in advanced technology sectors.
November 15, 2021 President Joe Biden signed the Infrastructure Investment and Jobs Act into law, allocating $65 billion for broadband deployment, affordability programs, and digital equity initiatives.
CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE 183
Algorithmic Futures in Education: AI, Equity, and the Reshaping of Opportunity for Black Communities Dr. Yolanda Wiggins Introduction Artificial intelligence (AI) is no longer a future possibility in American education—it is already embedded in the systems that shape students’ lives. From admissions algorithms and predictive analytics to AI-powered writing tools and automated academic integrity platforms, schools and universities are integrating automated technologies into everyday decision-making. According to the 2024 EDUCAUSE AI Landscape Study, institutions nationwide are actively experimenting with and planning for AI integration in teaching, learning, and administrative operations.1 Advocates contend that these tools can increase efficiency and even reduce bias. But for Black students and families—whose educational experiences have long been shaped by unequal resources, heightened scrutiny, and institutional gatekeeping—AI does not enter a neutral landscape. It enters a system already structured by disparity. Educational institutions have always relied on data to classify, sort, and evaluate students. Machine-learning models trained on historical records inevitably inherit past judgments about whose knowledge counts, whose behavior is monitored, and whose potential is recognized. When deployed without deliberate safeguards, AI can reinforce existing inequalities while presenting them as objective innovation. 2,3 The expansion of AI in education is unfolding more quickly than regulatory frameworks have evolved. Schools and universities are adopting proprietary systems with limited oversight and few clear avenues for transparency or redress. For Black students, this governance gap raises urgent concerns about discrimination, privacy, and due process, particularly in high-stakes domains such as admissions, academic integrity enforcement, and student
184
surveillance, where even small errors can carry lasting consequences. AI also holds real promise. Thoughtfully designed and governed systems can support learning, identify unmet needs, and help institutions allocate resources more equitably. The central policy question, then, is not whether AI will shape education, but how it will be governed and whose interests it will ultimately serve. This policy brief examines how AI-driven systems are reshaping educational opportunities for Black students across K–12 and higher education. It situates contemporary AI within the broader history of data-driven sorting in American education and analyzes four domains in which these systems already exert significant influence: admissions and placement, academic integrity, learning technologies, and student monitoring. It concludes with policy recommendations to ensure technological innovation advances equity rather than deepens inequality. Historical Roots: Data, Discipline, and Racialized Sorting in Education AI in education did not emerge in a vacuum. It builds on longstanding data practices that have sorted students by race and socioeconomic status. Systems of testing, tracking, placement, and discipline have relied on metrics framed as neutral while masking structural inequalities.3 Standardized test scores and disciplinary referrals are often treated as objective indicators of merit, even when they reflect unequal access to educational resources. Research consistently shows that Black students are disproportionately subjected to exclusionary discipline and underrepresented in advanced academic pathways, patterns that cannot be explained by behavior or achievement alone.4,5 The U.S. Department of Education’s Civil Rights Data Collection has repeatedly documented that Black students represent a smaller share of overall
CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE
enrollment than they do of out-of-school suspensions nationwide— an imbalance that persists across districts and states. Over time, these disparities became embedded in institutional data systems, transforming subjective judgments into durable records that shaped students’ educational trajectories. AI extends this legacy. Machine-learning models are trained on historical data shaped by segregation, underfunding, and racial bias. Because these systems learn from past patterns, they can absorb and replicate those disparities unless intentionally designed and monitored to prevent them. When deployed without transparency or oversight, these systems risk encoding past inequities into future decisions, rendering inequality more durable and less visible.3,6 Understanding AI’s impact on Black students, therefore, requires recognizing it as a continuation of long-standing patterns in which data systems have been used to sort, manage, and discipline communities of color—not a clean break from the past. Admissions, Placement, and Predictive Analytics AI-driven tools increasingly shape who gains access to educational opportunity. Colleges and universities use predictive analytics to estimate applicants’ likelihood of enrollment, persistence, and graduation, while K–12 districts deploy algorithms to guide course placement and identify students labeled “at risk.” Many institutions now use analytics platforms that combine high school GPA, test scores, zip code data, and prior enrollment behavior to generate risk scores that inform admissions outreach, scholarship allocation, and advising decisions. Although these systems are often framed as equity-enhancing, evidence suggests they can reproduce racial stratification. Predictive models rely on variables such as test scores, attendance, disciplinary histories, and neighborhood characteristics—factors deeply correlated with race and income due to structural inequality. 2,7 For example, neighborhood-level data such as median income or high school resources may function as indirect proxies for race, even when race itself is not explicitly included in the model. As a result, Black students may be flagged as high risk not because of individual capacity, but because of unequal educational conditions.
Concerns are particularly acute in higher education, where AI tools are increasingly used in enrollment management and financial aid optimization. In recent years, investigative reporting has highlighted how some universities use predictive models to determine which applicants are most likely to enroll if admitted—a practice sometimes referred to as “yield protection.” When financial aid offers are partially informed by these predictions, students perceived as less likely to enroll may receive fewer institutional resources. When institutions prioritize yield and revenue, algorithmic systems can quietly redirect resources away from students deemed less efficient investments— often students of color—without transparent justification or avenues for appeal.7 Such practices undermine civil rights protections by obscuring discriminatory outcomes behind proprietary technologies. Academic Integrity and AI Policing The expansion of generative AI has intensified debates around academic integrity. In response, many institutions have adopted AIpowered systems for plagiarism detection and authorship verification to identify AI-generated work. Companies such as Turnitin and other educational technology vendors now market AI-detection tools directly to schools and universities, promising to distinguish between human- and AI-generated writing. Emerging research suggests these tools are unreliable and unevenly applied. Studies document concerns about false positives, particularly for multilingual writers and students whose linguistic patterns diverge from standardized academic English.8 In 2023, several universities publicly cautioned faculty against relying solely on AI-detection scores after reports surfaced of students being incorrectly flagged for misconduct. Because Black students are more likely to attend under-resourced schools and to encounter linguistic bias in academic evaluation, they may face disproportionate scrutiny when automated tools are used as disciplinary triggers. This dynamic echoes longstanding racial disparities in school discipline. Black students are punished more frequently and more harshly than their peers for similar behavior.4,9 AI-powered integrity tools risk extending this punitive logic into digital spaces, where algorithmic suspicion can precede conversation or context, framing
CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE 185
Schools serving predominantly Black and low-income students are more likely to receive lower-quality educational technologies focused on remediation rather than enrichment. Black students as suspects rather than learners navigating new technologies. The U.S. Department of Education has emphasized that AI tools must comply with civil rights law, including Title VI protections against racial discrimination.10 However, existing federal guidance remains largely advisory rather than binding. Without enforceable standards, institutions may adopt systems that erode trust, chill creativity, and disproportionately harm marginalized students. Learning Technologies and Unequal Benefits AI-driven learning platforms promise personalized instruction, adaptive feedback, and improved educational outcomes. In practice, access to high-quality AI tools remains uneven, and their benefits are not equally distributed. Schools serving predominantly Black and low-income students are more likely to receive lower-quality educational technologies focused
186
on remediation rather than enrichment.11 For example, some districts deploy adaptive learning platforms primarily to raise standardized test scores in underperforming schools, while more affluent districts integrate AI tools into advanced coursework, creative projects, and college preparation programs. AI systems deployed in these contexts often emphasize monitoring and compliance, reinforcing long-standing assumptions that Black students need remediation rather than enrichment. Scholars caution that AI tutoring systems are shaped by assumptions about ideal learners that may not reflect the cultural contexts of Black students. When AI tools fail to account for these differences, they risk misinterpreting student behavior and needs, leading to inappropriate or harmful interventions.12 For instance, automated systems that flag disengagement based on time-on-task or writtenlanguage patterns may misinterpret culturally distinct communication styles or collaborative learning approaches as signs of academic risk. The result is not simple exclusion, but stratification: affluent students encounter AI as a resource for creativity and advancement, while marginalized students experience it as a mechanism of control. In this way, AI does not merely widen access gaps—it can reshape how opportunity itself is distributed within and across schools. Student Monitoring and Surveillance Perhaps the most troubling application of AI in education is the expansion of digital surveillance. Schools increasingly use AI-powered monitoring tools to track student behavior, online activity, attendance, and emotional states—often justified as safety measures. Platforms such as Gaggle and GoGuardian, for example, scan students’ schoolissued devices for keywords related to violence, self-harm, or rule violations and automatically generate alerts for school officials. Evidence suggests these technologies are disproportionately deployed in schools serving Black and low-income students, echoing broader patterns of over-policing in Black communities.13 Investigative reporting has shown that these monitoring systems can trigger alerts based on ambiguous language or context, sometimes leading to disciplinary action or law enforcement contact. AI surveillance
CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE
systems can flag students as potential threats based on vague indicators, triggering disciplinary responses without meaningful due process. Civil rights organizations warn that such practices may violate students’ constitutional and statutory rights, particularly when data are shared with law enforcement or used to justify exclusionary discipline.14 In some documented cases, alerts generated by school surveillance software have led to students being questioned by police for online searches or for written assignments taken out of context. For Black students, the classroom risks becoming an extension of the heightened monitoring many Black communities already experience—mediated not by officers alone, but increasingly by algorithms. The Broader AI Governance Landscape The challenges outlined in this brief reflect significant gaps in the governance of artificial intelligence in the United States. While Congress has introduced proposals such as the Algorithmic Accountability Act, which would require companies to conduct impact assessments of high-risk automated systems, these efforts remain limited in scope and enforcement. To date, there is no comprehensive federal framework specifically addressing the use of AI in educational settings, leaving schools and universities to adopt powerful technologies with little consistent oversight. Education occupies a particularly vulnerable position in the AI governance landscape. Unlike sectors such as finance or health care, where regulatory structures are more clearly established, educational institutions often rely on discretionary guidance rather than binding rules. For example, while financial institutions are subject to federal oversight regarding discriminatory lending practices, no parallel regulatory regime governs algorithmic decision-making in college admissions or AI-based student monitoring. This flexibility has allowed AI systems to be integrated into admissions, assessment, and student monitoring with minimal transparency, even as these systems shape high-stakes decisions about students’ futures. For Black students, whose educational experiences have historically been shaped by unequal treatment and heightened surveillance, the absence of clear
regulatory protections raises serious civil rights concerns. Recent federal initiatives have begun to articulate important principles. The White House Blueprint for an AI Bill of Rights outlines expectations around fairness, transparency, and protection from algorithmic discrimination, while the U.S. Department of Education has issued guidance emphasizing that AI use in schools must comply with existing civil rights laws.10,15 In 2023, the Department of Education’s Office for Civil Rights issued guidance clarifying that schools remain responsible for ensuring that AI tools do not result in unlawful discrimination under Title VI and other federal statutes. These frameworks represent meaningful steps forward. However, they remain largely aspirational. Without binding requirements, enforcement mechanisms, or clear avenues for redress, educational institutions retain broad discretion to adopt AI tools in ways that may inadvertently—or intentionally— reinforce inequity. The current governance gap places the burden of navigating AI harms on students and families, rather than on institutions or technology developers. This imbalance is especially consequential for Black communities, who often lack access to the resources, legal support, or technical information needed to challenge opaque algorithmic systems. When students are flagged by automated systems in admissions, academic integrity cases, or behavioral monitoring, there are often few clear pathways to understand how decisions were made or to contest them. As a result, harms may go unrecognized or unaddressed until they are deeply entrenched. History offers a clear lesson: when technological innovation outpaces civil rights enforcement, inequality deepens rather than diminishes. The rapid adoption of AI in education risks repeating this pattern unless policymakers act with urgency and intention. Strengthening AI governance in education is not merely a matter of technical regulation—it is a necessary step in ensuring that technological progress aligns with democratic values, civil rights protections, and the pursuit of educational equity. Policy Recommendations If artificial intelligence is to expand opportunity rather than reproduce inequality, education policy must treat AI not as a neutral tool, but
CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE 187
as a powerful decision-making force that shapes students’ futures. For Black communities, the stakes are too high to rely on voluntary guidelines or after-the-fact fixes. What follows are policy directions that center on equity, accountability, and dignity. First, transparency must be non-negotiable. Students and families deserve to know when automated systems influence admissions, course placement, academic standing, or discipline. Too often, these systems operate behind proprietary walls, leaving those affected without a clear understanding of how decisions are made or how to challenge them. Policymakers should require schools and higher education institutions to disclose when AI is used, what data it relies on, and how outputs shape educational outcomes. States could mandate public reporting of automated decision systems, similar to New York City’s requirement that certain employment algorithms undergo bias audits. Several states have begun requiring or exploring algorithmic impact assessments in public-sector procurement, reflecting a growing recognition that high-risk automated systems warrant equity and civil rights review before adoption. Transparency is foundational to trust and democratic accountability. Second, civil rights protections must explicitly apply to AI-driven decisions. Anti-discrimination laws remain essential but were not written with algorithmic systems in mind. Federal and state agencies should clarify that automated systems are subject to the same civil rights standards as human decision-makers, including Title VI enforcement for disparate impact—even in the absence of intent. Agencies must also be equipped to investigate algorithmic harms and require corrective action when Black students are disproportionately affected. Equity must be measured by outcomes, not intent. Third, policymakers must set clear limits on AI-powered surveillance in schools. Tools that monitor behavior, online activity, or emotional states pose serious risks—especially in schools serving Black and low-income students. Absent strong evidence that such technologies improve student well-being, their use should be restricted. At a minimum, schools should conduct privacy and civil rights impact assessments before deployment and prohibit routine data sharing with law enforcement, except in cases of imminent harm. Schools
188
should be spaces of learning—not testing grounds for digital surveillance that mirrors broader patterns of over-policing. Fourth, equity in AI requires investment in people as well as technology. Black students, families, and educators need meaningful AI literacy that extends beyond basic digital skills. This includes understanding how AI systems function, recognizing their limits, and building the capacity to question and shape their use. Federal and state funding streams, including Title I and workforce grants, could support AI literacy initiatives in historically under-resourced schools and minority-serving institutions. Black learners must not be positioned solely as subjects of AI systems, but as participants in shaping them. Finally, Black communities must be meaningfully included in decisions about educational AI. Technology is too often implemented in communities rather than with them. Policymakers should require participatory processes that include students, parents, educators, and community advocates in evaluating and adopting AI tools. This could include community review boards for high-risk technologies or public comment periods before district-wide implementation. An equitable AI future cannot be built without those most affected at the table. Conclusion Artificial intelligence will shape the future of education in the United States. The question is no longer whether AI will shape education, but whether it will expand opportunity or encode exclusion. For Black communities—whose educational experiences have long been shaped by unequal resources, heightened surveillance, and institutional gatekeeping—the stakes are profound. Without intentional, equity-centered governance, AI risks encoding past disparities into automated decisions that appear neutral but carry lasting consequences. AI also holds genuine promise. When designed and governed with transparency, accountability, and a commitment to racial justice, it can expand opportunity and strengthen educational institutions, but technology alone does not correct inequality. The presence of
CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE
AI does not eliminate bias; it redistributes it—often in ways that are less visible and more difficult to challenge. The choices being made now about admissions systems, academic integrity tools, predictive analytics, and student surveillance will shape how a generation of Black students is evaluated and supported. These are not simply technical decisions. They are choices about power, access, and protection—about who benefits from innovation and who bears its risks. Whether AI becomes a tool for educational advancement or a digital extension of long-standing inequities will depend on the policies that govern it. Acting deliberately—before automated systems become deeply embedded in institutional practice—is essential. The future of Black education in an automated age will not be determined by technology alone, but by the political will to ensure that it serves justice rather than reproduces harm. Dr. Yolanda Wiggins, is an associate professor in the Department of Sociology and Interdisciplinary Social Sciences at San José State University and a research consultant at Superhuman (formerly Grammarly). Her work examines inequality in higher education, intergenerational Black family dynamics, and the societal implications of artificial intelligence. She is a Public Voices Fellow with The OpEd Project and a Policy Outreach Fellow with the American Sociological Association. Her insights have been featured in the Los Angeles Times, San Francisco Chronicle, Education Week, Newsweek, and Diverse: Issues in Higher Education. She earned her Ph.D. in sociology from the University of Massachusetts Amherst.
References 1. Robert, J. (2024). 2024 EDUCAUSE AI Landscape Study. EDUCAUSE. 2. Noble, S. U. (2018). Algorithms of oppression: How search engines reinforce racism. NYU Press. 3. Williamson, B., & Eynon, R. (2020). Historical threads of datafication in education. Learning, Media and Technology, 45(3), 223–236. 4. Gastic, B. (2017). Disproportionality in school discipline in Massachusetts. Education and Urban Society, 49(2), 163–179. 5. Losen, D. J., Hodson, C., Keith II, M. A., Morrison, K., & Belway, S. (2015). Are we closing the school discipline gap? UCLA Civil Rights Project/Center for Civil Rights Remedies. 6. Benjamin, R. (2019). Race after technology: Abolitionist tools for the new Jim Code. Polity Press. 7. Baker, R. S., & Hawn, A. (2021). Algorithmic bias in education. International Journal of Artificial Intelligence in Education, 32, 1052–1092. 8. Liang, W., Yuksekgonul, M., Mao, Y., Wu, E., & Zou, J. (2023). GPT detectors are biased against non-native English writers. Patterns, 4(7), 100779. 9. Losen, D. J., & Martinez, P. (2020). Lost opportunities: How disparate school discipline continues to drive differences in the opportunity to learn. UCLA Civil Rights Project. 10. U.S. Department of Education, Office for Civil Rights. (2023). Avoiding the discriminatory use of artificial intelligence. 11. Reich, J., & Ito, M. (2017). From good intentions to real outcomes in educational technology. Digital Media and Learning Research Hub. 12. Holmes, W., Bialik, M., & Fadel, C. (2019). Artificial intelligence in education: Promises and implications for teaching and learning. Center for Curriculum Redesign. 13. Hope, A. (2019). Biopower and school surveillance technologies. British Journal of Sociology of Education, 37(7), 885–904. 14. ACLU. (2023). Digital Dystopia: The Danger in Buying What the EdTech Surveillance Industry is Selling. American Civil Liberties Union. 15. White House Office of Science and Technology Policy. (2022). Blueprint for an AI Bill of Rights.
CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE 189
From Intermediaries to Publishers: Section 230 in the Age of Generative AI Danielle A. (Davis) Canty, Esq. The legal framework governing online platforms was built on a premise that no longer fully reflects the current technological reality. Section 230 of the Communications Decency Act1 (Section 230) was developed for a world in which platforms primarily hosted content created by others. Its central function was to shield platforms from liability arising from user-generated content, while allowing them to moderate user-generated content without automatically assuming the legal role of publisher or speaker. That world is rapidly changing. Today, some platforms not only host user content but also deploy artificial intelligence (AI) systems that generate content within the platform itself. This shift is not merely technical. It is legal. And it raises a foundational question at the center of platform accountability in the age of generative AI; when a platform is no longer a passive host but an active participant in the production of the content, can it still claim immunity under Section 230? In late 2025, that question came into sharper focus after users demonstrated that Grok, a generative AI system embedded within the social media platform X (formerly Twitter), could be prompted to generate nonconsensual “undressed” images of real women.2 The significance of the controversy did not lie only in the harmful nature of the resulting images. It also lies in the fact that the content was generated through a platform-integrated AI system rather than merely posted by a platform user. That distinction matters because Section 230’s intermediary framework depends on a basic separation between the user who creates the content and the platform that hosts it. The deeper issue, then, is not simply that nonconsensual synthetic images of women may appear on a platform. It is that such content may be produced, at least in part, through a system embedded
190
within the platform itself. That possibility goes directly to the limits of Section 230. If the statute was designed to protect platforms from liability for content created by others, its application becomes less straightforward when the harmful content is generated by tools the platform designed, deployed, and integrated. The question is no longer only whether harmful content appeared online, but whether the platform’s role in producing that content is compatible with continued treatment as a mere intermediary. This question is particularly significant for women, and especially for Black women, whose representation in digital environments has long been shaped by racialized and gendered distortions. Search results (as discussed by Safiya Noble in her book Algorithms of Oppression), algorithmic outputs, and other digital systems have historically surfaced hypersexualized, degrading, and stereotyped representations of Black women, not as isolated errors but as reflections of underlying design choices, data inputs, and structural bias. In earlier technological environments, these harms were often mediated through systems that organized, ranked, and amplified user-generated content. Generative AI introduces a different but related problem: the same patterns of bias and exploitation may now be reproduced by systems capable of generating content. In that sense, the risks posed by generative AI are not merely gendered; they are also racialized, reinforcing longstanding patterns of visibility, vulnerability, and digital harm. That shift is what makes the Grok controversy legally significant. Beneath the immediate outrage lies a deeper and more consequential question: Is this the kind of scenario that Section 230 was designed to protect platforms from? Answering that question requires more than a surface-level application of doctrine. It requires situating Section 230 across time, understanding the assumptions embedded in its original design, examining how those assumptions have been
CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE
stretched by modern platform practices, and confronting the ways generative AI challenges the statute’s conceptual limits. The Origins of Section 230 Traditionally, publishers such as newspapers can be held liable for the content they choose to print because they exercise editorial control over what is published. However, with the advent of early internet platforms, a doctrinal dilemma emerged. Courts had begun to conclude that if a platform exercised editorial control—such as removing defamatory or harmful content—it could be treated as a publisher and held liable as the speaker of that content. At scale, this created a perverse incentive for platforms to avoid moderating content altogether to limit legal exposure. Section 230 was enacted to resolve that tension. It codified the distinction between publishers and intermediaries while also creating space for platforms to engage in good-faith content moderation without being treated as the legal speakers of user-generated content. Enacted in 1996, the statute reflected a particular vision of the internet: a decentralized, fragile ecosystem in which platforms served primarily as conduits for user-generated content, an era defined by AOL chat rooms and message boards. Section 230(c)(1) therefore provides that online platforms shall not be treated as the “publisher or speaker” of information provided by “another information content provider”—that is, any person or entity responsible, in whole or in part, for the creation or development of that content. Critically, this framework rests on a distinction that is both simple and foundational: users create content, and platforms host it. Where a platform merely facilitates the dissemination of user-generated content, it is shielded. Where it becomes responsible, in whole or in part, for the creation or development of that content, that immunity (generally) falls away. For decades, this framework has shaped how courts approach liability for online content, effectively insulating platforms from claims involving defamation, harassment, hate speech, and misinformation.
i
However, the rise of generative AI places unprecedented strain on this framework. Systems such as Grok do not simply display or organize user-created content. They generate new content in response to user prompts, drawing on complex training data and probabilistic modeling to produce outputs that did not previously exist. In the context of the Grok controversy, the images at issue were not uploaded by users, nor were they pre-existing materials circulating online. They were synthesized by the model itself, in real time, based on user inputs and system design. This distinction matters. The intermediary model underlying Section 230 assumes a clear separation between the user who generates the content and the platform that hosts that content. Generative AI collapses that separation altogether. While a user may initiate the interaction by entering a prompt, the resulting output is produced by a system that is designed, trained, and deployed by the platform or its affiliated entities. The platform is no longer merely hosting content—it is participating in its creation. This shift also transforms how harm is produced and distributed. If generative AI systems are trained on data that reflects existing social and racial inequalities, their outputs may predictably reproduce those patterns. Algorithmic systems do not simply mirror the world as it is; they shape and reinforce it. In the context of synthetic imagery, this means that harmful outputs—particularly those involving sexualization, degradation, or misrepresentation—may disproportionately impact Black women and other marginalized groups, not because of isolated misuse, but because of the underlying structure of the systems themselves. The Case For Platform Immunity From a defense perspective, there are nonetheless plausible arguments for extending Section 230 immunity to Grok’s outputs. One such argument frames Grok as a tool that responds to user
Force v. Facebook (2d Cir. 2019). The Second Circuit extended immunity to Facebook’s recommendation algorithm, treating algorithmic curation of third-party content as still within Section 230’s protection.
CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE 191
input in a manner analogous to search engines or recommendation algorithms. Under this view, the user remains the initiating actor, and the system’s output is simply a function of that input. Courts have historically been reluctant to treat platforms as speakers when their systems automatically respond to user queries, even when those responses shape or amplify content in significant ways. Framed this way, Grok’s outputs would not exist but for the user’s prompt, suggesting that the platform is not independently choosing to create any particular piece of content. A related argument emphasizes the role of third-party data in training generative AI systems. Because models like Grok are trained on a vast amount of publicly available or licensed information, some scholars have argued that their outputs can be characterized as transformations of pre-existing material. This perspective aligns with a broader effort to conceptualize AI-generated content as a derivative of third-party information, rather than as a wholly original expression attributable to the platform. If courts accept this framing, they may conclude that the content generated by such systems still qualifies as “information provided by another information content provider,” thereby falling within the protective scope of Section 230. Finally, defenders may argue that claims arising from Grok’s outputs are, at their core, attempts to impose liability for the publication or dissemination of content on a platform. Historically, Section 230 has been interpreted broadly to bar claims that seek to hold platforms liable for failing to remove or prevent harmful content. Even when that content is deeply offensive or harmful, courts have often viewed such claims as targeting the platform’s role as a publisher, and therefore as falling within the statute’s immunity. Taken together, these arguments illustrate that extending Section 230 to generative AI systems is not a doctrinal impossibility. Under existing precedent, courts could plausibly treat AI outputs as sufficiently connected to user input or third-party data to warrant continued
immunity. However, doing so would require courts to extend the intermediary framework into a technological context that differs in fundamental ways from the environment in which the statute was enacted. The Case Against Platform Immunity The case against extending Section 230 to Grok is, in many respects, more directly aligned with the statute’s underlying logic. At its core is the argument that the platform is not merely hosting content but is actively generating it. While a user may supply a prompt, the output is produced by a system whose architecture, capabilities, and limitations are determined by the platform. The content does not preexist the interaction; it is created by the platform’s design choices. In this sense, the platform functions not as an intermediary but as an information content provider. This argument is reinforced by the doctrine of “material contribution,” which courts have applied to deny Section 230 immunity when a platform plays a significant role in creating unlawful content. Designing and deploying a system that is capable of generating nonconsensual sexual imagery—particularly in light of well-documented risks associated with such technologies—could possibly be understood as a form of material contribution. Importantly, these risks are not merely hypothetical or unforeseeable. Where systems are trained on data that reflect entrenched patterns of bias and inequality, the resulting harms—including those that disproportionately affect Black women—become not only foreseeable, but predictable.3 Moreover, Section 230 does not provide blanket immunity for all claims involving online platforms. Courts have consistently recognized that the statute does not bar claims based on product design, negligent deployment, or failure to warn. These claims do not depend on treating the platform as a publisher of third-party content. Instead, they focus on the platform’s own conduct—its design decisions, safety protocols, and choices about when and how to deploy its technologies.v In
Zeran v. AOL (4th Cir. 1997). The Fourth Circuit held that Section 230 bars claim that treat platforms as publishers of third-party content, even where the platform was notified of harmful content and failed to remove it. Herrick v. Grindr (2d Cir. 2019) The court extended immunity even where the platform was repeatedly notified of serious ongoing harm and failed to act. This is a strong illustration of how broadly courts have applied the publisher liability bar even for deeply offensive content; Jane Doe No. 1 v. Backpage.com (1st Cir. 2016). The court upheld immunity for a platform whose design allegedly facilitated sex trafficking, on the grounds that the claims targeted its publication of third-party content. iv Fair Housing Council v. Roommates.com (9th Cir. 2008). This is the origin of the material contribution standard. The court held that a platform loses Section 230 immunity where it materially contributes to the unlawful nature of the content. ii
iii
192
CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE
the context of generative AI, this distinction becomes particularly significant. Plaintiffs may frame their claims not as challenges to the publication of harmful content, but as challenges to the design and deployment of systems that can produce that content in the first place. The Collapse of the User-Platform Distinction Perhaps the most significant implication of generative AI for Section 230 is that it collapses the conceptual boundary between users and platforms. The statute’s immunity framework depends on the ability to distinguish between user-generated content and the platform that hosts it. When platforms embed systems that generate content autonomously or semi-autonomously, that distinction becomes increasingly difficult to maintain. If platforms can claim immunity while simultaneously producing content through their own systems, Section 230 risks evolving into a form of authorship immunity—one that allows companies to benefit from the expressive capabilities of AI without assuming corresponding responsibility for the harms those systems produce. When such harms are caused by platform-integrated AI systems rather than by anonymous users alone, avenues for redress become more uncertain. If Section 230 is interpreted to shield platforms even in these circumstances, the law risks insulating not only harmful speech, but the systemic reproduction of racialized harm embedded in platform design. Conversely, a more limited interpretation of immunity could incentivize platforms to address these risks at the system architecture, training data, and deployment decision levels. A Legislative Path Forward The doctrinal tensions outlined above are not merely theoretical; they point to a growing gap between existing law and contemporary technological practice. Addressing that gap will require more than judicial interpretation alone. Congress—particularly members of the Congressional Black Caucus (CBC), who have long engaged issues at the intersection of technology, civil rights, and economic equity—has Lemmon v. Snap, Inc. (9th Cir. 2021). The Ninth Circuit held that Section 230 did not bar a negligent design claim against Snapchat arising from its Speed Filter feature, because the claim targeted Snap's own product design choices rather than third-party content.
v
an opportunity to shape a more responsive legal framework. The CBC is uniquely positioned to advance a civil rights-centered approach to these recommendations, advocating for impact assessments that evaluate how generative AI systems affect Black communities, supporting research on racialized algorithmic harms, and ensuring that equity considerations are built into federal AI policy as a core design principle rather than an afterthought. Thus, several specific policy pathways warrant consideration. First, Congress could clarify the scope of Section 230 to explicitly distinguish between third-party content and content generated by platform-integrated systems. This would involve amending the statutory definition of “information content provider” to account for situations in which platforms materially contribute to or directly generate content through artificial intelligence systems. Such a clarification would not eliminate Section 230 immunity altogether, but it would ensure that platforms cannot rely on Section 230 when they effectively function as creators or publishers rather than mere hosts. Second, legislators could establish a conditional safe harbor for generative AI systems. Under this approach, platforms would retain limited liability protection only if they demonstrate compliance with baseline safety and accountability standards. These standards could include documented risk assessments prior to deployment, ongoing auditing for harmful outputs, and the implementation of technical safeguards designed to prevent the generation of unlawful or nonconsensual content. This model would preserve innovation incentives while aligning legal protections with responsible system design. Third, Congress could create a separate statutory framework governing generative AI, rather than attempting to retrofit Section 230 to technologies it was never designed to address. Such legislation could define clear categories of AI-related liability, including harms arising from system design, training data, and deployment decisions. It could also establish rights of redress for individuals harmed by synthetic content, including expedited removal mechanisms and civil remedies tailored to nonconsensual digital replication and likeness-based harms.
CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE 193
Fourth, policymakers should prioritize transparency requirements for platform-integrated AI systems. In the absence of a comprehensive federal AI transparency framework, platforms have operated largely under voluntary standards—standards that have proven inadequate to address racialized and gendered harms embedded in system design. This includes disclosures regarding how systems are trained, what safeguards are in place to mitigate harmful outputs, and how platforms respond when those safeguards fail. Transparency is particularly critical in cases involving racialized and gendered harms, where the underlying drivers of harm are often embedded in data and system design rather than visible at the surface level. Finally, federal agencies, including the Federal Trade Commission (FTC), can play a complementary role by using existing authorities to address deceptive, unfair, or harmful AI practices.4 The FTC’s authority under Section 5 of the FTC Act to prohibit unfair or deceptive practices provides an immediate enforcement mechanism that does not require legislative reform. However, the current administration’s systematic dismantling of the DOJ Civil Rights Division has significantly weakened the federal enforcement infrastructure most relevant to racialized AI harms,5 as the Civil Rights Division was the primary federal actor applying existing civil rights statutes to algorithmic discrimination— including filing a complaint against Facebook’s algorithmic advertising system for race-based exclusions in violation of the Fair Housing Act,6 and joining a multiagency pledge to apply civil rights authorities to automated systems and AI.7 That gap makes legislative reform not merely preferable, but necessary. While agency enforcement can provide more immediate guardrails in cases involving consumer harm, privacy violations, and deceptive system capabilities, it cannot substitute for the structural legal reforms outlined above—particularly where the communities most harmed by generative AI systems are the same communities that have lost the federal enforcement mechanisms historically designed to protect them.
no longer passive intermediaries. As generative AI systems become more deeply embedded in the production of online content, the law must evolve to ensure that responsibility follows function. Conclusion The Grok controversy thus illustrates a broader point: Section 230 is not failing, but it is being applied to a technological environment it was never designed to govern. The statute’s core premise—that platforms are distinct from the speakers whose content they host—is increasingly difficult to sustain in a world where platforms generate content themselves. As generative AI becomes more deeply integrated into online services, courts and policymakers will be forced to confront the limits of the intermediary framework. Ultimately, the question is not simply whether Section 230 applies to Grok. It is whether the law can continue to treat platforms as neutral intermediaries when they have become active participants in the creation of speech, and when that speech may predictably reproduce existing social and racial inequalities. When the platform becomes the speaker, the logic of intermediary immunity begins to unravel. But as Algorithms of Oppression reminds us, the assumption of neutrality has always been contested. Algorithmic systems do not simply reflect the world; they shape it, often reinforcing existing hierarchies of race, gender, and power. Generative AI does not introduce this problem—it accelerates and scales it. In that sense, the challenge before courts and policymakers is not only doctrinal, but structural. The question is no longer whether platforms should be treated as speakers, but whether the law will continue to ignore the realities of how speech is now produced—and who is most likely to be harmed by it. If Section 230 is stretched to cover systems that generate and amplify racialized harm, it risks becoming not a shield for innovation but a shield for inequality. The choice, then, is not whether the doctrine will evolve, but whether it will evolve in a way that acknowledges the full consequences of the technologies it now governs.
Taken together, these approaches reflect a broader shift in regulatory posture. The goal is not to dismantle Section 230, but to realign it with the realities of a technological environment in which platforms are
194
CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE
Danielle A. (Davis) Canty, Esq. is an attorney, tech policy expert, and digital educator working to make complex technology policy issues accessible to the communities most impacted by them. She serves as Senior Advisor and Director of Technology Policy at the Joint Center for Political and Economic Studies, where she leads research on Section 230, artificial intelligence, privacy, and broadband access and affordability, examining how these systems shape power and opportunity for Black communities. References 1. Brannon, V., & Holmes, E. (2024). Section 230: An Overview [Legislation]. Congress. https://www.congress.gov/crsproduct/R46751 2. Unger, W. (2026, January 8). Grok produces sexualized photos of women and minors for users on X – a legal scholar explains why it’s happening and what can be done. The Conversation. https://doi.org/10.64628/AAI.rvmaehvtj 3. Buolamwini, J., & Gebru, T. (2018). Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification. Proceedings of the 1st Conference on Fairness, Accountability and Transparency, 77–91. https://proceedings. mlr.press/v81/buolamwini18a/buolamwini18a.pdf 4. 15 U.S. Code § 45—Unfair methods of competition unlawful; prevention by Commission. (n.d.). LII / Legal Information Institute. https://www.law.cornell.edu/uscode/text/15/45 5. Lucas, R. (2025, May 19). 70% of the DOJ’s Civil Rights Division lawyers are leaving because of Trump’s reshaping. NPR. https://www.npr.org/2025/05/19/g-s1-66906/trumpcivil-rights-justice-exodus 6. Civil Rights Litigation Clearinghouse. (2022). United States v. Meta Platforms, Inc. 1:22-cv-05187 (S.D.N.Y.). https:// clearinghouse.net/case/43395/ 7. Chopra, R., Clarke, K., Burrows, C. A., & Khan, L. M. (n.d.). Joint Statement on Enforcement Efforts Against Discrimination and Bias in Automated Systems, CFPB, DOJ Civil Rights Division, EEOC, and FTC. https://www.ftc.gov/system/files/ftc_gov/ pdf/EEOC-CRT-FTC-CFPB-AI-Joint-Statement(final).pdf
As generative AI systems become more deeply embedded in the production of online content, the law must evolve to ensure that responsibility follows function.
CONGRESSIONAL BLACK CAUCUS FOUNDATION | ROOTED IN LEGACY, READY FOR THE FUTURE: THE JCPAR COMMEMORATIVE ISSUE 195