The capabilities of generative artificial intelligence are growing rapidly, and so is the frequency of AI-generated content. The increase in realistic yet fabricated content creates serious concerns regarding the information ecosystem and spread of disinformation.
The Rapid Growth and Disinformation Threat of AI
Generative artificial intelligence is expanding its capabilities at a rapid pace, leading to a significant increase in AI-generated content. This surge in realistic, yet fabricated information poses serious concerns for the information ecosystem and the potential for widespread disinformation, a phenomenon that University of Georgia professor Roger Stahl believes is just beginning.
Social Media's Role in Eroding Trust
Professor Stahl traces the current disinformation problem to the rise of social media around 2010, which decentralized information flow and shifted credibility from established news organizations to personal online followings. AI accelerates this trend by making it effortless to produce synthetic content, further blurring the lines of authorship and diminishing the perceived importance of transparent sourcing.
Underestimated Technical Threats and Detection Challenges
Kyle Johnsen, associate director of UGA’s Institute for Artificial Intelligence, highlights that the rapid evolution of AI means knowledge about its capabilities quickly becomes outdated. He notes that while AI detection tools exist and are improving, they are only effective if users are actively looking for fabricated content, as most people can only discern AI-generated material if specifically scrutinizing it.
Policy Solutions Versus Practical Enforcement
Mandatory labeling of AI-generated content, a policy adopted in Europe's EU AI Act, is a proposed solution. However, Johnsen expresses skepticism about its realism, citing the difficulty of enforcing such requirements, especially against bad actors. Stahl, on the other hand, suggests that the long-term solution lies with established news organizations that possess credibility, clout, and accountability, as they can counter the fractured and insulated information environments created by social media and AI.
