Home

Donate
Perspective

In Post-Authenticity AI Age, Knowledge Institutions Matter More than Ever

John Wihbey / Nov 12, 2025

This perspective is part of a series of provocations published on Tech Policy Press in advance of a symposium at the University of Pittsburgh's Communication Technology Research Lab (CTRL) on threats to knowledge and US democracy.

OpenAI launched Sora 2, its latest video generation model, on September 30, 2025.

The threat of deepfakes is well established. Scholars have argued that synthetic media is a challenge to privacy norms, democratic governance, and national security and examined its social effects and impact on information integrity. Yet these analyses must increasingly take on the challenge of a cultural shift: mounting evidence that large segments of online audiences no longer care whether content is authentic. While the proposed solutions which have garnered the most attention are technical in nature, these are unlikely to fix a challenge rooted in eroding institutions of knowledge. At the same time, the public is increasingly distrustful or indifferent to those institutions. This puts solutions even further out of reach.

This indifference reflects not an inability to detect fakes but a waning concern for authenticity itself. When emotionally resonant or politically convenient narratives circulate, truth often becomes secondary. We appear to be entering a post-authenticity era in which the distinction between genuine and synthetic content loses its ability to constrain belief or guide action.

The power and ease of generative AI applications to produce photorealistic content at virtually no cost fuels this headlong rush toward a new epistemic situation. Memes, parodies, satires, and weaponized campaigns often blur the lines between deepfake and ironic, but malicious, attacks on truth and factual reality. Yes, many considered society to be racing toward a “post-truth” situation as of a decade ago, but we lacked scalable technologies that could so easily mimic reality. Many online users now may increasingly operate in a hybrid state of knowing and gullibility, entranced by the sheer interesting-ness of fake content that, in spirit, seems genuinely real, because it confirms beliefs, conforms to priors, or just appears to be a logical extension of online narratives.

The standard response to synthetic media has been technical—blockchain provenance systems, authentication protocols, watermarking, and detection algorithms. These tools presume that once authenticity can be verified, citizens will adjust their judgments accordingly. But that logic fails when audiences ignore authenticity markers or distrust the institutions behind them. The challenge with deepfakes and synthetic content is less about detection capabilities than about the institutional capacity to make those detections matter. Provenance systems are only as credible as the institutions that validate them and the publics that trust those institutions; a blockchain certificate of authenticity is meaningless if citizens distrust the certifier, misunderstand the technology, or no longer value the distinction it upholds. Our collective epistemic “backstop”—shared norms for evaluating truth—depends on institutional legitimacy, not infrastructure alone.

Unfortunately, the institutions which provide such epistemic backdrops are eroding. Universities, libraries, journalism, and science—all traditional epistemic anchors—face financial and political strain. Social media platforms, meanwhile, have dismantled trust and safety teams, defunded civic integrity work, and embraced generative AI without proportional safeguards.

The result is that AI systems are now flooding networks with synthetic content at scale. The platforms that host it have abdicated responsibility for information quality, and the institutions once tasked with verification lack reach and legitimacy. Engagement-driven business models reward virality and emotion—traits that synthetic media cheaply optimize.

Together, these dynamics amplify AI’s structural risks to democratic knowledge. AI systems are inherently epistemically anachronistic—trained on the past and incapable of modeling the emergent, deliberative character of democracy. As they increasingly mediate what citizens see and believe, they create feedback loops that weaken the cognitive foundations of self-government. We are likely to see consequences as everything from polling to journalism, content moderation to content generation, increasingly rely on AI technologies that favor mean tendencies in the data distribution, crowding out marginal perspectives and creative, emergent, or unorthodox angles and views.

Addressing this crisis requires sustained pressure on social media companies to become active stewards—rather than passive distributors—of authoritative information. Beyond moderation, this means investments by platform companies: subsidizing journalism (at arm’s length), supporting local news ecosystems, prioritizing verified sources, and maintaining human oversight. More dollars in the creator economy should flow to fact-based and nonfiction media efforts. Technical interventions remain vital and plausible but are futile without institutional renewal. Many existing institutional problems, public policy failures, and societal deficits are simply made worse by deepfakes, but perhaps the crisis will finally underscore the need for major redress and could be the catalyst for political change.

Humans are not naturally gullible; we evolved strong mechanisms for evaluating credibility. Yet these depend on an information ecosystem rich in trustworthy institutions and credible choices. To preserve democratic knowledge, those institutions must innovate and compete within the attention economy. The pressing question is whether we can rebuild this epistemic infrastructure before norms of authenticity decay beyond repair.

Authors

John Wihbey
John Wihbey is an associate professor at Northeastern University, where he is a faculty researcher with the Ethics Institute, cofounder of the Internet Democracy Initiative (IDI), and director of the AI-Media Strategies Lab (AIMES). He is author of The Social Fact (2019) and the forthcoming book Gov...

Related

Perspective
The United States is on the Cusp of a Digital Dark AgeNovember 10, 2025
Analysis
Synthetic Media Policy: Provenance and Authentication — Expert Insights and QuestionsMay 2, 2025

Topics