Misinformation is not a new phenomenon. The architecture that allows it to propagate at scale, faster than correction, is new — and its governance implications are significant.
The Propagation Architecture
The misinformation architecture — the combination of social media platforms' engagement-optimising algorithms, the network dynamics of online information sharing, and the economic incentives of the attention economy — is the infrastructure through which false, misleading, and harmful information propagates at scale in the modern information environment. The architecture's specific contribution to misinformation is not the production of false claims — false claims predate the internet — but the amplification of false claims at speeds and at scales that the correction mechanisms available in any information ecosystem cannot match. The false story that reaches millions of people in hours cannot be effectively corrected by the accurate story that reaches hundreds of thousands of people in days. The asymmetry between propagation speed and correction speed is the architecture's most consequential feature.
The governance of the misinformation architecture is contested in ways that reflect the genuine tensions between the values at stake. The platform's interest in engagement maximisation — which drives the algorithmic amplification that makes misinformation spread faster than accurate information — conflicts with the public interest in an information environment that supports informed democratic participation. The First Amendment's protection of speech — which limits the government's ability to mandate content moderation — conflicts with the governance interest in preventing the specific harms that misinformation produces. And the practical capacity of platforms to moderate content at the scale they operate — billions of pieces of content across multiple languages and cultural contexts — conflicts with the governance interest in consistent, accurate, and fair content moderation.
The misinformation architecture is the information environment that social media's engagement optimisation has built. It is not designed to spread misinformation — it is designed to maximise engagement, and engagement maximisation selects for content that spreads misinformation. The governance challenge is addressing the architecture rather than the specific misinformation it amplifies — which is technically feasible and politically contested.
Discussion