Misinformation at Scale: Narratives, Networks, Techniques and Prebunking

Remember from Grade 11

In Grade 11 you separated misinformation, disinformation and malinformation, used SIFT and lateral reading, and learned the who else? test. Those skills check one post at a time.

Grade 12 looks at misinformation at scale: how false content is organized into narratives, spread through networks, and resisted by whole communities. This is evaluation (1.3) plus analysis of perspectives and the questions of power that misinformation raises (1.5).

Hook: the fireplace ban that wasn't

An invented graphic spreads in rural Ontario groups: a logo that looks like a government trillium, the words NOTICE: Wood-burning fireplaces and stoves banned province-wide from January 2027. Fines up to $10,000, and the line Mainstream media won't tell you this. City politicians want to control how you heat your home. SHARE before they delete it!

There is no such ban in this scenario. The provincial government's official news page has no such announcement. But the post gets thousands of shares, and when one is fact-checked, a new version appears: Now they're coming for backyard fire pits.

Narratives, claims and content

• A claim is a specific, checkable statement (a province-wide ban begins in January 2027).
• A narrative is a broader story that gives claims meaning (they are coming for your way of life). Narratives connect to real feelings and values, which makes them durable.
• Content is the many posts, memes and videos that carry the claims.

Fact-checking one claim helps, but the narrative can attach to a new claim. Effective responses address the narrative, the techniques and the real concerns underneath (here, perhaps real worries about heating costs and rural voices being ignored).

Common manipulation techniques

Researchers Jon Roozenbeek and Sander van der Linden built a game called Bad News (2018) to teach techniques often used in disinformation. They include:

• Impersonation: posing as a trusted source (the fake trillium logo).
• Emotional language: fear and outrage (fines up to $10,000).
• Polarization: us versus them (city politicians versus rural people).
• Conspiracy: a hidden plot (before they delete it).
• Discrediting: attacking those who might correct it (mainstream media won't tell you).
• Trolling: provoking people to get reactions.

How false content travels

• Networks and coordination: groups can coordinate fake or misleading accounts to make a message look popular. Platforms call this coordinated inauthentic behaviour. Bots (automated accounts) and sockpuppets (fake identities run by real people) inflate numbers.
• Cheapfakes: simple edits (slowing a video, cutting a quote, a false caption) can mislead as well as deepfakes. Researchers Britt Paris and Joan Donovan used this term in 2019.
• Data voids: when people search for a new or rare term, there may be little reliable content, so manipulators fill the gap. Michael Golebiewski and danah boyd described data voids in 2018.
• The liar's dividend: a term from law professors Bobby Chesney and Danielle Citron. Because fakes exist, people can dismiss real evidence as fake.

Responding: debunking and prebunking

• Debunking corrects a falsehood after it spreads. A useful structure is the truth sandwich (associated with linguist George Lakoff): start with the truth, briefly name the falsehood and the technique, end with the truth again. Researchers once worried that corrections could backfire and strengthen false beliefs; later studies found this is rare, and that corrections usually help.
• Prebunking builds resistance before exposure, by teaching the techniques. It is based on inoculation theory, which psychologist William McGuire developed in the 1960s.

Power and perspective (1.5)

Misinformation raises questions of power: who gains from confusion? Who is targeted? False narratives often scapegoat minority groups, newcomers or people already marginalized, and they can reduce trust in institutions that communities need, such as health services and elections. Analyze who benefits, who is harmed, and whose real concerns the narrative exploits.