Skip to main content
Menu

Main navigation

  • About
    • Annual Reports
    • Leadership
    • Jobs
    • Student Programs
    • Media Information
    • Store
    • Contact
    LOADING...
  • Experts
    • Policy Scholars
    • Adjunct Scholars
    • Fellows
  • Events
    • Upcoming
    • Past
    • Event FAQs
    • Sphere Summit
    LOADING...
  • Publications
    • Studies
    • Commentary
    • Books
    • Reviews and Journals
    • Public Filings
    LOADING...
  • Blog
  • Donate
    • Sponsorship Benefits
    • Ways to Give
    • Planned Giving

Issues

  • Constitution and Law
    • Constitutional Law
    • Criminal Justice
    • Free Speech and Civil Liberties
  • Economics
    • Banking and Finance
    • Monetary Policy
    • Regulation
    • Tax and Budget Policy
  • Politics and Society
    • Education
    • Government and Politics
    • Health Care
    • Poverty and Social Welfare
    • Technology and Privacy
  • International
    • Defense and Foreign Policy
    • Global Freedom
    • Immigration
    • Trade Policy
Live Now

Blog


  • Blog Home
  • RSS

Email Signup

Sign up to have blog posts delivered straight to your inbox!

Topics
  • Banking and Finance
  • Constitutional Law
  • Criminal Justice
  • Defense and Foreign Policy
  • Education
  • Free Speech and Civil Liberties
  • Global Freedom
  • Government and Politics
  • Health Care
  • Immigration
  • Monetary Policy
  • Poverty and Social Welfare
  • Regulation
  • Tax and Budget Policy
  • Technology and Privacy
  • Trade Policy
Archives
  • February 2021
  • January 2021
  • December 2020
  • November 2020
  • October 2020
  • September 2020
  • August 2020
  • July 2020
  • June 2020
  • May 2020
  • April 2020
  • March 2020
  • February 2020
  • January 2020
  • December 2019
  • November 2019
  • October 2019
  • September 2019
  • August 2019
  • July 2019
  • June 2019
  • May 2019
  • April 2019
  • March 2019
  • February 2019
  • January 2019
  • December 2018
  • November 2018
  • October 2018
  • September 2018
  • August 2018
  • July 2018
  • June 2018
  • May 2018
  • April 2018
  • March 2018
  • February 2018
  • January 2018
  • December 2017
  • November 2017
  • October 2017
  • September 2017
  • August 2017
  • July 2017
  • June 2017
  • May 2017
  • April 2017
  • March 2017
  • February 2017
  • January 2017
  • December 2016
  • November 2016
  • October 2016
  • September 2016
  • August 2016
  • July 2016
  • June 2016
  • May 2016
  • April 2016
  • March 2016
  • February 2016
  • January 2016
  • December 2015
  • November 2015
  • October 2015
  • September 2015
  • August 2015
  • July 2015
  • June 2015
  • May 2015
  • April 2015
  • March 2015
  • February 2015
  • January 2015
  • December 2014
  • November 2014
  • October 2014
  • September 2014
  • August 2014
  • July 2014
  • June 2014
  • May 2014
  • April 2014
  • March 2014
  • February 2014
  • January 2014
  • December 2013
  • November 2013
  • October 2013
  • September 2013
  • August 2013
  • July 2013
  • June 2013
  • May 2013
  • April 2013
  • March 2013
  • February 2013
  • January 2013
  • December 2012
  • November 2012
  • October 2012
  • September 2012
  • August 2012
  • July 2012
  • June 2012
  • May 2012
  • April 2012
  • March 2012
  • February 2012
  • January 2012
  • December 2011
  • November 2011
  • October 2011
  • September 2011
  • August 2011
  • July 2011
  • June 2011
  • May 2011
  • April 2011
  • March 2011
  • February 2011
  • January 2011
  • December 2010
  • November 2010
  • October 2010
  • September 2010
  • August 2010
  • July 2010
  • June 2010
  • May 2010
  • April 2010
  • March 2010
  • February 2010
  • January 2010
  • December 2009
  • November 2009
  • October 2009
  • September 2009
  • August 2009
  • July 2009
  • June 2009
  • May 2009
  • April 2009
  • March 2009
  • February 2009
  • January 2009
  • December 2008
  • November 2008
  • October 2008
  • September 2008
  • August 2008
  • July 2008
  • June 2008
  • May 2008
  • April 2008
  • March 2008
  • February 2008
  • January 2008
  • December 2007
  • November 2007
  • October 2007
  • September 2007
  • August 2007
  • July 2007
  • June 2007
  • May 2007
  • April 2007
  • March 2007
  • February 2007
  • January 2007
  • December 2006
  • November 2006
  • October 2006
  • September 2006
  • August 2006
  • July 2006
  • June 2006
  • May 2006
  • April 2006
  • Show More
January 8, 2021 5:07PM

Content Moderation Cannot Fix Elite Failure

By Will Duffield

SHARE

Twitter responded to the Capitol riot by, in a first for the platform, removing two of President Trump’s tweets and imposing a 24‐​hour ban on his account. Facebook followed suit, first banning the president from posting for the next day, and then banning him until he leaves office, while Snapchat indefinitely locked his account.

At this point, however, their decisions are mostly a symbolic gesture. While the president has tweeted false claims of election fraud since November and had posted notice about the planned rally on Twitter, he exhorted the crowd to march on the Capitol from the White House Ellipse.

Mainstream social media moderation has in many ways reached a point of diminishing returns. Those who planned to occupy the Capitol had already been relegated to alternative platforms such as Gab and Parler. Some organized in invitation‐​only spaces, such as Discord groups and messaging services. Crucially, their grievances were supported by an increasingly mature pro‐​Trump media ecosystem, with its own platforms and sources of news.

TheDonald.win, an independent clone of the banned subreddit r/​TheDonald, played a prominent role. Here, rioters encouraged one another and posted photos of their standoffs with the Capitol Police. Despite cutting ties with Reddit, TheDonald.win, isn’t entirely independent – the forum is still reliant on web hosting services provided by other firms. Now TheDonald’s hosting providers have given it an ultimatum – clean up the site or find a new webhost. In a pattern established by content delivery network Cloudflare’s cessation of service to white supremacist website Daily Stormer, spasms of extremism often push moderation decisions to infrastructure providers.

There are, however, real tradeoffs involved in shuttering alternative public platforms. Beyond the reduced opportunities for legal speech, closing TheDonald would likely push its more extreme users into invitation‐​only spaces where surveillance of their activities would be more difficult. Given the frequency with which rioters posted about their participation across alternative platforms, discouraging these opportunities for self‐​incrimination might be unwise. After all, TheDonald’s initial exodus created a less visible community unbound by the broader rules that had restrained their speech on Reddit.

Perhaps more important than the establishment of alternative platforms is the normalization of conspiracy. The media niche pioneered by fringe YouTubers (several of whom took part in the fracas, streaming themselves wandering the halls of Congress in search of content) has been formalized and professionalized. NewsMax, One America News, and a host of elected officials have spent the past two months legitimating baseless claims of a stolen election, constructing an engaging narrative around what would otherwise simply be the rantings of a sore loser.

The most striking example of this malaise is the rapid spread of the claim that antifa infiltrators instigated the riot at the Capitol. Over the course of the evening, a great chain of right‐​wing media personalities and politicians validated and amplified the baseless assertion.

It started with several separate, image‐​driven claims that began circulating mid‐​afternoon. In the first, a tattoo from the video game Dishonored was identified as a hammer and sickle (and evidence of antifa membership)

The misidentified tattoo (left) and the 'Outsider's Mark' from the video game Dishonored (right)

The misidentified tattoo (left) and the ‘Outsider’s Mark’ from the video game Dishonored (right)

In the other, the same tattooed rioter and a compatriot are matched to an image from phillyan​tifa​.org. In its original context, Matthew Heimbach, leader of the Traditionalist Workers Party, and the tattooed man and have been labeled fascists by a Philadelphia antifa group. However, in a cropped side by side with some overlaid lines, only the source of the image, phillyan​tifa​.org, remains.

The false side-by-side (left) and the original image from an antifa website (right)

The false side‐​by‐​side (left) and the original image from phillyan​tifa​.org (right)

This was proof enough for some. Beyond the Parler account of pro‐​Trump lawyer Lin Wood, the images themselves received only limited reach. However, they formed the basis for a reckless evening story by Washington Times reporter Rowan Scarborough. Originally titled “Facial Recognition Identifies Extremists Storming the Capitol,” within a few hours the title was softened to “Facial Recognition Firms claims Antifa infiltrated Trump Protestors who stormed Capitol.”

Scarborough writes that “a retired military officer told The Washington Times” that the image analysis firm XRVision had used facial recognition to identify antifa agitators within the Capitol mob. While Scarborough provides no real evidence of these claims beyond “the source provided the photo match to The Times,” his descriptions are telling. He claims that the firm “matched two Philadelphia Antifa members to two men inside the Senate” and “one has a tattoo that indicates he is a Stalinist sympathizer.”

XRVision CTO Yaacov Apelbaum has contributed to past right‐​wing messaging campaigns, providing XRvision branded photos of Sen. Bernie Sanders’ (D-VT) lake house and antifa groups in Syria. However, he has denied identifying any antifascists at the Capitol, saying his firm had instead identified skinheads and national socialists.

At 7:40 pm, The story was shared by Fox News host Laura Ingraham, garnering 32,000 retweets. By the time Congress reconvened at half‐​past eight, the claim had made it to Matt Gaetz (R-FL), who parroted the assertion on the floor of the House. Platform regulation is not a salve for epistemically divided government.

Rapid elite endorsement, not lax platform moderation, is responsible for the claim’s spread. The images themselves provided a pretext for less contestable claims; the hammer‐​and‐​sickle interpretation of the Dishonored tattoo was organically mocked. Scarborough’s story summarizing the false visual evidence without providing a means of contesting it was quickly validated and redistributed by public officials and journalists. Sarah Palin invoked the images as evidence on Fox News, and Rep. Paul Gosar (R-AZ) amplified claims that rioters’ knee‐​pads were evidence of antifa affiliation. Each particular claim can be debunked, but the story’s rapid movement between mediums limits platform‐​specific solutions.

Like the President, these figures’ off‐​platform bona fides have, at least until now, prompted moderators to treat them gingerly. However, unlike the deplatformed alt‐​right celebrities who wandered the Capitol on Wednesday, elites in positions of public trust have enduring off‐​platform reach. Moderating them more strictly would be ineffective and politically fraught.

Midway through Thursday afternoon, The Washington Times pulled Scarborough’s story. A different version, published Thursday evening, acknowledges the error, apologizing for presenting XRVision’s identification of fascists as the identification of antifascists before doubling down on the original claim of antifa involvement. In addition to Rep. Gosar’s unsupported kneepad theory and an unnamed law enforcement source, Scarborough references a story by the NY Post. Now reliant on a single unidentified law enforcement source, an earlier version of the Post story cited Scarborough’s initial story, “Two other D.C. protesters were actually Philadelphia‐​based Antifa members, The Washington Times reported Wednesday night.” This shell game keeps the story alive, obscuring the fact that it now relies on nothing more than the accounts of up to two unnamed law enforcement sources and the gut feelings of a few Congressmen. Nevertheless, largely because of Scarborough’s tale, in his words “The presence of Antifa became part of Wednesday’s divisive debate.” Rep. Matt Gaetz (R-FL) has yet to address the false claims he repeated on the House floor.

When misinformation moves rapidly among mass social media, niche platforms, and cable and print news, public figures who move between these spaces must assume greater responsibility for their claims. The lack of forethought and restraint demonstrated throughout this disinformation bucket brigade, to say nothing of the lack of contrition in its aftermath, is not a problem that can be solved by well‐​meaning managers in Menlo Park. Content moderation is no replacement for a healthy elite.

Related Tags
Free Speech and Technology, Free Speech and Civil Liberties, Technology and Privacy

Stay Connected to Cato

Sign up for the newsletter to receive periodic updates on Cato research, events, and publications.

View All Newsletters

1000 Massachusetts Ave, NW,
Washington, DC 20001-5403
(202) 842-0200
Contact Us
Privacy

Footer 1

  • About
    • Annual Reports
    • Leadership
    • Jobs
    • Student Programs
    • Media Information
    • Store
    • Contact

Footer 2

  • Experts
    • Policy Scholars
    • Adjunct Scholars
    • Fellows
  • Events
    • Upcoming
    • Past
    • Event FAQs
    • Sphere Summit

Footer 3

  • Publications
    • Books
    • Cato Journal
    • Regulation
    • Cato Policy Report
    • Cato Supreme Court Review
    • Cato’s Letter
    • Human Freedom Index
    • Economic Freedom of the World
    • Cato Handbook for Policymakers

Footer 4

  • Blog
  • Donate
    • Sponsorship Benefits
    • Ways to Give
    • Planned Giving
Also from Cato Institute:
Libertarianism.org
|
Humanprogress.org
|
Downsizinggovernment.org