Learning from Error

An old-school blog by Adarsh Mathew

Why Move Beyond Misinformation?

Last Modified at — Dec 29, 2021

In a bit of great news, I’ve been invited to present our paper on ["Paths to Power"](/projects/paths-to-power/ at the upcoming workshop “Beyond Misinformation: Towards a Research Agenda for Information Ecosystems, Network Dynamics and Emergent Epistemologies” 1 hosted by the iSchool at Syracuse University. I’m excited to present our framework and early results to the academic audience for several reasons: this is a crowd that senses something is wrong with the polatization/misinformation/fake-news research paradigm, and they have their eye on network epistemology, something that’s very nascent.

While preparing my paper talk for the workshop, I got this really interesting prompt from the organizers:

“How you organize your presentation is up to you, but at some point in your presentation please try to highlight for your audience a question or perspective that helps elaborate a future agenda for research beyond misinformation. In formulating this, it may be useful for you to consider the following provocation: If you were a program officer for a major research body with a budget of $1T and the goal of changing the information ecosystem to advance the welfare of all people, what kind of research proposals would you invite?”

This triggered an internal discussion: How does the Ideolect and Legitimate conflict project fit into this kind of agenda? How does it talk about information ecosystems?

Jeremiah and I were talking through this. While we want to understand how powerful users influence conversation on the internet, we are also studying how they collaborate and how likely they are to do so; trying to measure ‘open-mindedness’, which we believe is an inverse to extremism. The broader question we’re tackling is how individuals exchange ideas on these platforms. Identifying conflict, illegitimate (trolling) and legitimate (substantial back and forth).

We conceptualize these forums as practical epistemic communities, where agents exchange information and signal approval and engage in sense-making. We do two things: a) identify the network structure of interaction in this setup, and b) measure and describe discourse characteristics of the group. We hope to understand the interplay between these two, to identify how social relationships impact discourse, to understand how communities become epistemically weakened. they could be vulnerable and open to hijack; they could become reinforcing echo chambers; they could become aggressively skpetical, eroding all norms of evidence.

A lot of this thinking stems from Kevin Zollman’s work on how epistemic networks converge on the truth, with the example of academia. Our work tries to examine how such an approach could be translated to empirical networks beyond agent-based models. To identify and predict influence. To understand the drivers of power. To characterize how communities evolve and change, if they do.

So, our broader question is this: How do we construct ‘virtuous’ epistemic communities that are resilient to attack/hijack? How do we port these ideas to the design of platforms and groups on the internet, identifying key sets of incentives to discourage ‘deceitful’ behavior? How do we encode this without impeding their ability to process conflicting, uncertain information in uncertain times?


  1. Quite a mouthful. But such a sweet combination of ideas. ↩︎

comments powered by Disqus