{"id":1089,"date":"2021-10-11T10:41:00","date_gmt":"2021-10-11T10:41:00","guid":{"rendered":"https:\/\/resources.illc.uva.nl\/illc-blog\/?p=1089"},"modified":"2021-10-13T07:43:20","modified_gmt":"2021-10-13T07:43:20","slug":"the-wisdom-of-the-crowds","status":"publish","type":"post","link":"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/","title":{"rendered":"The wisdom of the crowds"},"content":{"rendered":"\n<p class=\"has-small-font-size\">11 October 2021,&nbsp;<a href=\"https:\/\/twitter.com\/IrisProff\">Iris Proff<\/a><\/p>\n\n\n\n<figure class=\"wp-block-image size-large header-image\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"856\" src=\"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/sand-buckets-1424-min-1024x856.png\" alt=\"\" class=\"wp-image-1203\" title=\"\" srcset=\"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/sand-buckets-1424-min-1024x856.png 1024w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/sand-buckets-1424-min-300x251.png 300w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/sand-buckets-1424-min-768x642.png 768w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/sand-buckets-1424-min-1200x1003.png 1200w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/sand-buckets-1424-min.png 1424w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p class=\"has-text-align-right has-small-font-size\">\u00a9&nbsp;<a rel=\"noreferrer noopener\" href=\"http:\/\/mdhk.net\/\" target=\"_blank\">Marianne de Heer Kloots<\/a><\/p>\n\n\n\n<p class=\"has-text-align-left has-normal-font-size\">The hive mind, swarm intelligence or the wisdom of the crowds \u2013 there are many expressions for the simple intuition that groups are better at solving problems than individuals are. Flocks of migrating birds manage to find their route between breeding and wintering grounds over thousands of kilometers year after year. Ant colonies can identify the optimal path to a food source. And when a large group of people is asked to guess the weight of a bucket of sand, their averaged guesses can be pretty close to the true weight.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>A theorem of collective wisdom<\/strong><\/h2>\n\n\n\n<p>In each of these somewhat mysterious cases, individual guesses might be quite far off. However, the errors individuals make balance each other out, such that the collective arrives close to the \u201ctruth\u201d. This idea was formalized by the 18<sup>th<\/sup> century statesman, mathematician and philosopher Nicolas de Condorcet in what has come to be known as Condorcet Jury Theorem. Roughly speaking, it states that groups are better than individuals at identifying the truth, and that they get better and better as the group gets larger.<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"alignright size-medium\"><a href=\"https:\/\/resources.illc.uva.nl\/illc-blog\/the-madness-of-the-crowds\/\"><img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"251\" src=\"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/01\/logic-society-1424-lights-min-300x251.png\" alt=\"\" class=\"wp-image-718\" srcset=\"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/01\/logic-society-1424-lights-min-300x251.png 300w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/01\/logic-society-1424-lights-min-1024x856.png 1024w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/01\/logic-society-1424-lights-min-768x642.png 768w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/01\/logic-society-1424-lights-min-1200x1003.png 1200w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/01\/logic-society-1424-lights-min.png 1424w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><figcaption>The madness of the crowds: Read in <a href=\"https:\/\/resources.illc.uva.nl\/illc-blog\/the-madness-of-the-crowds\/\" target=\"_blank\" rel=\"noreferrer noopener\">this earlier blogpost<\/a> about how filter bubbles and informational cascades arise from social interaction gone wrong<\/figcaption><\/figure><\/div>\n\n\n\n<p>The Condorcet Jury Theorem and its many extensions and implications are one of the interests of Adrian Haret, researcher in the Computational Social Choice group at the ILLC. \u201cThe theorem holds only under very special, somewhat unrealistic conditions\u201d, says Haret. One of those is that individual guesses must be independent. In other words: the agents, be it birds, ants or humans, are not allowed to influence each other. That might be true for artificial guessing games where people quietly note down their beliefs. But in reality, we are very much influenced by other people\u2019s beliefs in our search for truth. When it goes wrong, this interaction <a href=\"https:\/\/www.pnas.org\/content\/108\/22\/9020\" target=\"_blank\" rel=\"noreferrer noopener\">can break the wisdom of the crowds<\/a> and lead to polarization of opinion, informational cascades, and filter bubbles. But when it goes right, interaction might actually&nbsp; increase people\u2019s ability to find truth.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Prediction markets as crystal balls<\/strong><\/h2>\n\n\n\n<p>For a powerful example, let&#8217;s turn to a rather painful chapter of the recent history of empirical research: the replication crisis in Psychology. <a href=\"https:\/\/www.pnas.org\/content\/112\/50\/15343.short\" target=\"_blank\" rel=\"noreferrer noopener\">Between 2012 and 2014<\/a>, a group of 92 researchers placed bets on which results from 44 published psychological studies would be replicated in independent repetitions of the original experiments. They did so in two different manners: First, they quietly noted down their own beliefs. Then, they participated in a prediction market, where they could trade contracts for different studies with each other, similar to assets on a stock market.<\/p>\n\n\n\n<p>Interestingly, the silent guesses of the researchers were not predictive of which results would later be replicated. The prices of the contracts after trading however indicated with 70 percent accuracy which results would be replicated (rather shockingly, more than half would fail to replicate). Only by trading contracts back and forth and by adjusting their beliefs to what other people think could the researchers collectively arrive at a consensus and get closer to the truth.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>A simple model of social learning<\/strong><\/h2>\n\n\n\n<p>In the 1970s, the American statistician Morris DeGroot built a mathematical model of how such a consensus can arise out of interaction between individuals. The now famous DeGroot model consists in a network of agents that start with an initial belief about a certain variable. This variable might represent the weight of a bucket of sand or the mortality rate of a viral disease. Step by step, they update their belief by replacing it with a weighted average of some of the other agents\u2019 beliefs \u2013 those they are connected to in the network. <\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"alignright size-medium\"><a href=\"https:\/\/staff.science.uva.nl\/a.haret\/\"><img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"240\" src=\"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/09\/adrian_haret-300x240.jpg\" alt=\"\" class=\"wp-image-1091\" srcset=\"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/09\/adrian_haret-300x240.jpg 300w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/09\/adrian_haret-1024x819.jpg 1024w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/09\/adrian_haret-768x614.jpg 768w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/09\/adrian_haret-1536x1229.jpg 1536w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/09\/adrian_haret-2048x1638.jpg 2048w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/09\/adrian_haret-1200x960.jpg 1200w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/09\/adrian_haret-1980x1584.jpg 1980w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><figcaption><a rel=\"noreferrer noopener\" href=\"https:\/\/staff.science.uva.nl\/a.haret\/\" target=\"_blank\">Adrian Haret<\/a> is a postdoc in the Computational Social Choice group of the ILLC. <\/figcaption><\/figure><\/div>\n\n\n\n<p>DeGroot found that in this simplistic model, all agents\u2019 beliefs converge to one and the same belief over time. This is remarkable because \u201cthere isn&#8217;t any central authority that has access to all the beliefs\u201d, says Adrian Haret. \u201cIt&#8217;s just the agents updating locally, and somehow they manage to reach the same result as if they were to pool all their beliefs.\u201d<\/p>\n\n\n\n<p>It wasn\u2019t until 2010 that Benjamin Golub and Matthew O. Jackson added the notion of truth to the DeGroot model. They showed that if the agents\u2019 beliefs are centered around a \u201ctrue\u201d value and the group is large enough, then, by repeatedly updating their beliefs, they will eventually converge not just to any value, but to the truth. However, Golub and Jackson found that this truth finding only works if the network is structured in a certain way: As the network grows larger and larger, every agent\u2019s influence must diminish, and eventually vanish. If there is a prominent individual or group that, in virtue of its privileged position, exercises an outsized influence on what the group believes, this will prevent the group from finding the truth.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Pure or oversimplified?<\/strong><\/h2>\n\n\n\n<p>The DeGroot model \u2013 also known as na\u00efve social learning \u2013 can capture the basic principle underlying mysterious wisdom of the crowds effects such as prediction markets. \u201cIt\u2019s a very purified view of the flow of information in a social network,\u201d says Adrian Haret. As such, it is heavily simplified compared to real-world social learning. How so? First, it requires every agent to trust the information obtained from other agents and to take it into account when forming a new belief. It thus ignores the fact that real people might be selective about which information to trust and do not easily throw away their prior beliefs when new information comes in.<\/p>\n\n\n\n<p>Second, when the agents update their beliefs, they&nbsp; rely solely&nbsp; on information from other agents and do not have any contact with&nbsp; the external world. The model thus assumes, in a way, that each individual is born with a certain belief about the mortality rate of a disease, which they will subsequently forget and replace by whatever other individuals around them believe.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Misinformation kills social learning<\/strong><\/h2>\n\n\n\n<p>Despite these somewhat absurd simplifications, the DeGroot model allows researchers to explore what happens when the basic mechanism of social learning is distorted. For instance, a <a href=\"https:\/\/arxiv.org\/abs\/2102.11768\" target=\"_blank\" rel=\"noreferrer noopener\">group of researchers from Tel Aviv<\/a> recently investigated the effect of non-cooperative agents who forever stick with their initial belief and never update it. These non-cooperative agents, dubbed \u201cbots\u201d by the authors, mimic misinformation spreaders in a social network. The research team found that with a single bot in the network, all other agents eventually adopt that bot\u2019s belief. While certainly exaggerated compared to a real-world scenario, this suggests that social learning is highly vulnerable to persistent misinformation.<\/p>\n\n\n\n<p>A new, more cautious learning rule proposed by the authors can prevent the catastrophic effect of bots. Agents following this rule change their belief maximally to a certain extent and only if the evidence speaks strongly against it. While this renders learning resistant against bots, it also prevents the agents from finding a perfect consensus \u2013 instead their opinions end up being scattered around the true value.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"571\" src=\"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/09\/Network400UnInc-1-1024x571.png\" alt=\"\" class=\"wp-image-1104\" srcset=\"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/09\/Network400UnInc-1-1024x571.png 1024w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/09\/Network400UnInc-1-300x167.png 300w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/09\/Network400UnInc-1-768x428.png 768w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/09\/Network400UnInc-1-1536x857.png 1536w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/09\/Network400UnInc-1-2048x1142.png 2048w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/09\/Network400UnInc-1-1200x669.png 1200w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/09\/Network400UnInc-1-1980x1104.png 1980w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption>Visualization of a social network model, where the colour indicates how far each agent&#8217;s belief is away from the true value. In the standard DeGroot model, the agents beliefs converge over time to one and the same value. If the network is structured in the right way, this value will be the truth. \u00a9 Roman S. Oort<\/figcaption><\/figure>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"alignright size-medium is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/Roman_portrait-2-300x295.jpg\" alt=\"\" class=\"wp-image-1196\" width=\"301\" height=\"296\" srcset=\"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/Roman_portrait-2-300x295.jpg 300w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/Roman_portrait-2-1024x1008.jpg 1024w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/Roman_portrait-2-768x756.jpg 768w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/Roman_portrait-2-1536x1511.jpg 1536w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/Roman_portrait-2-2048x2015.jpg 2048w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/Roman_portrait-2-1200x1181.jpg 1200w, https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/Roman_portrait-2-1980x1948.jpg 1980w\" sizes=\"auto, (max-width: 301px) 100vw, 301px\" \/><figcaption>Roman Oort is a Master Student of Artificial Intelligence at the University of Amsterdam<\/figcaption><\/figure><\/div>\n\n\n\n<p>In his Bachelor thesis at the ILLC, Adrian Haret\u2019s student Roman Oort replicated this finding and found that another updating rule, the so-called \u201cprivate belief rule\u201d has a similar effect. Here, besides&nbsp; considering beliefs of other agents, an individual always hangs on to their initial and fixed \u201cprivate belief\u201d \u2013 think of it as a first gut feeling, or <a rel=\"noreferrer noopener\" href=\"https:\/\/en.wikipedia.org\/wiki\/Anchoring_(cognitive_bias)\" target=\"_blank\">anchor for future beliefs<\/a> \u2013&nbsp; and includes this private belief in every further update. Both approaches essentially \u201cmake the agents more sceptical, or stubborn\u201d, says Roman Oort. A healthy amount of scepticism \u2013 or stubbornness \u2013 might also help people in the real world resist the effects of persistent misinformation, the student argues. \u201cThere is a sweet spot between having very trustful and very suspicious agents that is incredibly hard to find\u201d, says Adrian Haret.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>All models are wrong<\/strong>?<\/h2>\n\n\n\n<p>The elephant-in-the-room-question remains: Can mathematical models of social learning teach us something about the real world? Variants of this question apply to modeling research in all kinds of disciplines, from modeling the climate, to modeling the economy or modeling the brain. Social learning \u2013 just as the climate, the economy, and the brain \u2013 is a complex process with countless variables that play into it. Any mathematical model of social learning will rely on heavy simplifications . This means that effects observed in learning models do not translate one-to-one to reality. <\/p>\n\n\n\n<p>However, social learning models allow us to think systematically about how things like misinformation or highly prominent agents affect the basic mechanism of social learning. They allow us to identify under which network structures filter bubbles or informational cascades can emerge. And they allow us to make careful suggestions about how agents <em>should<\/em> behave or how the network <em>should <\/em>be structured to resist such distortions. It all comes down to the famous quote by the British statistician George Box: \u201cAll models are wrong, but some are useful.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"<p>When people join forces to search for the truth, they can develop seemingly magical abilities. But in our hyperconnected world, many things go wrong in the collective search for truth. Mathematical models explain why.<\/p>\n","protected":false},"author":2,"featured_media":1203,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1089","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.9 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>The wisdom of the crowds - ILLC Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The wisdom of the crowds - ILLC Blog\" \/>\n<meta property=\"og:description\" content=\"When people join forces to search for the truth, they can develop seemingly magical abilities. But in our hyperconnected world, many things go wrong in the collective search for truth. Mathematical models explain why.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/\" \/>\n<meta property=\"og:site_name\" content=\"ILLC Blog\" \/>\n<meta property=\"article:published_time\" content=\"2021-10-11T10:41:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2021-10-13T07:43:20+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/sand-buckets-1424-min.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1424\" \/>\n\t<meta property=\"og:image:height\" content=\"1190\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"8 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/\"},\"author\":{\"name\":\"admin\",\"@id\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/#\/schema\/person\/e6a636d976565eaec71567ead9a5e70a\"},\"headline\":\"The wisdom of the crowds\",\"datePublished\":\"2021-10-11T10:41:00+00:00\",\"dateModified\":\"2021-10-13T07:43:20+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/\"},\"wordCount\":1562,\"publisher\":{\"@id\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/#organization\"},\"image\":{\"@id\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/sand-buckets-1424-min.png\",\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/\",\"url\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/\",\"name\":\"The wisdom of the crowds - ILLC Blog\",\"isPartOf\":{\"@id\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/sand-buckets-1424-min.png\",\"datePublished\":\"2021-10-11T10:41:00+00:00\",\"dateModified\":\"2021-10-13T07:43:20+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/#primaryimage\",\"url\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/sand-buckets-1424-min.png\",\"contentUrl\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/sand-buckets-1424-min.png\",\"width\":1424,\"height\":1190},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The wisdom of the crowds\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/#website\",\"url\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/\",\"name\":\"ILLC Blog\",\"description\":\"Institute for Logic, Language and Computation\",\"publisher\":{\"@id\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/#organization\",\"name\":\"ILLC Blog\",\"url\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2020\/04\/logo-uva.png\",\"contentUrl\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2020\/04\/logo-uva.png\",\"width\":301,\"height\":30,\"caption\":\"ILLC Blog\"},\"image\":{\"@id\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/#\/schema\/person\/e6a636d976565eaec71567ead9a5e70a\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/9da35c76f4cff342883f387bb36fd693eeeceb9d4c368ae306f833f4b54db32e?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/9da35c76f4cff342883f387bb36fd693eeeceb9d4c368ae306f833f4b54db32e?s=96&d=mm&r=g\",\"caption\":\"admin\"},\"url\":\"https:\/\/resources.illc.uva.nl\/illc-blog\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"The wisdom of the crowds - ILLC Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/","og_locale":"en_US","og_type":"article","og_title":"The wisdom of the crowds - ILLC Blog","og_description":"When people join forces to search for the truth, they can develop seemingly magical abilities. But in our hyperconnected world, many things go wrong in the collective search for truth. Mathematical models explain why.","og_url":"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/","og_site_name":"ILLC Blog","article_published_time":"2021-10-11T10:41:00+00:00","article_modified_time":"2021-10-13T07:43:20+00:00","og_image":[{"width":1424,"height":1190,"url":"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/sand-buckets-1424-min.png","type":"image\/png"}],"author":"admin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin","Est. reading time":"8 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/#article","isPartOf":{"@id":"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/"},"author":{"name":"admin","@id":"https:\/\/resources.illc.uva.nl\/illc-blog\/#\/schema\/person\/e6a636d976565eaec71567ead9a5e70a"},"headline":"The wisdom of the crowds","datePublished":"2021-10-11T10:41:00+00:00","dateModified":"2021-10-13T07:43:20+00:00","mainEntityOfPage":{"@id":"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/"},"wordCount":1562,"publisher":{"@id":"https:\/\/resources.illc.uva.nl\/illc-blog\/#organization"},"image":{"@id":"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/#primaryimage"},"thumbnailUrl":"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/sand-buckets-1424-min.png","inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/","url":"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/","name":"The wisdom of the crowds - ILLC Blog","isPartOf":{"@id":"https:\/\/resources.illc.uva.nl\/illc-blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/#primaryimage"},"image":{"@id":"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/#primaryimage"},"thumbnailUrl":"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/sand-buckets-1424-min.png","datePublished":"2021-10-11T10:41:00+00:00","dateModified":"2021-10-13T07:43:20+00:00","breadcrumb":{"@id":"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/#primaryimage","url":"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/sand-buckets-1424-min.png","contentUrl":"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2021\/10\/sand-buckets-1424-min.png","width":1424,"height":1190},{"@type":"BreadcrumbList","@id":"https:\/\/resources.illc.uva.nl\/illc-blog\/the-wisdom-of-the-crowds\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/resources.illc.uva.nl\/illc-blog\/"},{"@type":"ListItem","position":2,"name":"The wisdom of the crowds"}]},{"@type":"WebSite","@id":"https:\/\/resources.illc.uva.nl\/illc-blog\/#website","url":"https:\/\/resources.illc.uva.nl\/illc-blog\/","name":"ILLC Blog","description":"Institute for Logic, Language and Computation","publisher":{"@id":"https:\/\/resources.illc.uva.nl\/illc-blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/resources.illc.uva.nl\/illc-blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/resources.illc.uva.nl\/illc-blog\/#organization","name":"ILLC Blog","url":"https:\/\/resources.illc.uva.nl\/illc-blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/resources.illc.uva.nl\/illc-blog\/#\/schema\/logo\/image\/","url":"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2020\/04\/logo-uva.png","contentUrl":"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-content\/uploads\/2020\/04\/logo-uva.png","width":301,"height":30,"caption":"ILLC Blog"},"image":{"@id":"https:\/\/resources.illc.uva.nl\/illc-blog\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/resources.illc.uva.nl\/illc-blog\/#\/schema\/person\/e6a636d976565eaec71567ead9a5e70a","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/resources.illc.uva.nl\/illc-blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/9da35c76f4cff342883f387bb36fd693eeeceb9d4c368ae306f833f4b54db32e?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/9da35c76f4cff342883f387bb36fd693eeeceb9d4c368ae306f833f4b54db32e?s=96&d=mm&r=g","caption":"admin"},"url":"https:\/\/resources.illc.uva.nl\/illc-blog\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-json\/wp\/v2\/posts\/1089","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-json\/wp\/v2\/comments?post=1089"}],"version-history":[{"count":26,"href":"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-json\/wp\/v2\/posts\/1089\/revisions"}],"predecessor-version":[{"id":1205,"href":"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-json\/wp\/v2\/posts\/1089\/revisions\/1205"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-json\/wp\/v2\/media\/1203"}],"wp:attachment":[{"href":"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-json\/wp\/v2\/media?parent=1089"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-json\/wp\/v2\/categories?post=1089"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/resources.illc.uva.nl\/illc-blog\/wp-json\/wp\/v2\/tags?post=1089"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}