Timezone: »
When individuals independently recollect events or retrieve facts from memory, how can we aggregate these retrieved memories to reconstruct the actual set of events or facts? In this research, we report the performance of individuals in a series of general knowledge tasks, where the goal is to reconstruct from memory the order of historic events, or the order of items along some physical dimension. We introduce two Bayesian models for aggregating order information based on a Thurstonian approach and Mallows model. Both models assume that each individuals reconstruction is based on either a random permutation of the unobserved ground truth, or by a pure guessing strategy. We apply MCMC to make inferences about the underlying truth and the strategies employed by individuals. The models demonstrate a "wisdom of crowds" effect, where the aggregated orderings are closer to the true ordering than the orderings of the best individual.
Author Information
Mark Steyvers (UC Irvine)
Michael D Lee (University of California, Irvine)
Brent Miller (University of California, Irvine)
Pernille Hemmer
More from the Same Authors
-
2021 Poster: Combining Human Predictions with Model Probabilities via Confusion Matrices and Calibration »
Gavin Kerrigan · Padhraic Smyth · Mark Steyvers -
2020 Poster: Can I Trust My Fairness Metric? Assessing Fairness with Unlabeled Data and Bayesian Inference »
Disi Ji · Padhraic Smyth · Mark Steyvers -
2017 : POSTER: Cognitive modeling and the wisdom of the crowd »
Michael D Lee -
2013 Poster: Scoring Workers in Crowdsourcing: How Many Control Questions are Enough? »
Qiang Liu · Alexander Ihler · Mark Steyvers -
2013 Spotlight: Scoring Workers in Crowdsourcing: How Many Control Questions are Enough? »
Qiang Liu · Alexander Ihler · Mark Steyvers -
2010 Spotlight: Learning concept graphs from text with stick-breaking priors »
America Chambers · Padhraic Smyth · Mark Steyvers -
2010 Poster: Learning concept graphs from text with stick-breaking priors »
America Chambers · Padhraic Smyth · Mark Steyvers -
2006 Poster: A Bayesian Approach to Diffusion Models of Decision-Making and Response Time »
Michael D Lee · Ian Fuss · Daniel Navarro -
2006 Spotlight: A Bayesian Approach to Diffusion Models of Decision-Making and Response Time »
Michael D Lee · Ian Fuss · Daniel Navarro