Journal article

Improving Analytic Reasoning via Crowdsourcing and Structured Analytic Techniques

Tim van Gelder, Ariel Kruger, Sujai Thomman, Richard de Rozario, Elizabeth Silver, Morgan Saletta, Ashley Barnett, Richard O Sinnott, Glenn Tesla Jayaputera, Mark Burgman

JOURNAL OF COGNITIVE ENGINEERING AND DECISION MAKING | SAGE PUBLICATIONS INC | Published : 2020

Abstract

How might analytic reasoning in intelligence reports be substantially improved? One conjecture is that this can be achieved through a combination of crowdsourcing and structured analytic techniques (SATs). To explore this conjecture, we developed a new crowdsourcing platform supporting groups in collaborative reasoning and intelligence report drafting using a novel SAT we call “Contending Analyses.” In this paper we present findings from a large study designed to assess whether groups of professional analysts working on the platform produce better-reasoned reports than those analysts produce when using methods and tools normally used in their organizations. Secondary questions were whether p..

View full abstract

Grants

Awarded by Office of the Director of National Intelligence (ODNI), Intelligence Advanced Research Projects Activity (IARPA)


Funding Acknowledgements

This research is based upon work supported in part by the Office of the Director of National Intelligence (ODNI), Intelligence Advanced Research Projects Activity (IARPA), under Contract 2017-16122000002. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies, either expressed or implied, of ODNI, IARPA, or the U.S. Government. The U.S. Government is authorized to reproduce and distribute reprints for governmental purposes notwithstanding any copyright annotation therein.