{"id":1774,"date":"2012-10-22T13:52:49","date_gmt":"2012-10-22T03:52:49","guid":{"rendered":"http:\/\/www.aspistrategist.ru\/?p=1774"},"modified":"2012-10-23T09:32:55","modified_gmt":"2012-10-22T23:32:55","slug":"aspi-recommends-psychology-of-intelligence-analysis","status":"publish","type":"post","link":"https:\/\/www.aspistrategist.ru\/aspi-recommends-psychology-of-intelligence-analysis\/","title":{"rendered":"ASPI recommends: Psychology of Intelligence Analysis"},"content":{"rendered":"
\"Psychology<\/a><\/figure>\n

For your (virtual) bookshelf:\u00a0Psychology of Intelligence Analysis<\/a><\/em>, Richards J. Heuer, Centre for the Study of Intelligence, Central Intelligence Agency, 1999.<\/p>\n

In the 1990s, the CIA commissioned a study on the nature of intelligence analysis to try to understand why they had an unenviable track record of missing (more accurately, underestimating) some major developments in areas they had been watching closely, such as the decline of the Soviet Union. Or, as Jack Davis, himself a former CIA analyst memorably put it, the CIA analysts had mind sets that helped \u2018get the production out on time and keep things going effectively between those watershed events that become chapter headings in the history books\u2019.<\/p>\n

Heuer\u2019s monograph,\u00a0Psychology of Intelligence Analysis<\/em>, is something of a classic in the field, and it sheds much light on the frailties of the human mind regarding the difficulties of making objective assessments of complex situations when only incomplete information is available. This is a very readable book in that it is not a theory-based approach, and it is full of examples of how we can fool ourselves into being surer than we have any right to be.<\/p>\n

Here\u2019s one of my favourites, which illustrates a subtle point about decision making. It\u2019s almost axiomatic after any intelligence \u2018failure\u2019 (which may or may not actually be a failure in the true sense of the word) that more collection is one of the remedies\u2014if only the analysts had had more information, the implied reasoning goes, then they would have had a better chance of getting it right.<\/p>\n

Not necessarily so, says Heuer, and he has experimental evidence to back him. In the experiment, experienced horse handicappers were presented with datasets of variable sizes for a set of horse races (with the race and horse identities concealed). They were asked to predict the outcomes based on variables such as the weight to be carried, the percentage of races in which the horse finished first, second or third during the previous year, the jockey\u2019s record and the number of days since the horse\u2019s last race. Their performance at the task is shown in the graph below. With a small number of variables, their predictions were accurate between 15% and 20% of the time. Importantly, their assessment of their accuracy almost matched their performance. However, as more data was provided, their confidence in their predictions grew steadily\u2014in contrast to their performance, which was resolutely unaffected by the extra data.<\/p>\n

Graph.<\/strong> Decision making: perception vs reality<\/p>\n

\"Graph\"<\/a><\/figure>\n

Heuer concludes the discussion with an observation that this effect isn\u2019t limited to the world of intelligence. I\u2019ve argued in the past that the increasingly elaborate process surrounding the development of the Defence capability plan (52 major pieces of documentation at last count) runs the risk of prioritising information over analysis.<\/p>\n

Heuer has another example, and an observation (emphasis added):<\/p>\n

A series of experiments to examine the mental processes of medical doctors diagnosing illness found little relationship between thoroughness of data collection and accuracy of diagnosis. Medical students whose self-described research strategy stressed thorough collection of information (as opposed to formation and testing of hypotheses) were significantly below average in the accuracy of their diagnoses. It seems that the explicit formulation of hypotheses directs a more efficient and effective search for information.<\/em><\/p><\/blockquote>\n

In short, Heuer makes a very convincing case for the scientific method<\/a> as the right basis for intelligence analysis and, by extension, other areas of complex decision making.<\/p>\n

Andrew Davies\u00a0is senior analyst for defence capability at ASPI and executive editor of\u00a0<\/em>The Strategist.<\/p>\n","protected":false},"excerpt":{"rendered":"

For your (virtual) bookshelf:\u00a0Psychology of Intelligence Analysis, Richards J. Heuer, Centre for the Study of Intelligence, Central Intelligence Agency, 1999. In the 1990s, the CIA commissioned a study on the nature of intelligence analysis to …<\/p>\n","protected":false},"author":6,"featured_media":1775,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"footnotes":""},"categories":[1],"tags":[32,170],"class_list":["post-1774","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-general","tag-book-review","tag-intelligence"],"acf":[],"yoast_head":"\nASPI recommends: Psychology of Intelligence Analysis | The Strategist<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.aspistrategist.ru\/aspi-recommends-psychology-of-intelligence-analysis\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"ASPI recommends: Psychology of Intelligence Analysis | The Strategist\" \/>\n<meta property=\"og:description\" content=\"For your (virtual) bookshelf:\u00a0Psychology of Intelligence Analysis, Richards J. Heuer, Centre for the Study of Intelligence, Central Intelligence Agency, 1999. In the 1990s, the CIA commissioned a study on the nature of intelligence analysis to ...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.aspistrategist.ru\/aspi-recommends-psychology-of-intelligence-analysis\/\" \/>\n<meta property=\"og:site_name\" content=\"The Strategist\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/ASPI.org\" \/>\n<meta property=\"article:published_time\" content=\"2012-10-22T03:52:49+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2012-10-22T23:32:55+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2012\/10\/AD-book.png\" \/>\n\t<meta property=\"og:image:width\" content=\"476\" \/>\n\t<meta property=\"og:image:height\" content=\"713\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Andrew Davies\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@ASPI_org\" \/>\n<meta name=\"twitter:site\" content=\"@ASPI_org\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Andrew Davies\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.aspistrategist.ru\/#website\",\"url\":\"https:\/\/www.aspistrategist.ru\/\",\"name\":\"The Strategist\",\"description\":\"ASPI's analysis and commentary site\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.aspistrategist.ru\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-AU\"},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-AU\",\"@id\":\"https:\/\/www.aspistrategist.ru\/aspi-recommends-psychology-of-intelligence-analysis\/#primaryimage\",\"url\":\"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2012\/10\/AD-book.png\",\"contentUrl\":\"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2012\/10\/AD-book.png\",\"width\":476,\"height\":713,\"caption\":\"Psychology of Intelligence Analysis\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.aspistrategist.ru\/aspi-recommends-psychology-of-intelligence-analysis\/\",\"url\":\"https:\/\/www.aspistrategist.ru\/aspi-recommends-psychology-of-intelligence-analysis\/\",\"name\":\"ASPI recommends: Psychology of Intelligence Analysis | The Strategist\",\"isPartOf\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/aspi-recommends-psychology-of-intelligence-analysis\/#primaryimage\"},\"datePublished\":\"2012-10-22T03:52:49+00:00\",\"dateModified\":\"2012-10-22T23:32:55+00:00\",\"author\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/08a9125f7af3039520d264e965235a73\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/aspi-recommends-psychology-of-intelligence-analysis\/#breadcrumb\"},\"inLanguage\":\"en-AU\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.aspistrategist.ru\/aspi-recommends-psychology-of-intelligence-analysis\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.aspistrategist.ru\/aspi-recommends-psychology-of-intelligence-analysis\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.aspistrategist.ru\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"ASPI recommends: Psychology of Intelligence Analysis\"}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/08a9125f7af3039520d264e965235a73\",\"name\":\"Andrew Davies\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-AU\",\"@id\":\"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/bbb47ebb41d4978346dbf2e1d21b992a?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/bbb47ebb41d4978346dbf2e1d21b992a?s=96&d=mm&r=g\",\"caption\":\"Andrew Davies\"},\"url\":\"https:\/\/www.aspistrategist.ru\/author\/andrew-davies\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"ASPI recommends: Psychology of Intelligence Analysis | The Strategist","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.aspistrategist.ru\/aspi-recommends-psychology-of-intelligence-analysis\/","og_locale":"en_US","og_type":"article","og_title":"ASPI recommends: Psychology of Intelligence Analysis | The Strategist","og_description":"For your (virtual) bookshelf:\u00a0Psychology of Intelligence Analysis, Richards J. Heuer, Centre for the Study of Intelligence, Central Intelligence Agency, 1999. In the 1990s, the CIA commissioned a study on the nature of intelligence analysis to ...","og_url":"https:\/\/www.aspistrategist.ru\/aspi-recommends-psychology-of-intelligence-analysis\/","og_site_name":"The Strategist","article_publisher":"https:\/\/www.facebook.com\/ASPI.org","article_published_time":"2012-10-22T03:52:49+00:00","article_modified_time":"2012-10-22T23:32:55+00:00","og_image":[{"width":476,"height":713,"url":"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2012\/10\/AD-book.png","type":"image\/png"}],"author":"Andrew Davies","twitter_card":"summary_large_image","twitter_creator":"@ASPI_org","twitter_site":"@ASPI_org","twitter_misc":{"Written by":"Andrew Davies","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebSite","@id":"https:\/\/www.aspistrategist.ru\/#website","url":"https:\/\/www.aspistrategist.ru\/","name":"The Strategist","description":"ASPI's analysis and commentary site","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.aspistrategist.ru\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-AU"},{"@type":"ImageObject","inLanguage":"en-AU","@id":"https:\/\/www.aspistrategist.ru\/aspi-recommends-psychology-of-intelligence-analysis\/#primaryimage","url":"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2012\/10\/AD-book.png","contentUrl":"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2012\/10\/AD-book.png","width":476,"height":713,"caption":"Psychology of Intelligence Analysis"},{"@type":"WebPage","@id":"https:\/\/www.aspistrategist.ru\/aspi-recommends-psychology-of-intelligence-analysis\/","url":"https:\/\/www.aspistrategist.ru\/aspi-recommends-psychology-of-intelligence-analysis\/","name":"ASPI recommends: Psychology of Intelligence Analysis | The Strategist","isPartOf":{"@id":"https:\/\/www.aspistrategist.ru\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.aspistrategist.ru\/aspi-recommends-psychology-of-intelligence-analysis\/#primaryimage"},"datePublished":"2012-10-22T03:52:49+00:00","dateModified":"2012-10-22T23:32:55+00:00","author":{"@id":"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/08a9125f7af3039520d264e965235a73"},"breadcrumb":{"@id":"https:\/\/www.aspistrategist.ru\/aspi-recommends-psychology-of-intelligence-analysis\/#breadcrumb"},"inLanguage":"en-AU","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.aspistrategist.ru\/aspi-recommends-psychology-of-intelligence-analysis\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.aspistrategist.ru\/aspi-recommends-psychology-of-intelligence-analysis\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.aspistrategist.ru\/"},{"@type":"ListItem","position":2,"name":"ASPI recommends: Psychology of Intelligence Analysis"}]},{"@type":"Person","@id":"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/08a9125f7af3039520d264e965235a73","name":"Andrew Davies","image":{"@type":"ImageObject","inLanguage":"en-AU","@id":"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/bbb47ebb41d4978346dbf2e1d21b992a?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/bbb47ebb41d4978346dbf2e1d21b992a?s=96&d=mm&r=g","caption":"Andrew Davies"},"url":"https:\/\/www.aspistrategist.ru\/author\/andrew-davies\/"}]}},"_links":{"self":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts\/1774"}],"collection":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/comments?post=1774"}],"version-history":[{"count":21,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts\/1774\/revisions"}],"predecessor-version":[{"id":1817,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts\/1774\/revisions\/1817"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/media\/1775"}],"wp:attachment":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/media?parent=1774"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/categories?post=1774"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/tags?post=1774"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}