{"id":53550,"date":"2020-02-14T11:00:12","date_gmt":"2020-02-14T00:00:12","guid":{"rendered":"https:\/\/www.aspistrategist.ru\/?p=53550"},"modified":"2020-02-14T10:58:09","modified_gmt":"2020-02-13T23:58:09","slug":"truth-as-fiction-the-dangers-of-hubris-in-the-information-environment","status":"publish","type":"post","link":"https:\/\/www.aspistrategist.ru\/truth-as-fiction-the-dangers-of-hubris-in-the-information-environment\/","title":{"rendered":"Truth as fiction: the dangers of hubris in the information environment"},"content":{"rendered":"
<\/figure>\n

As Felipe Fern\u00e1ndez-Armesto points out in his 2019 Out of our minds: what we think and how we came to think it<\/em><\/a>, ideas about how humans tell truth from falsity are among the oldest and most important ones we ever have. The digital information age presents a range of new and old challenges to the conundrum, and in national security they become particularly acute. In the digital age, we\u2019re drowning in information\u2014and most projections<\/a> suggest it will only get worse. A tendency, however, to overreact to these new iterations of old problems will quickly forfeit any strategic gains the digital information age once seemed to offer.<\/p>\n

Another of the oldest and most important human concepts is narrative. The stories we tell about ourselves, both individually and collectively, are the substrates of identity. Narrative is a different species from truth and falsity; it spans the gap between factual truth and truth as meaning\u2014a delicate, dynamic and complex assemblage of information, knowledge, understanding and illusion. Humans participate in constructing their own narratives, but are not their sole architects. The world outside of human control has the final say.<\/p>\n

In Stalin\u2019s Soviet Union as well as Nazi Germany, \u2018truth\u2019 was considered a theoretical construct under the control of human architects. As Eugene Lyons noted of life in the USSR in his 1938 Assignment in Utopia<\/a><\/em>, under certain conditions utter nonsense can seem true\u2014nonsense with a special type of momentum whereby each accumulated failure only stiffens collective commitment to the lie. When centralised regimes control much of the information infrastructure, falsehoods can seem plausible for a period of time, but not because logic bends to human will\u2014it doesn\u2019t. By controlling information infrastructure and by implementing a climate not only of fear but of vanguardism, Soviet and Nazi propagandists created truth out of thin air. The climates of terror and the infrastructures of control these regimes produced eventually fell\u2014and so did the nonsense they held aloft for a brief period of time. The 20th century stands as the greatest warning against hubris and human authorship.<\/p>\n

Despite those lessons, the temptation to treat narrative truth as a fiction of our own making\u2014unburdened by fact\u2014is again on the agenda. Three factors have put it there: our self-inflicted glut of data; the conviction that adversaries are conducting narrative warfare against us and that we\u2019re losing; and highly speculative<\/a> theories about what technology can do to combat the problem.<\/p>\n

The belief, driven primarily by the big data commerce industry (as opposed to the big data science<\/a> industry), that data must contain a type of magic dust\u2014discernible patterns and regularities in human behaviour that offer significant insights\u2014is losing its lustre<\/a>. Much of what has passed, and been bought and sold, as behavioural analytics derived from data has little or no legitimacy. Some analytical tools perform no better than human intuition<\/a> at predicting social outcomes, yet the idea that complex human behaviour can be steered by social engineers is part of the zeitgeist. That the age of big data might yield diminishing returns<\/a> is information-age heresy.<\/p>\n

Two decades of conflict against an adversary unbound by ethical and moral constraints in communication has left the West\u2019s security agencies and their personnel pushing boundaries to win the contest of narratives by countering the content, flow or, in many cases, the communicators. The overarching concern, characterised as a national security risk, has been amplified in recent years as revisionist states use information as a tool or weapon. Again, the desire to counter (to be seen to be doing something, usually offensive, against the identified threat) has led to that same security apparatus considering forgoing the very values, ethics and morals that make Western democracy worth preserving.<\/p>\n

This isn\u2019t mere speculation. Decisions within the US security apparatus to reframe long-held prohibitions against torture in order to gain a supporting legal opinion justifying \u2018enhanced\u2019 interrogation methods are a sobering case study<\/a>. Arguably, a significant erosion of trust<\/a> in US decision-making was cemented following the release of reports on previously covert actions related to enhanced interrogation\u2014rendition to black sites, waterboarding and so on. The negative impact was greater because those acts were fully thought through and authorised in order to \u2018win\u2019, not the actions of poorly led individuals as occurred at Abu Ghraib. Strategic consequences flow from serious breaches of trust.<\/p>\n

The fight can\u2019t be solely about countering the adversary. We need to protect what we have and ensure that we don\u2019t throw it away through frustration and the desire to report a success. Freedom is not free and, once squandered, can\u2019t be regained without tumultuous change. For democratic states, people\u2019s and partners\u2019 trust<\/a> in national institutions is a central requirement. While \u2018trust\u2019 is an increasingly flexible concept, short-term wins have negative long-term strategic consequences. Bellingcat\u2019s<\/a> work to separate fact from fiction and correctly attribute online influence efforts provides a great longitudinal view of the increasing number of states or strategic agencies attempting to \u2018win\u2019. It\u2019s also a sobering insight into the fragility of the concepts behind engaging in clandestine or covert actions while outsourcing delivery and hiding in the sea of big data. Here, hubris is increasingly obvious.<\/p>\n

The third factor\u2014statistical inference software (unhelpfully known as artificial intelligence, or AI)\u2014offers high-speed information sorting. The technology is a crucial part of the response to the data deluge in the national security sphere. But AI might never accomplish the simulated assembly of complex information, knowledge, understanding and illusion that gives rise to narrative identity. We accrue intellectual debt<\/a> when we offload cognitive tasks. It would take historically epic hubris to contend that statistical inference can replace or even augment this process. It stretches credulity even further to suggest that states should attempt such interventions as they grapple with the uncertainty of the digital age. The price of hubris could be a type of hidden defeat<\/a>.<\/p>\n

Intervening in human complexity is permanently fraught. If we believe an adversary is conducting such activities<\/a>, why not let them fail? No current technology offers a way out that doesn\u2019t include significant societal costs. Statistical inference software helps in sorting and analysing information that\u2019s bounded and discrete\u2014the identification of threat signatures in cyberattacks is one example. Expecting this technology to play a meaningful role in the complex assembly of narrative and meaning, however, is to make a scientifically unsupported leap of faith.<\/p>\n

Expecting humans and the machines they make to become the authors and architects of narrative meaning, without exacerbating the very problem they\u2019re supposedly attempting to mitigate, is an old fantasy using some new gadgets. It never ends well.<\/p>\n

The astute approach to what humans and the machines they make can do to help tell truth from falsity\u2014this oldest of human conundrums\u2014requires a large dose of sceptical conservatism from the national security community. Australia has an open, democratic social fabric to protect and strengthen. Truth may be a partly human fiction, but it\u2019s one of the most important fictions a nation can conceive. Turning it over to algorithmic alchemy and a handful of central controllers in a frenzy of presentism is the fastest way to unravel the whole tapestry.<\/p>\n","protected":false},"excerpt":{"rendered":"

As Felipe Fern\u00e1ndez-Armesto points out in his 2019 Out of our minds: what we think and how we came to think it, ideas about how humans tell truth from falsity are among the oldest and …<\/p>\n","protected":false},"author":1020,"featured_media":53557,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"footnotes":""},"categories":[1],"tags":[106,1778,932,332],"class_list":["post-53550","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-general","tag-democracy","tag-propaganda","tag-security","tag-technology"],"acf":[],"yoast_head":"\nTruth as fiction: the dangers of hubris in the information environment | The Strategist<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.aspistrategist.ru\/truth-as-fiction-the-dangers-of-hubris-in-the-information-environment\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Truth as fiction: the dangers of hubris in the information environment | The Strategist\" \/>\n<meta property=\"og:description\" content=\"As Felipe Fern\u00e1ndez-Armesto points out in his 2019 Out of our minds: what we think and how we came to think it, ideas about how humans tell truth from falsity are among the oldest and ...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.aspistrategist.ru\/truth-as-fiction-the-dangers-of-hubris-in-the-information-environment\/\" \/>\n<meta property=\"og:site_name\" content=\"The Strategist\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/ASPI.org\" \/>\n<meta property=\"article:published_time\" content=\"2020-02-14T00:00:12+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-02-13T23:58:09+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2020\/02\/GettyImages-161904483.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"810\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Zac Rogers\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@ASPI_org\" \/>\n<meta name=\"twitter:site\" content=\"@ASPI_org\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Zac Rogers\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.aspistrategist.ru\/#website\",\"url\":\"https:\/\/www.aspistrategist.ru\/\",\"name\":\"The Strategist\",\"description\":\"ASPI's analysis and commentary site\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.aspistrategist.ru\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-AU\"},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-AU\",\"@id\":\"https:\/\/www.aspistrategist.ru\/truth-as-fiction-the-dangers-of-hubris-in-the-information-environment\/#primaryimage\",\"url\":\"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2020\/02\/GettyImages-161904483.jpg\",\"contentUrl\":\"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2020\/02\/GettyImages-161904483.jpg\",\"width\":1024,\"height\":810,\"caption\":\"JAN 15 1975, JAN 22 1975, JAN 13 1976; Polygraph Screening Service Inc.; (Photo By Ira Gay Sealy\/The Denver Post via Getty Images)\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.aspistrategist.ru\/truth-as-fiction-the-dangers-of-hubris-in-the-information-environment\/\",\"url\":\"https:\/\/www.aspistrategist.ru\/truth-as-fiction-the-dangers-of-hubris-in-the-information-environment\/\",\"name\":\"Truth as fiction: the dangers of hubris in the information environment | The Strategist\",\"isPartOf\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/truth-as-fiction-the-dangers-of-hubris-in-the-information-environment\/#primaryimage\"},\"datePublished\":\"2020-02-14T00:00:12+00:00\",\"dateModified\":\"2020-02-13T23:58:09+00:00\",\"author\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/0bce3575c1fa769ec1d0e22e7e7a8bd7\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/truth-as-fiction-the-dangers-of-hubris-in-the-information-environment\/#breadcrumb\"},\"inLanguage\":\"en-AU\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.aspistrategist.ru\/truth-as-fiction-the-dangers-of-hubris-in-the-information-environment\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.aspistrategist.ru\/truth-as-fiction-the-dangers-of-hubris-in-the-information-environment\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.aspistrategist.ru\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Truth as fiction: the dangers of hubris in the information environment\"}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/0bce3575c1fa769ec1d0e22e7e7a8bd7\",\"name\":\"Zac Rogers\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-AU\",\"@id\":\"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/97c401b837fe271f4d3238f786b5a2dd?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/97c401b837fe271f4d3238f786b5a2dd?s=96&d=mm&r=g\",\"caption\":\"Zac Rogers\"},\"url\":\"https:\/\/www.aspistrategist.ru\/author\/zac-rogers\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Truth as fiction: the dangers of hubris in the information environment | The Strategist","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.aspistrategist.ru\/truth-as-fiction-the-dangers-of-hubris-in-the-information-environment\/","og_locale":"en_US","og_type":"article","og_title":"Truth as fiction: the dangers of hubris in the information environment | The Strategist","og_description":"As Felipe Fern\u00e1ndez-Armesto points out in his 2019 Out of our minds: what we think and how we came to think it, ideas about how humans tell truth from falsity are among the oldest and ...","og_url":"https:\/\/www.aspistrategist.ru\/truth-as-fiction-the-dangers-of-hubris-in-the-information-environment\/","og_site_name":"The Strategist","article_publisher":"https:\/\/www.facebook.com\/ASPI.org","article_published_time":"2020-02-14T00:00:12+00:00","article_modified_time":"2020-02-13T23:58:09+00:00","og_image":[{"width":1024,"height":810,"url":"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2020\/02\/GettyImages-161904483.jpg","type":"image\/jpeg"}],"author":"Zac Rogers","twitter_card":"summary_large_image","twitter_creator":"@ASPI_org","twitter_site":"@ASPI_org","twitter_misc":{"Written by":"Zac Rogers","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebSite","@id":"https:\/\/www.aspistrategist.ru\/#website","url":"https:\/\/www.aspistrategist.ru\/","name":"The Strategist","description":"ASPI's analysis and commentary site","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.aspistrategist.ru\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-AU"},{"@type":"ImageObject","inLanguage":"en-AU","@id":"https:\/\/www.aspistrategist.ru\/truth-as-fiction-the-dangers-of-hubris-in-the-information-environment\/#primaryimage","url":"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2020\/02\/GettyImages-161904483.jpg","contentUrl":"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2020\/02\/GettyImages-161904483.jpg","width":1024,"height":810,"caption":"JAN 15 1975, JAN 22 1975, JAN 13 1976; Polygraph Screening Service Inc.; (Photo By Ira Gay Sealy\/The Denver Post via Getty Images)"},{"@type":"WebPage","@id":"https:\/\/www.aspistrategist.ru\/truth-as-fiction-the-dangers-of-hubris-in-the-information-environment\/","url":"https:\/\/www.aspistrategist.ru\/truth-as-fiction-the-dangers-of-hubris-in-the-information-environment\/","name":"Truth as fiction: the dangers of hubris in the information environment | The Strategist","isPartOf":{"@id":"https:\/\/www.aspistrategist.ru\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.aspistrategist.ru\/truth-as-fiction-the-dangers-of-hubris-in-the-information-environment\/#primaryimage"},"datePublished":"2020-02-14T00:00:12+00:00","dateModified":"2020-02-13T23:58:09+00:00","author":{"@id":"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/0bce3575c1fa769ec1d0e22e7e7a8bd7"},"breadcrumb":{"@id":"https:\/\/www.aspistrategist.ru\/truth-as-fiction-the-dangers-of-hubris-in-the-information-environment\/#breadcrumb"},"inLanguage":"en-AU","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.aspistrategist.ru\/truth-as-fiction-the-dangers-of-hubris-in-the-information-environment\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.aspistrategist.ru\/truth-as-fiction-the-dangers-of-hubris-in-the-information-environment\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.aspistrategist.ru\/"},{"@type":"ListItem","position":2,"name":"Truth as fiction: the dangers of hubris in the information environment"}]},{"@type":"Person","@id":"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/0bce3575c1fa769ec1d0e22e7e7a8bd7","name":"Zac Rogers","image":{"@type":"ImageObject","inLanguage":"en-AU","@id":"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/97c401b837fe271f4d3238f786b5a2dd?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/97c401b837fe271f4d3238f786b5a2dd?s=96&d=mm&r=g","caption":"Zac Rogers"},"url":"https:\/\/www.aspistrategist.ru\/author\/zac-rogers\/"}]}},"_links":{"self":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts\/53550"}],"collection":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/users\/1020"}],"replies":[{"embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/comments?post=53550"}],"version-history":[{"count":4,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts\/53550\/revisions"}],"predecessor-version":[{"id":53552,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts\/53550\/revisions\/53552"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/media\/53557"}],"wp:attachment":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/media?parent=53550"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/categories?post=53550"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/tags?post=53550"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}