{"id":10742,"date":"2013-11-14T13:30:49","date_gmt":"2013-11-14T02:30:49","guid":{"rendered":"http:\/\/www.aspistrategist.ru\/?p=10742"},"modified":"2013-11-15T08:50:18","modified_gmt":"2013-11-14T21:50:18","slug":"does-collecting-big-data-make-us-safer","status":"publish","type":"post","link":"https:\/\/www.aspistrategist.ru\/does-collecting-big-data-make-us-safer\/","title":{"rendered":"Does collecting big data make us safer?"},"content":{"rendered":"

The idea of\u00a0Big data<\/a>, the bane of privacy and civil liberty activists, now conjures up Edward Snowden, the NSA, and mass surveillance. It\u2019s also regularly presented as a critical tool for national security. So does it really keep us safe?<\/p>\n

Intelligence organisations argue that collecting big data helps keep us safe by providing the information to thwart terrorists and other nefarious actors. When we talk about big data, we are also talking about its collection and analysis. For organizations like the NSA, charged with the directive to \u2018process, analyze, produce, and disseminate signals intelligence information and data,\u2019 it is no surprise that big data represents a holy grail of sorts. But data alone isn\u2019t an intelligence product; the organization, interpretation, and analysis of data is what\u2019s important.<\/p>\n

The argument is that big data is worth what it costs. As one former U.S. intelligence official described<\/a> Gen. Keith Alexander\u2019s approach, \u2018rather than look for a single needle in the haystack\u2026let\u2019s collect the whole haystack.\u2019 After all, why would an intel organisation not want all the data it can get?<\/p>\n

Although the official line of \u201854 thwarted terrorist plots\u2019 has received its fair share of scrutiny, there is little doubt that the vast stores of data gathered by the NSA has produced at least some actionable intelligence. But the important question however is whether this method produces results which warrant the costs, including to privacy, compared to more targeted investigations.<\/p>\n

The primary challenge for any big data operation is resources. The procurement, storage, and processing of such a great volume of data is resource and labor intensive. The NSA\u2019s newest data center in Utah is slated to cost taxpayers $1.4 billion and that\u2019s not including the supercomputers that\u2019ll reside there. Operating costs are also significant. A look at the leaked Black Budget points to $10.8 billion in funding, and upwards of 35,000 employees slated for NSA operations, second only to the CIA in intelligence spending.<\/p>\n

This kind of data collection also impacts the resulting analysis. Gathering a database of records as large as the Library of Congress every six hours is no simple task, but sifting through it is much more challenging.<\/p>\n

Transforming the \u2018haystack\u2019 into intelligence is the trick. Analytics would need to rely on the use of identifiers, key words, and pattern recognition. And, true to the haystack metaphor, most of the data collected is irrelevant. 72.1 percent<\/a> of email communications are spam and only a miniscule proportion of intercepted communications are mission relevant. Automation helps, but programed searches often lack the refinement and depth needed for detailed investigatory work.<\/p>\n

Despite these vast droves of data, events ranging from the Arab Spring to the Boston bombing do fall through the cracks. Even big data gathering won\u2019t always identify and thwart the \u201clone wolves and small terrorist cells embracing violent rightwing extremist ideology\u201d that the Department of Homeland Security<\/a> has long deemed to be \u201cthe most dangerous domestic terrorism threat in the United States.\u201d And there are ways to bypass the type of wide-net intelligence gathering practices revealed by Edward Snowden. In fact the United States government is in many ways a major provider of such bypasses, from the State Departments support of Tor development to even the United States Postal Service. The sweeping surveillance of conventional communications channels are too broad to consistently identify outlier threats, while more organized or systemic threats can take advantage of the over reliance on this data.<\/p>\n

The appeal of big data for intelligence agencies is undeniable. But data lacks meaning until it has been analysed. And getting to the pertinent pieces of information in a big data set is no easy task. While there is clearly value in this approach, there appears to be an obsession with big data in the NSA and other intelligence organizations around the world. An overreliance on this method compared to others would be detrimental for their respective national security functions.<\/p>\n

Many have highlighted the challenge of balancing liberties and security, and this is a vital debate. But there has been a surprising lack of attention paid to the effectiveness or otherwise of mass surveillance while defending the approach in the name of counterterrorism.\u00a0 Those answers are of course hidden behind layers of security clearance. But to get a sense of whether big data warrants its cost to privacy, we need to develop a sense of whether it\u2019s really more effective than more targeted and warranted investigations.<\/p>\n

Klee Aiken will be joining ASPI as an analyst in the\u00a0International Cyber Policy Centre<\/a>.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

The idea of\u00a0Big data, the bane of privacy and civil liberty activists, now conjures up Edward Snowden, the NSA, and mass surveillance. It\u2019s also regularly presented as a critical tool for national security. So does …<\/p>\n","protected":false},"author":153,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"footnotes":""},"categories":[531],"tags":[391,624],"class_list":["post-10742","post","type-post","status-publish","format-standard","hentry","category-cyber-security-2","tag-cyber","tag-espionage"],"acf":[],"yoast_head":"\nDoes collecting big data make us safer? | The Strategist<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.aspistrategist.ru\/does-collecting-big-data-make-us-safer\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Does collecting big data make us safer? | The Strategist\" \/>\n<meta property=\"og:description\" content=\"The idea of\u00a0Big data, the bane of privacy and civil liberty activists, now conjures up Edward Snowden, the NSA, and mass surveillance. It\u2019s also regularly presented as a critical tool for national security. So does ...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.aspistrategist.ru\/does-collecting-big-data-make-us-safer\/\" \/>\n<meta property=\"og:site_name\" content=\"The Strategist\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/ASPI.org\" \/>\n<meta property=\"article:published_time\" content=\"2013-11-14T02:30:49+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2013-11-14T21:50:18+00:00\" \/>\n<meta name=\"author\" content=\"Kl\u00e9e Aiken\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@ASPI_org\" \/>\n<meta name=\"twitter:site\" content=\"@ASPI_org\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Kl\u00e9e Aiken\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.aspistrategist.ru\/#website\",\"url\":\"https:\/\/www.aspistrategist.ru\/\",\"name\":\"The Strategist\",\"description\":\"ASPI's analysis and commentary site\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.aspistrategist.ru\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-AU\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.aspistrategist.ru\/does-collecting-big-data-make-us-safer\/\",\"url\":\"https:\/\/www.aspistrategist.ru\/does-collecting-big-data-make-us-safer\/\",\"name\":\"Does collecting big data make us safer? | The Strategist\",\"isPartOf\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/#website\"},\"datePublished\":\"2013-11-14T02:30:49+00:00\",\"dateModified\":\"2013-11-14T21:50:18+00:00\",\"author\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/0b2cf82af9c5ffa5a44b13daf90f3f9f\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/does-collecting-big-data-make-us-safer\/#breadcrumb\"},\"inLanguage\":\"en-AU\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.aspistrategist.ru\/does-collecting-big-data-make-us-safer\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.aspistrategist.ru\/does-collecting-big-data-make-us-safer\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.aspistrategist.ru\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Does collecting big data make us safer?\"}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/0b2cf82af9c5ffa5a44b13daf90f3f9f\",\"name\":\"Kl\u00e9e Aiken\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-AU\",\"@id\":\"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/6f5557396a24a919df3f7396c9b60a7e?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/6f5557396a24a919df3f7396c9b60a7e?s=96&d=mm&r=g\",\"caption\":\"Kl\u00e9e Aiken\"},\"url\":\"https:\/\/www.aspistrategist.ru\/author\/klee-aiken\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Does collecting big data make us safer? | The Strategist","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.aspistrategist.ru\/does-collecting-big-data-make-us-safer\/","og_locale":"en_US","og_type":"article","og_title":"Does collecting big data make us safer? | The Strategist","og_description":"The idea of\u00a0Big data, the bane of privacy and civil liberty activists, now conjures up Edward Snowden, the NSA, and mass surveillance. It\u2019s also regularly presented as a critical tool for national security. So does ...","og_url":"https:\/\/www.aspistrategist.ru\/does-collecting-big-data-make-us-safer\/","og_site_name":"The Strategist","article_publisher":"https:\/\/www.facebook.com\/ASPI.org","article_published_time":"2013-11-14T02:30:49+00:00","article_modified_time":"2013-11-14T21:50:18+00:00","author":"Kl\u00e9e Aiken","twitter_card":"summary_large_image","twitter_creator":"@ASPI_org","twitter_site":"@ASPI_org","twitter_misc":{"Written by":"Kl\u00e9e Aiken","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebSite","@id":"https:\/\/www.aspistrategist.ru\/#website","url":"https:\/\/www.aspistrategist.ru\/","name":"The Strategist","description":"ASPI's analysis and commentary site","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.aspistrategist.ru\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-AU"},{"@type":"WebPage","@id":"https:\/\/www.aspistrategist.ru\/does-collecting-big-data-make-us-safer\/","url":"https:\/\/www.aspistrategist.ru\/does-collecting-big-data-make-us-safer\/","name":"Does collecting big data make us safer? | The Strategist","isPartOf":{"@id":"https:\/\/www.aspistrategist.ru\/#website"},"datePublished":"2013-11-14T02:30:49+00:00","dateModified":"2013-11-14T21:50:18+00:00","author":{"@id":"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/0b2cf82af9c5ffa5a44b13daf90f3f9f"},"breadcrumb":{"@id":"https:\/\/www.aspistrategist.ru\/does-collecting-big-data-make-us-safer\/#breadcrumb"},"inLanguage":"en-AU","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.aspistrategist.ru\/does-collecting-big-data-make-us-safer\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.aspistrategist.ru\/does-collecting-big-data-make-us-safer\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.aspistrategist.ru\/"},{"@type":"ListItem","position":2,"name":"Does collecting big data make us safer?"}]},{"@type":"Person","@id":"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/0b2cf82af9c5ffa5a44b13daf90f3f9f","name":"Kl\u00e9e Aiken","image":{"@type":"ImageObject","inLanguage":"en-AU","@id":"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/6f5557396a24a919df3f7396c9b60a7e?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/6f5557396a24a919df3f7396c9b60a7e?s=96&d=mm&r=g","caption":"Kl\u00e9e Aiken"},"url":"https:\/\/www.aspistrategist.ru\/author\/klee-aiken\/"}]}},"_links":{"self":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts\/10742"}],"collection":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/users\/153"}],"replies":[{"embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/comments?post=10742"}],"version-history":[{"count":4,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts\/10742\/revisions"}],"predecessor-version":[{"id":10770,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts\/10742\/revisions\/10770"}],"wp:attachment":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/media?parent=10742"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/categories?post=10742"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/tags?post=10742"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}