{"id":46302,"date":"2019-03-19T15:11:28","date_gmt":"2019-03-19T04:11:28","guid":{"rendered":"https:\/\/www.aspistrategist.ru\/?p=46302"},"modified":"2019-03-19T15:11:28","modified_gmt":"2019-03-19T04:11:28","slug":"algorithms-wont-stop-the-spread-of-live-streamed-terror","status":"publish","type":"post","link":"https:\/\/www.aspistrategist.ru\/algorithms-wont-stop-the-spread-of-live-streamed-terror\/","title":{"rendered":"Algorithms won\u2019t stop the spread of live-streamed terror"},"content":{"rendered":"
<\/figure>\n

In the wake of the Christchurch attacks, the internet giants Facebook, Google and Twitter have come under pressure for failing to prevent the killer from using their platforms to share his message, including live-streaming the shooting.<\/p>\n

While some of this criticism may be deserved, what this episode really shows is that automated systems for detecting and removing terrorist content are still no match for humans determined to promote vile messages.<\/p>\n

New Zealand Prime Minister Jacinda Ardern said<\/a> on Sunday that she intended to ask Facebook how the terrorist was able to live-stream his attack on its platform for a full 17 minutes. In a matter of moments, the footage was ricocheting around the internet, not just on Facebook but on YouTube, Google, Twitter, Reddit and a host of smaller social media and video-sharing platforms.<\/p>\n

\u2018I do think there are further questions to be answered\u2019, Ardern said. \u2018These social media platforms have wide reach. This is a problem which goes well beyond New Zealand \u2026 So whilst we might have seen action taken here, that hasn\u2019t prevented [the video] being circulated beyond New Zealand\u2019s shores.\u2019<\/p>\n

The social media giants have been quick to highlight their efforts to stop the footage from spreading. Facebook, which also owns Instagram and WhatsApp, said<\/a> on Monday that it had removed over 1.5\u00a0million copies of the footage in just the first 24 hours after the attack, 80% of which were blocked immediately when the user attempted to upload them.<\/p>\n

Google, which also owns YouTube, deleted the terrorist\u2019s YouTube account before he was able to upload footage of the attack, but said<\/a> the number of copies and related videos being uploaded was \u2018unprecedented in scale and speed, at times as fast as a new upload every second\u2019. In response, Google called in its \u2018war room\u2019 of crisis responders and removed tens of thousands of videos which were automatically flagged as containing even a 5% match to the footage. For the first time, the company even \u2018broke\u2019 parts of YouTube\u2019s own search function to make it more difficult for viewers to find copies of the video.<\/p>\n

Twitter has been the least forthcoming of the three major platforms about what action it has taken to prevent the footage from proliferating, simply saying that it is \u2018continuously monitoring<\/a>\u2019 content uploaded to the platform. As of Tuesday morning, it was still possible to find links to the entire, uncensored footage on Twitter within seconds with a simple search.<\/p>\n

Under the circumstances, it\u2019s fair to ask whether platforms are really doing enough. At the same time, it\u2019s important to recognise the scale and nature of the challenge they\u2019re up against. We shouldn\u2019t allow (justifiable) anger at the platforms and their fallible algorithms to distract us from where the lion\u2019s share of the blame really lies: the human users who are actively uploading, promoting and sharing this content.<\/p>\n

The killer wanted his message to go viral and, as a native of the dark corners of the internet where far-right extremism grows like poisonous mushrooms, he knew how to make it happen.<\/p>\n

There is significant evidence that he planned his communications campaign well in advance of the attack. Moments before the shooting began, he posted an 18,300 word \u2018manifesto\u2019 on Twitter, uploaded multiple times across three platforms in a clear effort to make it more difficult to take down. (As of Tuesday morning, the manifesto was also still easily accessible online as the first result in a simple Google search, despite the apparent efforts of hosting providers like Document Cloud to take it down.)<\/p>\n

The gunman announced his attack and shared the link to the live-stream on 8chan\/pol\/, one of the\u00a0 mouldy internet corners frequented by the kind of people who could be relied on to not only watch but gleefully promote his video and his message. \u2018Please do your part by spreading my message, making memes and shitposting<\/a> as you usually do\u2019, he wrote.<\/p>\n

And they did\u2014or at least some of them did. Others were divided as to whether it was an attempt to entrap them in either a communist, FBI, Islamic or Jewish conspiracy, because that\u2019s how people in these forums think.<\/p>\n

Recordings of the initial live-stream were downloaded, saved and shared across a network of far-right and white nationalist forums. Users were uploading new versions faster than the platform providers could take them down. Google says that it deleted hundreds of YouTube accounts which were created after the shooting specifically to share the shooting footage or express sympathy with the perpetrator.<\/p>\n

Some of the more tech-savvy users also took deliberate steps to circumvent the platform\u2019s automated systems for recognising terrorist content. Facebook, Google, Twitter and a number of other major digital companies share \u2018hashes\u2019 (sort of like digital fingerprints) of problematic content via a specialised database<\/a>. This is what Google was referring to when it said it was taking down videos with even a 5% match to the footage\u2014its algorithms were comparing every new video to the hash of the original live-stream, and blocking everything with even a partial match.<\/p>\n

But hashes are easy to break. Small alterations, such as skewing the video\u2019s size or adding a watermark, can be enough to prevent the system from recognising the video, and that\u2019s precisely what many of the uploaders did. Millions of copies may have been caught on upload, but far more clearly slipped through the net. Realistically, this footage will almost certainly never be entirely scrubbed from the web.<\/p>\n

This tragedy should serve as a wakeup call to the internet giants. The weaponisation of information networks is not new, but the digital architecture of the major platforms creates unprecedented opportunities for bad actors to spread their message across the globe in minutes, and to keep it out there indefinitely for as long as extremists continue to lurk, like colonies of mould, in the nooks and crannies of the internet.<\/p>\n

And as this episode shows, for all their expertise and resources, the platforms\u2019 automated systems are not yet enough to stop the spores from spreading.<\/p>\n","protected":false},"excerpt":{"rendered":"

In the wake of the Christchurch attacks, the internet giants Facebook, Google and Twitter have come under pressure for failing to prevent the killer from using their platforms to share his message, including live-streaming the …<\/p>\n","protected":false},"author":899,"featured_media":46304,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"footnotes":""},"categories":[1],"tags":[2443,1756,300,224,127],"class_list":["post-46302","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-general","tag-christchurch","tag-facebook","tag-google","tag-social-media","tag-terrorism"],"acf":[],"yoast_head":"\nAlgorithms won\u2019t stop the spread of live-streamed terror | The Strategist<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.aspistrategist.ru\/algorithms-wont-stop-the-spread-of-live-streamed-terror\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Algorithms won\u2019t stop the spread of live-streamed terror | The Strategist\" \/>\n<meta property=\"og:description\" content=\"In the wake of the Christchurch attacks, the internet giants Facebook, Google and Twitter have come under pressure for failing to prevent the killer from using their platforms to share his message, including live-streaming the ...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.aspistrategist.ru\/algorithms-wont-stop-the-spread-of-live-streamed-terror\/\" \/>\n<meta property=\"og:site_name\" content=\"The Strategist\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/ASPI.org\" \/>\n<meta property=\"article:published_time\" content=\"2019-03-19T04:11:28+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2019\/03\/1903testpattern.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"640\" \/>\n\t<meta property=\"og:image:height\" content=\"400\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Elise Thomas\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@ASPI_org\" \/>\n<meta name=\"twitter:site\" content=\"@ASPI_org\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Elise Thomas\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.aspistrategist.ru\/#website\",\"url\":\"https:\/\/www.aspistrategist.ru\/\",\"name\":\"The Strategist\",\"description\":\"ASPI's analysis and commentary site\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.aspistrategist.ru\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-AU\"},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-AU\",\"@id\":\"https:\/\/www.aspistrategist.ru\/algorithms-wont-stop-the-spread-of-live-streamed-terror\/#primaryimage\",\"url\":\"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2019\/03\/1903testpattern.jpg\",\"contentUrl\":\"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2019\/03\/1903testpattern.jpg\",\"width\":640,\"height\":400},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.aspistrategist.ru\/algorithms-wont-stop-the-spread-of-live-streamed-terror\/\",\"url\":\"https:\/\/www.aspistrategist.ru\/algorithms-wont-stop-the-spread-of-live-streamed-terror\/\",\"name\":\"Algorithms won\u2019t stop the spread of live-streamed terror | The Strategist\",\"isPartOf\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/algorithms-wont-stop-the-spread-of-live-streamed-terror\/#primaryimage\"},\"datePublished\":\"2019-03-19T04:11:28+00:00\",\"dateModified\":\"2019-03-19T04:11:28+00:00\",\"author\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/f4be10158c8a81660d6248a3f55850f5\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/algorithms-wont-stop-the-spread-of-live-streamed-terror\/#breadcrumb\"},\"inLanguage\":\"en-AU\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.aspistrategist.ru\/algorithms-wont-stop-the-spread-of-live-streamed-terror\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.aspistrategist.ru\/algorithms-wont-stop-the-spread-of-live-streamed-terror\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.aspistrategist.ru\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Algorithms won\u2019t stop the spread of live-streamed terror\"}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/f4be10158c8a81660d6248a3f55850f5\",\"name\":\"Elise Thomas\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-AU\",\"@id\":\"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/5694011532b257e771c1162109c8d19f?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/5694011532b257e771c1162109c8d19f?s=96&d=mm&r=g\",\"caption\":\"Elise Thomas\"},\"url\":\"https:\/\/www.aspistrategist.ru\/author\/elise-thomas\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Algorithms won\u2019t stop the spread of live-streamed terror | The Strategist","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.aspistrategist.ru\/algorithms-wont-stop-the-spread-of-live-streamed-terror\/","og_locale":"en_US","og_type":"article","og_title":"Algorithms won\u2019t stop the spread of live-streamed terror | The Strategist","og_description":"In the wake of the Christchurch attacks, the internet giants Facebook, Google and Twitter have come under pressure for failing to prevent the killer from using their platforms to share his message, including live-streaming the ...","og_url":"https:\/\/www.aspistrategist.ru\/algorithms-wont-stop-the-spread-of-live-streamed-terror\/","og_site_name":"The Strategist","article_publisher":"https:\/\/www.facebook.com\/ASPI.org","article_published_time":"2019-03-19T04:11:28+00:00","og_image":[{"width":640,"height":400,"url":"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2019\/03\/1903testpattern.jpg","type":"image\/jpeg"}],"author":"Elise Thomas","twitter_card":"summary_large_image","twitter_creator":"@ASPI_org","twitter_site":"@ASPI_org","twitter_misc":{"Written by":"Elise Thomas","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebSite","@id":"https:\/\/www.aspistrategist.ru\/#website","url":"https:\/\/www.aspistrategist.ru\/","name":"The Strategist","description":"ASPI's analysis and commentary site","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.aspistrategist.ru\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-AU"},{"@type":"ImageObject","inLanguage":"en-AU","@id":"https:\/\/www.aspistrategist.ru\/algorithms-wont-stop-the-spread-of-live-streamed-terror\/#primaryimage","url":"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2019\/03\/1903testpattern.jpg","contentUrl":"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2019\/03\/1903testpattern.jpg","width":640,"height":400},{"@type":"WebPage","@id":"https:\/\/www.aspistrategist.ru\/algorithms-wont-stop-the-spread-of-live-streamed-terror\/","url":"https:\/\/www.aspistrategist.ru\/algorithms-wont-stop-the-spread-of-live-streamed-terror\/","name":"Algorithms won\u2019t stop the spread of live-streamed terror | The Strategist","isPartOf":{"@id":"https:\/\/www.aspistrategist.ru\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.aspistrategist.ru\/algorithms-wont-stop-the-spread-of-live-streamed-terror\/#primaryimage"},"datePublished":"2019-03-19T04:11:28+00:00","dateModified":"2019-03-19T04:11:28+00:00","author":{"@id":"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/f4be10158c8a81660d6248a3f55850f5"},"breadcrumb":{"@id":"https:\/\/www.aspistrategist.ru\/algorithms-wont-stop-the-spread-of-live-streamed-terror\/#breadcrumb"},"inLanguage":"en-AU","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.aspistrategist.ru\/algorithms-wont-stop-the-spread-of-live-streamed-terror\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.aspistrategist.ru\/algorithms-wont-stop-the-spread-of-live-streamed-terror\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.aspistrategist.ru\/"},{"@type":"ListItem","position":2,"name":"Algorithms won\u2019t stop the spread of live-streamed terror"}]},{"@type":"Person","@id":"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/f4be10158c8a81660d6248a3f55850f5","name":"Elise Thomas","image":{"@type":"ImageObject","inLanguage":"en-AU","@id":"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/5694011532b257e771c1162109c8d19f?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/5694011532b257e771c1162109c8d19f?s=96&d=mm&r=g","caption":"Elise Thomas"},"url":"https:\/\/www.aspistrategist.ru\/author\/elise-thomas\/"}]}},"_links":{"self":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts\/46302"}],"collection":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/users\/899"}],"replies":[{"embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/comments?post=46302"}],"version-history":[{"count":4,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts\/46302\/revisions"}],"predecessor-version":[{"id":46305,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts\/46302\/revisions\/46305"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/media\/46304"}],"wp:attachment":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/media?parent=46302"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/categories?post=46302"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/tags?post=46302"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}