{"id":82112,"date":"2023-10-11T06:00:07","date_gmt":"2023-10-10T19:00:07","guid":{"rendered":"https:\/\/www.aspistrategist.ru\/?p=82112"},"modified":"2023-10-10T17:14:45","modified_gmt":"2023-10-10T06:14:45","slug":"artificial-intelligence-and-the-future-of-humanity","status":"publish","type":"post","link":"https:\/\/www.aspistrategist.ru\/artificial-intelligence-and-the-future-of-humanity\/","title":{"rendered":"Artificial intelligence and the future of humanity"},"content":{"rendered":"
<\/figure>\n

Thinking and learning about artificial intelligence are the mental equivalent of a fission chain reaction. The questions get really big, really quickly.<\/p>\n

The most familiar concerns revolve around short-term impacts: the opportunities for economic productivity, health care, manufacturing, education, solving global challenges such as climate change and, on the flip side, the risks of mass unemployment, disinformation, killer robots, and concentrations of economic and strategic power.<\/p>\n

Each of these is critical, but they\u2019re only the most immediate considerations. The deeper issue is our capacity to live meaningful, fulfilling lives in a world in which we no longer have intelligence supremacy.<\/p>\n

As long as humanity has existed, we\u2019ve had an effective monopoly on intelligence. We have been, as far as we know, the smartest entities in the universe.<\/p>\n

At its most noble, this extraordinary gift of our evolution drives us to explore, discover and expand. Over the past roughly 50,000 years\u2014accelerating 10,000 years ago and then even more steeply from around 300 years ago\u2014we\u2019ve built a vast intellectual empire made up of science, philosophy, theology, engineering, storytelling, art, technology and culture.<\/p>\n

If our civilisations\u2014and in varying ways our individual lives\u2014have meaning, it is found in this constant exploration, discovery and intellectual expansion.<\/p>\n

Intelligence is the raw material for it all. But what happens when we\u2019re no longer the smartest beings in the universe? We haven\u2019t yet achieved artificial general intelligence (AGI)\u2014the term for an AI that could do anything we can do. But there\u2019s no barrier in principle to doing so, and no reason it wouldn\u2019t quickly outstrip us by orders of magnitude.<\/p>\n

Even if we solve the economic equality questions through something like a universal basic income and replace notions of \u2018paid work\u2019 with \u2018meaningful activity\u2019, how are we going to spend our lives in ways that we find meaningful, given that we\u2019ve evolved to strive and thrive and compete?<\/p>\n

Picture the conflict that arises for human nature if an AGI or ASI (artificial superintelligence) could answer all of our most profound questions and solve all of our problems. How much satisfaction do we get from having the solutions handed to us? Worse still, imagine the wistful sense of consolation at being shown an answer and finding we\u2019re too stupid to understand it.<\/p>\n

Eventually, we\u2019re going to face the prospect that we\u2019re no longer in charge of our civilisation\u2019s intelligence output. If that seems speculative, we\u2019re actually already creeping in that direction with large language models. Ask ChatGPT to write an 800-word opinion article on, say, whether the Reserve Bank of Australia should raise interest rates further. It does a decent job\u2014not a brilliant one, but a gullible editor would probably publish it and it certainly could be used as the basis for a sensible dinner party conversation. You might edit it, cherrypick the bits you agree with and thereby tell yourself these are your views on the issue. But they\u2019re not; they\u2019re ChatGPT\u2019s views and you\u2019re going along with them.<\/p>\n

Generative AI is an amazing achievement and a valuable resource, but we have to be clear-eyed about where these tools might take us.<\/p>\n

This is not about AI going wrong. To be sure, there\u2019s a pressing urgency for more work on AI alignment so that we don\u2019t give powerful AIs instructions that sound sensible but go horribly wrong because we can never describe exactly what we want. AI pioneer Stuart Russell has compared this to the King Midas story. Turning everything into gold by touching it sounds fantastic until you try to eat an apple or hug your kids.<\/p>\n

But beyond alignment lies the question of where we\u2019re left, even if we get it all right. What do we do with ourselves?<\/p>\n

Optimistic commentators argue that human opportunities will only expand. After all, there have been great breakthroughs in the past that enhanced us rather than made us redundant. But AGI is categorically different.<\/p>\n

Horses and machines replaced our muscles. Factories replaced our organised physical labour. Instruments such as calculators and computers have replaced specific mental tasks, while communications technology improves our cooperation and hence our collective intelligence. Narrow AI can enhance us by freeing us from routine tasks, enabling us to concentrate on higher level strategic goals and improving our productivity. But with AGI, we\u2019re talking about something that could supersede all applications of human intelligence. A model that can plan, strategise, organise, pursue very high-level directions and even form its own goals would leave an ever-diminishing set of tasks for us to do ourselves.<\/p>\n

The physicist Max Tegmark, co-founder of the Future of Life Institute, has compared AGI to a rising ocean, with human intellectual tasks occupying shrinking land masses that eventually become small islands left for our intelligence to perch on.<\/p>\n

One thing we will keep is our humanness. Freedom to spend more time doing what we want should be a gift. We can spend more time being parents, spouses, family members, friends, social participants\u2014things that by definition only humans can fully give to other humans. The slog of paid work need not be the only thing that gives us meaning\u2014indeed it would be sad if we fell apart without it.<\/p>\n

Equally, we have always earned our living since we hunted and gathered, so a transition to a post-scarcity, post-work world will be a social experiment like no other. Exercising our humanness towards one another might continue to be enough, but we will need to radically reorientate our customs and beliefs about what it means to be a valued member of the human race. (Even our humanness might be an eroding land mass; generative AI\u2019s creative powers and ability to simulate empathy have already reached levels we didn\u2019t anticipate just a couple of years ago.)<\/p>\n

A real possibility is that we integrate our brains with AI to avoid being left behind by it. Elon Musk\u2019s Neuralink is the best-known enterprise in this field, but there\u2019s plenty of other work going on. Maybe humans will keep up with AI by merging with it, but then that raises the question of at what point we diverge from being human.<\/p>\n

Maybe you\u2019re a transhumanist or a technology futurist and you just don\u2019t care whether the intelligence that inherits the world is recognisably human or even biological. What does it matter? Maybe we should bequeath this great endowment to silicon and accept that we were only ever meant to be a spark that ignited the true god-like power of intelligence on other substrates.<\/p>\n

That is a risky position. We can\u2019t assume that a future superintelligence will carry forward our values and goals, unless we take enormous care to build it that way. Sure, human values and goals are often far from perfect, but they have improved over our history through the accumulation of principles such as human rights. Even if we\u2019re sometimes loath to acknowledge it, the human story is one of progress.<\/p>\n

Imagine if our non-biological descendants had no inner subjective experience\u2014the weird thing called consciousness that enables us to marvel at a scientific theory or feel a sense of achievement at having sweated our way to success at some ambitious task. What if they were to solve the deepest riddles of the universe yet feel no sense of wonder at what they\u2019d done?<\/p>\n

Over the long span of the future, AI needs to serve the interests of humanity, not the other way around. Humans won\u2019t be here forever, but let\u2019s make sure that the future of intelligence represents a controlled evolution, not a radical breach, of the values we\u2019ve built and the wisdom we\u2019ve earned over millennia.<\/p>\n

There is a lot we can do. We need to avoid, for instance, letting commercial or geopolitical pressure drive reckless haste in developing powerful AIs. We need to think and debate very carefully the prospect of giving AIs the power to form their own goals or pursue very general goals on our behalf. Giving an AI the instruction to \u2018go out and make me a pile of money\u2019 isn\u2019t going to end well. At some point, the discussion will become less about intelligence and more about agency and the ability to achieve actual outcomes in the world.<\/p>\n

Ensuring that a future AGI does not leave us behind will likely mean putting some limitations on development\u2014even temporarily\u2014while we think through the implications of the technology and find ways to keep it tethered to human values and aspirations. As the neural network pioneer Geoffrey Hinton has put it, \u2018There is not a good track record of less intelligent things controlling things of greater intelligence.\u2019<\/p>\n

I\u2019m certainly not looking forward to any future in which AI treats humans like pets, as Apple co-founder Steve Wozniak once speculated.<\/p>\n

With that in mind, this is the first piece in a new Strategist<\/em> series that will look at artificial intelligence over the coming months as part of this ongoing and vital debate.<\/p>\n

ASPI is a national security and international policy think tank, so we\u2019ll be focusing on security and international dimensions. But what I\u2019ve outlined here is really the ultimate human security issue, which is our global future and our ability to continue to live meaningful lives. This is the biggest question we are facing right now and arguably the biggest we have ever faced.<\/p>\n","protected":false},"excerpt":{"rendered":"

Thinking and learning about artificial intelligence are the mental equivalent of a fission chain reaction. The questions get really big, really quickly. The most familiar concerns revolve around short-term impacts: the opportunities for economic productivity, …<\/p>\n","protected":false},"author":1651,"featured_media":82113,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"footnotes":""},"categories":[1],"tags":[1291,2651,3173,332,444],"class_list":["post-82112","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-general","tag-artificial-intelligence","tag-human-security","tag-society","tag-technology","tag-values","dinkus-of-minds-and-machines-an-ai-series"],"acf":[],"yoast_head":"\nArtificial intelligence and the future of humanity | The Strategist<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.aspistrategist.ru\/artificial-intelligence-and-the-future-of-humanity\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Artificial intelligence and the future of humanity | The Strategist\" \/>\n<meta property=\"og:description\" content=\"Thinking and learning about artificial intelligence are the mental equivalent of a fission chain reaction. The questions get really big, really quickly. The most familiar concerns revolve around short-term impacts: the opportunities for economic productivity, ...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.aspistrategist.ru\/artificial-intelligence-and-the-future-of-humanity\/\" \/>\n<meta property=\"og:site_name\" content=\"The Strategist\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/ASPI.org\" \/>\n<meta property=\"article:published_time\" content=\"2023-10-10T19:00:07+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-10-10T06:14:45+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2023\/09\/GettyImages-1404749040.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"788\" \/>\n\t<meta property=\"og:image:height\" content=\"443\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"David Wroe\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@ASPI_org\" \/>\n<meta name=\"twitter:site\" content=\"@ASPI_org\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"David Wroe\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"8 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.aspistrategist.ru\/#website\",\"url\":\"https:\/\/www.aspistrategist.ru\/\",\"name\":\"The Strategist\",\"description\":\"ASPI's analysis and commentary site\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.aspistrategist.ru\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-AU\"},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-AU\",\"@id\":\"https:\/\/www.aspistrategist.ru\/artificial-intelligence-and-the-future-of-humanity\/#primaryimage\",\"url\":\"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2023\/09\/GettyImages-1404749040.jpg\",\"contentUrl\":\"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2023\/09\/GettyImages-1404749040.jpg\",\"width\":788,\"height\":443,\"caption\":\"Robot and young woman face to face.\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.aspistrategist.ru\/artificial-intelligence-and-the-future-of-humanity\/\",\"url\":\"https:\/\/www.aspistrategist.ru\/artificial-intelligence-and-the-future-of-humanity\/\",\"name\":\"Artificial intelligence and the future of humanity | The Strategist\",\"isPartOf\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/artificial-intelligence-and-the-future-of-humanity\/#primaryimage\"},\"datePublished\":\"2023-10-10T19:00:07+00:00\",\"dateModified\":\"2023-10-10T06:14:45+00:00\",\"author\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/1a96b01d6160dcf217df305b20304728\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.aspistrategist.ru\/artificial-intelligence-and-the-future-of-humanity\/#breadcrumb\"},\"inLanguage\":\"en-AU\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.aspistrategist.ru\/artificial-intelligence-and-the-future-of-humanity\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.aspistrategist.ru\/artificial-intelligence-and-the-future-of-humanity\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.aspistrategist.ru\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Artificial intelligence and the future of humanity\"}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/1a96b01d6160dcf217df305b20304728\",\"name\":\"David Wroe\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-AU\",\"@id\":\"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/090fffcb8ca56c2e18c2b4262a71c8e5?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/090fffcb8ca56c2e18c2b4262a71c8e5?s=96&d=mm&r=g\",\"caption\":\"David Wroe\"},\"url\":\"https:\/\/www.aspistrategist.ru\/author\/david-wroe\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Artificial intelligence and the future of humanity | The Strategist","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.aspistrategist.ru\/artificial-intelligence-and-the-future-of-humanity\/","og_locale":"en_US","og_type":"article","og_title":"Artificial intelligence and the future of humanity | The Strategist","og_description":"Thinking and learning about artificial intelligence are the mental equivalent of a fission chain reaction. The questions get really big, really quickly. The most familiar concerns revolve around short-term impacts: the opportunities for economic productivity, ...","og_url":"https:\/\/www.aspistrategist.ru\/artificial-intelligence-and-the-future-of-humanity\/","og_site_name":"The Strategist","article_publisher":"https:\/\/www.facebook.com\/ASPI.org","article_published_time":"2023-10-10T19:00:07+00:00","article_modified_time":"2023-10-10T06:14:45+00:00","og_image":[{"width":788,"height":443,"url":"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2023\/09\/GettyImages-1404749040.jpg","type":"image\/jpeg"}],"author":"David Wroe","twitter_card":"summary_large_image","twitter_creator":"@ASPI_org","twitter_site":"@ASPI_org","twitter_misc":{"Written by":"David Wroe","Est. reading time":"8 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebSite","@id":"https:\/\/www.aspistrategist.ru\/#website","url":"https:\/\/www.aspistrategist.ru\/","name":"The Strategist","description":"ASPI's analysis and commentary site","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.aspistrategist.ru\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-AU"},{"@type":"ImageObject","inLanguage":"en-AU","@id":"https:\/\/www.aspistrategist.ru\/artificial-intelligence-and-the-future-of-humanity\/#primaryimage","url":"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2023\/09\/GettyImages-1404749040.jpg","contentUrl":"https:\/\/www.aspistrategist.ru\/wp-content\/uploads\/2023\/09\/GettyImages-1404749040.jpg","width":788,"height":443,"caption":"Robot and young woman face to face."},{"@type":"WebPage","@id":"https:\/\/www.aspistrategist.ru\/artificial-intelligence-and-the-future-of-humanity\/","url":"https:\/\/www.aspistrategist.ru\/artificial-intelligence-and-the-future-of-humanity\/","name":"Artificial intelligence and the future of humanity | The Strategist","isPartOf":{"@id":"https:\/\/www.aspistrategist.ru\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.aspistrategist.ru\/artificial-intelligence-and-the-future-of-humanity\/#primaryimage"},"datePublished":"2023-10-10T19:00:07+00:00","dateModified":"2023-10-10T06:14:45+00:00","author":{"@id":"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/1a96b01d6160dcf217df305b20304728"},"breadcrumb":{"@id":"https:\/\/www.aspistrategist.ru\/artificial-intelligence-and-the-future-of-humanity\/#breadcrumb"},"inLanguage":"en-AU","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.aspistrategist.ru\/artificial-intelligence-and-the-future-of-humanity\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.aspistrategist.ru\/artificial-intelligence-and-the-future-of-humanity\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.aspistrategist.ru\/"},{"@type":"ListItem","position":2,"name":"Artificial intelligence and the future of humanity"}]},{"@type":"Person","@id":"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/1a96b01d6160dcf217df305b20304728","name":"David Wroe","image":{"@type":"ImageObject","inLanguage":"en-AU","@id":"https:\/\/www.aspistrategist.ru\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/090fffcb8ca56c2e18c2b4262a71c8e5?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/090fffcb8ca56c2e18c2b4262a71c8e5?s=96&d=mm&r=g","caption":"David Wroe"},"url":"https:\/\/www.aspistrategist.ru\/author\/david-wroe\/"}]}},"_links":{"self":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts\/82112"}],"collection":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/users\/1651"}],"replies":[{"embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/comments?post=82112"}],"version-history":[{"count":6,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts\/82112\/revisions"}],"predecessor-version":[{"id":82115,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/posts\/82112\/revisions\/82115"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/media\/82113"}],"wp:attachment":[{"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/media?parent=82112"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/categories?post=82112"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.aspistrategist.ru\/wp-json\/wp\/v2\/tags?post=82112"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}