{"id":33824,"date":"2023-10-20T14:31:56","date_gmt":"2023-10-20T14:31:56","guid":{"rendered":"http:\/\/startupsmart.test\/2023\/10\/20\/of-cats-and-cliffs-the-ethical-dilemmas-of-the-driverless-car-startupsmart\/"},"modified":"2023-10-20T14:31:56","modified_gmt":"2023-10-20T14:31:56","slug":"of-cats-and-cliffs-the-ethical-dilemmas-of-the-driverless-car-startupsmart","status":"publish","type":"post","link":"https:\/\/www.startupsmart.com.au\/uncategorized\/of-cats-and-cliffs-the-ethical-dilemmas-of-the-driverless-car-startupsmart\/","title":{"rendered":"Of cats and cliffs: the ethical dilemmas of the driverless car &#8211; StartupSmart"},"content":{"rendered":"<div class=\"td-post-featured-image\"><img loading=\"lazy\" decoding=\"async\" width=\"445\" height=\"352\" itemprop=\"image\" class=\"entry-thumb\" src=\"\/wp-content\/uploads\/2015\/10\/l_decisions.png\" alt=\"\" title=\"l_decisions\"\/><\/div>\n<p>We make decisions every day based on risk \u2013 perhaps running across a road to catch a bus if the road is quiet, but not if it\u2019s busy. Sometimes these decisions must be made in an instant, in the face of dire circumstances: a child runs out in front of your car, but there are other dangers to either side, say a cat and a cliff. How do you decide? Do you risk your own safety to protect that of others?<\/p>\n<p>\u00a0<\/p>\n<p>Now that&nbsp;<a href=\"https:\/\/theconversation.com\/self-driving-cars-could-be-the-answer-to-congested-roads-33438\" target=\"_blank\" rel=\"noopener\">self-driving cars are here<\/a> and with no quick or sure way of overriding the controls \u2013 or even none at all \u2013 car manufacturers are faced with an algorithmic ethical dilemma. On-board computers in cars are already parking for us, driving on cruise control, and could take control in safety-critical situations. But that means they will be faced with the difficult choices that sometimes face humans.<\/p>\n<p>\u00a0<\/p>\n<p>How to programme a computer\u2019s ethical calculus?<\/p>\n<p>\u00a0<\/p>\n<ul>\n<li>Calculate      the lowest number of injuries for each possible outcome, and take that      route. Every living instance would be treated the same.<\/li>\n<li>Calculate      the lowest number of injuries for children for each possible outcome, and      take that route.<\/li>\n<li>Allocate      values of 10 for each human, four for a cat, two for a dog, and one for a      horse. Then calculate the total score for each in the impact, and take the      route with the lowest score. So a big group of dogs would rank more highly      than two cats, and the car would react to save the dogs.<\/li>\n<\/ul>\n<p>\u00a0<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-24841\" alt=\"tablesdcars\" height=\"133\" width=\"445\" src=\"\/wp-content\/uploads\/2015\/10\/tablesdcars.png\" srcset=\"https:\/\/startupsmart-uploads.s3.amazonaws.com\/uploads\/2015\/10\/tablesdcars-300x90.png 300w, https:\/\/startupsmart-uploads.s3.amazonaws.com\/uploads\/2015\/10\/tablesdcars-215x64.png 215w, https:\/\/startupsmart-uploads.s3.amazonaws.com\/uploads\/2015\/10\/tablesdcars-251x75.png 251w, https:\/\/startupsmart-uploads.s3.amazonaws.com\/uploads\/2015\/10\/tablesdcars.png 445w\" sizes=\"(max-width: 445px) 100vw, 445px\" \/><\/p>\n<p>\u00a0<\/p>\n<p>What if the car also included its driver and passengers in this assessment, with the implication that sometimes those outside the car would score more highly than those within it? Who would willingly climb aboard a car programmed to sacrifice them if needs be?<\/p>\n<p>\u00a0<\/p>\n<p><a href=\"http:\/\/arxiv.org\/abs\/1510.03346\" target=\"_blank\" rel=\"noopener\">A recent study<\/a> by Jean-Francois Bonnefon from the Toulouse School of Economics in France suggested that there\u2019s no right or wrong answer to these questions. The research used several hundred workers found through&nbsp;<a href=\"http:\/\/www.pbs.org\/newshour\/updates\/inside-amazons-hidden-science-factory\/\" target=\"_blank\" rel=\"noopener\">Amazon\u2019s Mechanical Turk<\/a> to analyse viewpoints on whether one or more pedestrians could be saved when a car swerves and hits a barrier, killing the driver. Then they varied the number of pedestrians who could be saved.<\/p>\n<p>\u00a0<\/p>\n<p>Bonnefon found that most people agreed with the principle of programming cars to minimise death toll, but when it came to the exact details of the scenarios they were less certain. They were keen for others to use self-driving cars, but less keen themselves. So people often feel a utilitarian instinct to save the lives of others and sacrifice the car\u2019s occupant, except when that occupant is them.<\/p>\n<p>\u00a0<\/p>\n<p><b>Intelligent machines<\/b><\/p>\n<p><b><br \/><\/b><\/p>\n<p><b> <\/b><\/p>\n<p>Science fiction writers have had plenty of leash to write about robots taking over the world (<a href=\"http:\/\/www.imdb.com\/title\/tt0088247\/\" target=\"_blank\" rel=\"noopener\">Terminator<\/a> and many others), or where everything that\u2019s said is recorded and analysed (such as in&nbsp;<a href=\"http:\/\/www.sparknotes.com\/lit\/1984\/\" target=\"_blank\" rel=\"noopener\">Orwell\u2019s 1984<\/a>). It\u2019s taken a while to reach this point, but many staples of science fiction are in the process of becoming mainstream science and technology. The internet and cloud computing have provided the platform upon which quantum leaps of progress are made, showcasing artificial intelligence against the human.<\/p>\n<p>\u00a0<\/p>\n<p>In Stanley Kubrick\u2019s seminal film&nbsp;<a href=\"http:\/\/www.imdb.com\/title\/tt0062622\/\" target=\"_blank\" rel=\"noopener\">2001: A Space Odyssey<\/a>, we see hints of a future, where computers make decisions on the priorities of their mission, with the ship\u2019s computer HAL saying: \u201cThis mission is too important for me to allow you to jeopardise it\u201d.<\/p>\n<p>\u00a0<\/p>\n<p> <iframe loading=\"lazy\" width=\"445\" height=\"250\" src=\"https:\/\/www.youtube.com\/embed\/qDrDUmuUBTo?rel=0\" frameborder=\"0\" allowfullscreen><\/iframe> <\/p>\n<p>\u00a0<\/p>\n<p>Machine intelligence is appearing in our devices, from phones to cars.&nbsp;<a href=\"http:\/\/download.intel.com\/newsroom\/kits\/ces\/2014\/pdfs\/TheIntelligentCar_infographic.pdf\" target=\"_blank\" rel=\"noopener\">Intel predicts<\/a> that there will be 152m connected cars by 2020, generating over 11 petabytes of data every year \u2013 enough to fill more than 40,000 250GB hard disks. How intelligent? As Intel puts it, (almost) as smart as you. Cars will share and analyse a range data in order to make decisions on the move. It\u2019s true enough that in most cases driverless cars are likely to be safer than humans, but it\u2019s the outliers that we\u2019re concerned with.<\/p>\n<p>\u00a0<\/p>\n<blockquote class=\"twitter-tweet\" lang=\"en\">\n<p lang=\"en\" dir=\"ltr\">The intelligent car, (almost) as smart as you. IoT will be a hot topic at <a href=\"https:\/\/twitter.com\/hashtag\/CES2014?src=hash\" target=\"_blank\" rel=\"noopener\">#CES2014<\/a>! <a href=\"http:\/\/t.co\/qqCKgWpfCU\" target=\"_blank\">http:\/\/t.co\/qqCKgWpfCU<\/a> <a href=\"http:\/\/t.co\/Pc7N5QFBFX\" target=\"_blank\">pic.twitter.com\/Pc7N5QFBFX<\/a><\/p>\n<p> \u2014 Intel Official News (@intelnews) <a href=\"https:\/\/twitter.com\/intelnews\/status\/419163099607093248\" target=\"_blank\" rel=\"noopener\">January 3, 2014<\/a><\/p>\n<\/blockquote>\n<p><p>\u00a0<\/p>\n<p>The author Isaac Asimov\u2019s famous&nbsp;<a href=\"http:\/\/www.technologyreview.com\/view\/527336\/do-we-need-asimovs-laws\" target=\"_blank\" rel=\"noopener\">three laws of robotics<\/a> proposed how future devices will cope with the need to make decisions in dangerous circumstances.<\/p>\n<p>\u00a0<\/p>\n<ul>\n<li>A      robot may not injure a human being or, through inaction, allow a human      being to come to harm.<\/li>\n<li>A      robot must obey the orders given it by human beings, except where such      orders would conflict with the First Law.<\/li>\n<li>A      robot must protect its own existence as long as such protection does not      conflict with the First or Second Laws.<\/li>\n<\/ul>\n<p>\u00a0<\/p>\n<p>He even added a more fundamental \u201c0th law\u201d preceding the others:<\/p>\n<p>\u00a0<\/p>\n<ul>\n<li>A      robot may not harm humanity, or, by inaction, allow humanity to come to      harm.<\/li>\n<\/ul>\n<p>\u00a0<\/p>\n<p>Asimov did not tackle our ethical dilemma of the car crash, but with greater sensors to gather data, more sources of data to draw from, and greater processing power, the decision to act is reduced to a cold act of data analysis.<\/p>\n<p>\u00a0<\/p>\n<p>Of course software is notoriously buggy. What havoc could malicious actors who compromise these systems wreak? And what happens at the point that machine intelligence takes control from the human? Will it be right to do so? After all, in 2001, Dave has to take urgent action when he\u2019s had enough of HAL\u2019s decision-making:<\/p>\n<p>\u00a0<\/p>\n<p> <iframe loading=\"lazy\" width=\"445\" height=\"250\" src=\"https:\/\/www.youtube.com\/embed\/c8N72t7aScY?rel=0\" frameborder=\"0\" allowfullscreen><\/iframe> <\/p>\n<p>\u00a0<\/p>\n<p>Could a future buyer purchase programmable ethical options with which to customise their car? The artificial intelligence equivalent of a bumper sticker that says \u201cI break for nobody\u201d? In which case, how would you know how cars were likely to act \u2013 and would you climb aboard if you did?<\/p>\n<p>\u00a0<\/p>\n<p>Then there are the legal issues. What if a car could have intervened to save lives but didn\u2019t? Or if it ran people down deliberately based on its ethical calculus? This is the responsibility we bear as humans when we drive a car, but machines follow orders, so who (or what) carries the responsibility for a decision? As we see with improving face recognition in smartphones, airport monitors and even on Facebook, it\u2019s not too difficult for a computer to identify objects, quickly calculate the consequences based on car speed and road conditions in order to calculate a set of outcomes, pick one, and act. And when it does so, it\u2019s unlikely you\u2019ll have an choice in the matter.<\/p>\n<p>\u00a0<\/p>\n<p><i>Do you know more on this story or have a tip of your own? Raising capital or launching a startup? Let us know. Follow StartupSmart on <\/i><a href=\"https:\/\/www.facebook.com\/StartUpSmart\" target=\"_blank\" rel=\"noopener\"><i>Facebook<\/i><\/a><i>, <\/i><a href=\"https:\/\/twitter.com\/startupsmartnow\" target=\"_blank\" rel=\"noopener\"><i>Twitter<\/i><\/a><i>, and <\/i><a href=\"https:\/\/www.linkedin.com\/company\/startupsmart\" target=\"_blank\" rel=\"noopener\"><i>LinkedIn<\/i><\/a><i>.<\/i><\/p>\n","protected":false},"excerpt":{"rendered":"<p>We make decisions every day based on risk \u2013 perhaps running across a road to catch a bus if the<\/p>\n","protected":false},"author":2,"featured_media":62439,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6,1],"tags":[],"_links":{"self":[{"href":"https:\/\/www.startupsmart.com.au\/wp-json\/wp\/v2\/posts\/33824"}],"collection":[{"href":"https:\/\/www.startupsmart.com.au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.startupsmart.com.au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.startupsmart.com.au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.startupsmart.com.au\/wp-json\/wp\/v2\/comments?post=33824"}],"version-history":[{"count":0,"href":"https:\/\/www.startupsmart.com.au\/wp-json\/wp\/v2\/posts\/33824\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.startupsmart.com.au\/wp-json\/wp\/v2\/media\/62439"}],"wp:attachment":[{"href":"https:\/\/www.startupsmart.com.au\/wp-json\/wp\/v2\/media?parent=33824"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.startupsmart.com.au\/wp-json\/wp\/v2\/categories?post=33824"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.startupsmart.com.au\/wp-json\/wp\/v2\/tags?post=33824"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}