This article is more than 1 year old

Why, Robot? Understanding AI ethics

Maybe we're headed for a robo-pocalpse, but let's deal with these other problems first, eh?

Not many people know that Isaac Asimov didn’t originally write his three laws of robotics for I, Robot. They actually first appeared in "Runaround", the 1942 short story*. Robots mustn’t do harm, he said, or allow others to come to harm through inaction. They must obey orders given by humans unless they violate the first law. And the robot must protect itself, so long as it doesn’t contravene laws one and two.

75 years on, we’re still mulling that future. Asimov’s rules seem more focused on “strong AI” – the kind of AI you’d find in HAL, but not in an Amazon Echo. Strong AI mimics the human brain, much like an evolving child, until it becomes sentient and can handle any problem you throw at it, as a human would. That’s still a long way off, if it ever comes to pass.

Instead, today we’re dealing with narrow AI, in which algorithms cope with constrained tasks. It recognises faces, understands that you just asked what the weather will be like tomorrow, or tries to predict whether you should give someone a loan or not.

Making rules for this kind of AI is quite difficult enough to be getting on with for now, though, says Jonathan M. Smith. He’s a member of the Association for Computing Machinery, and a professor of computer science at the University of Pennsylvania, says there’s still plenty of ethics to unpack at this level.

“The shorter-term issues are very important because they’re at the boundary of technology and policy,” he says. “You don’t want the fact that someone has an AI making decisions to escape, avoid or divert past decisions that we made in the social or political space about how we run our society.”

There are some thorny problems already emerging, whether real or imagined. One of them is a variation on the trolley problem, a kind of Sophie’s Choice scenario in which a train is bearing down on two sets of people. If you do nothing, it kills five people. If you actively pull a lever, the signals switch and it kills one person. You’d have to choose.

Critics of AI often adapt this to self-driving cars. A child runs into the road and there’s no time to stop, but the software could choose to swerve and hit an elderly person, say. What should the car do, and who gets to make that decision? There are many variations on this theme, and MIT even collected some of them into an online game.

There are classic counter arguments: the self-driving car wouldn’t be speeding in a school zone, so it’s less likely to occur. Utilitarians might argue that the number of deaths eliminated worldwide by eliminating distracted, drunk or tired drivers would shrink overall, which means society wins, even if one person loses.

You might point out that a human would have killed one of the people in the scenario too, so why are we even having this conversation? Yasemin J. Erden, a senior lecturer in philosophy at St Mary’s University, has an answer for that. She spends a lot of time considering ethics and computing on the committee of the Society for the Study of Artificial Intelligence and Simulation of Behaviour.

Decisions in advance suggest ethical intent and incur others’ judgement, whereas acting on the spot doesn’t in the same way, she points out

“The programming of a car with ethical intentions knowing what the risk could be means that the public could be less willing to view things as accidents,” she says. Or in other words, as long as you were driving responsibly it’s considered ok for you to say “that person just jumped out at me” and be excused for whomever you hit, but AI algorithms don’t have that luxury.

If computers are supposed to be faster and more intentional than us in some situations, then how they’re programmed matters. Experts are calling for accountability.

Do algorithms dream of electric ethics?

“I’d need to cross-examine my algorithm, or at least know how to find out what was happening at the time of the accident,” says Kay Firth-Butterfield. She is a lawyer specialising in AI issues and executive director at AI Austin. It’s a non-profit AI thinktank set up this March that evolved from the Ethics Advisory Panel, an ethics board set up by AI firm Lucid.​

W​e need a way to ​understand what ​AI algorithms are "thinking" when they do things​, she says. “How can you say to a patient's family if they died because of an intervention ‘we don't know how this happened’? So accountability and transparency are important.

Puzzling over why your car swerved around the dog but backed over the cat isn’t the only AI problem that calls for transparency. Biased AI algorithms can cause all kinds of problems. Facial recognition systems may ignore people of colour because their training data didn’t have enough faces fitting that description, for example.

Or maybe AI is self-reinforcing to the detriment of society. If social media AI learns that you like to see material supporting one kind of politics and only ever shows you that, then over time we could lose the capacity for critical debate.

​“J.S Mill made the argument that if ideas aren’t challenged then they are at risk of becoming dogma,” Erden recalls, nicely summarising what she calls the ‘filter bubble’ problem. (Mill was a 19th century utilitarian philosopher who was a strong proponent of logic and reasoning based on empirical evidence, so he probably wouldn’t have enjoyed arguing with people on Facebook much.​)

So if AI creates billions of people unwilling or even unable to recognise and civilly debate each other’s ideas, isn’t that an ethical issue that needs addressing?

Another issue concerns the forming of emotional relationships with robots. Firth-Butterfield is interested in two ends of the spectrum – children and the elderly. Kids love to suspend disbelief, which makes robotic companions with their AI conversational capabilities all that easier to embrace. She frets about AI robots that may train children to be ideal customers for their products.

Similarly, at the other end of the spectrum, she muses about AI robots used to provide care and companionship to the elderly.

“Is it against their human rights not to interact with human beings but just to be looked after by robots? I think that’s going to be one of the biggest decisions of our time,” she says.

That highlights a distinction in AI ethics, between how an algorithm does something and what we’re trying to achieve with it. Alex London, professor of philosophy and director at Carnegie Mellon University’s Center for Ethics and Policy, says that the driving question is what the machine is trying to do.

“The ethics of that is probably one of the most fundamental questions. If the machine is out to serve a goal that’s problematic, then ethical programming – the question of how it can more ethically advance that goal - sounds misguided,” he warns.

That’s tricky, because much comes down to intent. A robot could be great if it improves the quality of life for an elderly person as a supplement for frequent visits and calls with family. Using the same robot as an excuse to neglect elderly relatives would be the inverse. Like any enabling technology from the kitchen knife to nuclear fusion, the tool itself isn’t good or bad – it’s the intent of the person using it. Even then, points out Erden, what if someone thinks they’re doing good with a tool but someone else doesn’t?

More about

More about

More about


Send us news

Other stories you might like