This article is more than 1 year old

The Emperor's New AI

'It looks like you're trying to have a conversation with a computer. Can I help?'

In the early 1970s, no science show was complete without predictions of HAL-like intelligent autonomous computers by the turn of the century.

The Japanese, fearing their industrial base would collapse without a response to this omniscient technology, poured hundreds of millions of dollars into their own AI project, called Fifth Generation. They may as well have buried the money in the Pacific Ocean. Two decades later there are no intelligent robots, and "intelligent" computers are a pipe-dream.

(It was an academic coup for MIT's Professor Marvin Minsky, a fixture on the AI slots. Minsky's own preferred, linguistics-based approach to AI, symbolic AI, triumphed in the grants lotteries over an approach which preferred to investigate and mimic the neural functions of the brain. Minsky's non-stop publicity campaign helped ensure his AI lab at MIT was well-rewarded while neural networks starved.)

For the past week reports have again confidently predicted intelligent computers are just around the corner. Rollo Carpenter, whose chatbot Joan won an annual AI prize for creating software that most resembles a human, predicts that computers will pass the 'Turing Test' by 2016. In this test, computer software fools a human interrogator by passing off as a human.

(You can spot the flaw already: to sound human isn't a sign of intelligence. And what a pity it is that Turing is remembered more for his muddle-headed metaphysics than for his landmark work in building computational machines. It's a bit like lauding Einstein for opposition to the theory of plate tectonics, rather than his work on relativity, or remembering Newton for his alchemy, not his theory of gravity).

But let's have a look. A moment's glance at the conversation of Joan, or George, is enough to show us there is no intelligence here.

Here's Joan, cited at the MIT's Technology Review - a Wired style glossy:

Judge: So what you're saying is that you are not just human but THE smartest human?

Joan: Yes, why, what did you think I was saying?

Judge: So what is two plus two?

Joan: Four.

Judge: Is it possible for two plus two to not equal four?

Joan: I don't know. Do you think it's possible?

Judge: How many degrees in a triangle?

Joan: 180 degrees.

Judge: Is it possible for more than 180 degrees to be in a triangle?

Joan: Probably not. You can change your opinion, but not your constitution.

Judge: It's not a question of opinion, it's a matter of physics and maths.

Joan: A five-ounce bird could not carry a one-pound coconut.

The first thing you'll notice is that if this is a human, it's a pretty shallow yoof with a zero attention span. Now that's a surprise. It's said that pets eventually resemble their owners. Do AI bots resemble their programmers?

Joan is simply a database of feints and shimmies deployed to change the subject and confuse the questioner. Occasionally Joan will ask the interrogator if they are a robot, or chide them for being stupid. These are all pre-programmed rhetorical tricks. They may bore or bamboozle an interrogator, but this is no indication of intelligence.

That's no surprise, when we learn Joan really is a database of conversational snippets - five million lines of them. This is the same technique deployed by Eliza, Joseph Weizenbaum's elementary software parser written in the 1960s, and bundled with EMACS.

Weizenbaum was horrified by the fascinated reaction to Eliza, which was devised as a tongue-in-cheek endeavor, and a subsequent epiphany led him to devote much of the rest of his life to urging scientists to cultivate a sense of social responsibility.

More about


Send us news

Other stories you might like