Institute for Ethics and Emerging Technologies

The IEET is a 501(c)3 non-profit, tax-exempt organization registered in the State of Connecticut in the United States. Please give as you are able, and help support our work for a brighter future.

Search the IEET
Subscribe and Contribute to:

Technoprogressive? BioConservative? Huh?
Overview of technopolitics

whats new at ieet

What makes an algorithm feminist, and why we need them to be

Some things you wanted to know about robot sex* (but were afraid to ask)

Peut-on aimer un robot (ou une IA) ?

Hoffer’s The True Believer and Trump

Resilience Technology Part II: Simple measures to thwart possible collapse

Any sufficiently advanced totalitarianism is indistinguishable from Facebook

ieet books

Philosophy’s Future: The Problem of Philosophical Progress
Russell Blackford and Damien Broderick eds.


Enframing the Flesh: Heidegger, Transhumanism, and the Body as “Standing Reserve”

Moral Enhancement and Political Realism

Intelligent Technologies and Lost Life

Comment on this entry

Bruce Sterling Thinks Artificial Intelligence Has Jumped the Shark

George Dvorsky


January 19, 2013

Bruce Sterling wrote influential works like Schismatrix and Islands in the Net, plus he practically invented cyberpunk (with all due respect, of course, to William Gibson and Rudy Rucker). We are serious fans of his work. And if his recent comments about the potential risks of greater-than-human artificial intelligence — or lack thereof — are any indication, he's itching to start a giant fight among futurists.


Complete entry


Posted by Richard Loosemore  on  01/19  at  10:40 AM

Well, yes and no.

Here are the nuggets of truth at the heart of what Bruce Sterling says.

First, there is a lot of talk (which, George, you repeat) about how a general tide of evolution in AI will eventually yield systems that will be non-human-like and non-self-aware, but nevertheless so intelligent that they are beyond human ken and control.  This. Is. A. Myth!  It is a story that AI researchers tell themselves about progress, and it is the same story that has been told ever since the Minsky crowd waxed lyrical about how it would only take a decade or so to build a computer that was as intelligent as a human.

I say that from a position on the inside:  I have been doing AI research since the 80s, and I have clocked a serious amount of time as both an AI/software engineer and a cognitive scientist.  AI researchers have been hacking away, using basically the same stunted techniques, for decades without making any substantial progress.  And before you jump on that statement (!) let me add:  “substantial” progress means something more than mopping up the low-hanging fruit.  Siri and Watson are just 80s technology running on faster machines, and with a few more bells and whistles, but the core of what they do contains the same failure rates and the same failure modes that we already saw in the 80s.  Watson is not a supersonic jetliner, compared to the horse—it is just a horse on performance-enhancing drugs, with legs replaced by carbon-fiber springs.  AI as a field has been dead for decades:  it’s just that the corpse hasn’t stopped twitching yet.

As for the “no business model” idea:  I think Sterling nailed it.  Do you know what happens when researchers ask for a small investment to explore radical new ideas in AI?  Radical new ideas that might break the stalemate and unleash the future?  Nothing.  Nada.  Deadsville.  (Okay, I speak from bitter experience.  Indulge me, yeah?).  Everyone, but everyone, wants to support incremental progress and fashionable trends.  Even DARPA, which makes a point of specifically targeting “high-risk/high-payoff technologies” does not really do that in practice:  instead, it looks for track-record people who work in a gold-plated rut carved out by their postdocs, who spin some ideas until they look crazy enough that DARPA will throw some money at them (again).

You ask a rhetorical question that I’d like to answer: “And does anyone seriously believe that the Pentagon will allow other countries to get a head start on any of this?”

Umm, yes.  The Pentagon is a Bear of Little Brain.  Sure, it would never in a thousand years *intend* to let other countries get a head start on any of this, but that won’t stop it trying. grin

Final word.  Actually, I think that progress can be had, and that Sterling can be wrong.  I think you are right to say that by pushing the envelope (especially in the human-cognition/AI area, which is a barren wasteland at the moment) things can be made to happen.  But, see, when I look at the landscape of the research that is actually going on out there, I don’t see how anyone could come to such a positive conclusion using *that* for evidence.  Me, I can see a silver lining if I look at my own research and that of a tiny handful of other renegades out there, but I don’t see how anyone else could possibly come to such a positive conclusion, when what they seem to be doing is staring directly at the main rump of what is happening in AI at the moment, without seeming to even know that there are some unfunded renegades on the loose.

But, hey ho.  Let’s wait another ten years and see if I was right.

Posted by Michael Bone  on  01/19  at  01:17 PM

@Richard Loosemore

Could you direct me to a paper(s) that you wrote that best represents the path that you believe should be taken in AI?

Posted by CygnusX1  on  01/19  at  03:51 PM

@ Richard..

So what do you think about Kurzweil’s new corporate collaboration with Google?

Can superfast internet driven data mining and A.I search/interaction/participation, simulate an intelligent responsive system that can reap real benefits for global society?

It’s difficult to define intelligence? Holistically, is this really any more than speed of data processing to “weed out” invalid and illogical/irrational responses, creativity as “swerve balls” emerging in chaotic systems?

I would stretch to guess that biological brains are no more and no less than the same as complex neural machine processing?

How complex does the “derivative” algorithm need to be at the lowest level, is it not complexity from which the phenomenon of intelligence emerges?

Posted by Stefano Vaj  on  01/19  at  04:16 PM

Hey, Sterling’s bit sounds remarkably close to what I discussed much more extensively in the article “Artificious Intelligences”, recently published , inter alia, here:

Posted by Curt Welch  on  01/19  at  06:29 PM

Sterling suffers from a common problem that many people in society do.  They are confused by the illusion of dualism into a false belief that humans hold some sort of “god-like” powers called “consciousness’”.

Humans hold no such magical powers.  The insignificant powers we do hold, are already being duplicated by AI researches.  Not only is Sterling dead wrong with his belief that we are getting “no closer” to self aware systems, our systems are already fully self-aware.

It’s this false belief, that is so common in society, that “real” humans, have a magical power that no one has duplicated in a computer is what makes people like Sterling so un-aware of what’s happening at places like Google.

The problem with people like Sterling is not that he is unaware of what our computers have achieved.  It’s that he is unaware of just how truly insignificant, human mental powers really are.  Like most of us humans, he has a highly inflated ego when it comes to understanding our place in the universe.

Our machines have been replacing humans in the work force for a long time now, and as they continue their exponential climb in ability, while we humans see our physical and mental powers standing still, they will soon replace all of us.  This has been happening for a long time, but we are now reaching the point where the humans are starting to lose the race against the machines.  The machines are advancing faster, and taking over more jobs, faster than humans can retrain and find new jobs.  Anyone that doesn’t understand this, and who suggests, “there’s no business model for AI”, is going to left in the dust.

Posted by Ben Goertzel  on  01/19  at  10:58 PM


Richard Loosemore and I wrote an article a couple years ago called “Why an Intelligence Explosion is Probable”:

We considered there many counter-arguments and refuted them ... but we didn’t think of the counter-argument Sterling raises here, i.e. that advanced human-like AGI won’t occur because there’s no profit to be made in it…

With all due respect for Sterling’s literary prowess, I have to say that’s just kinda dumb….

No economic value in home service robots, elder care or nanny robots that can really do what humans do, and empathize with and understand humans?  No economic value in AGI scientists that can hold the totality of scientific datasets online in their minds and make hypotheses and analyses based thereupon?  No economic value in something SIRI-like that really works?  Gimme a break !! ....  Sterling reminds me of some know-it-all biz consultant in 1975 pontificating that there’s no business model in the Internet or mobile phones…

No one company, not even Google, is likely to build the Singularity—any more than one company built the Internet, or the world’s mobile phone infrastructure, or the Industrial Revolution, or modern mathematics, etc….  The Singularity is going to emerge from the inter-reinforcing activities of a host of different actors pursuing their own goals, some mainly economically motivated and some not….  Explicit AGI designs like, perhaps, my team’s OpenCog system, will be part of the picture…

People who whine that AGI is never going to happen because the AI field has been trying and failing since the 1960s, really make me laugh.  Get some historical perspective, folks.  That’s 50-60 years, which is a blink of the eye historically.  The hardware of the 1960s sucked by the standards of my iPhone….

Sterling is a very good SF writer—but remember, SF writers sell books by being interesting, not by being right…

—Ben Goertzel

Posted by Richard Loosemore  on  01/20  at  11:03 AM

@Michael Bone.  The paper “Complex Systems, Artificial Intelligence and Theoretical Psychology” is probably the one you want.  It can be found at

Posted by Stefano Vaj  on  01/20  at  11:59 AM

Sterling may just be into provocation, but I think a more interesting interpretation of what he says is that there is no (great, obvious, high-priority) business case for the the development of persuasively anthropomorphic AIs.

*Of course* there is a business case for increasingly intelligent computers. Or for increasingly intelligent humans, for that matter.

In fact, I maintain in the article indicated above that *this* is both more strategic and more interesting than manufacturing Turing-qualified machines - something that Wolfram, eg, persuasively suggests could be done with any universal computing device at all, including the original PC, no mater how “stupid”, if you allow for an unlimited memory and an unlimitedly slow responsiveness.

In fact, besides the intrinsic scientific interest of creating the latter systems, “for the sake of it”, the only immediate application I can think for them is the emulation of existing humans with a sufficient accuracy to be considered by the individual interested as a metaphor of spiritual immortality - see under “mind-uploading”.

Posted by Curt Welch  on  01/20  at  01:26 PM

Stefano Vaj - I think there actually are many very good business cases for the development of anthropomorphic AIs.  Though I do agree that there are far more businesses cases for smart AIs that replace our mental abilities without seeming to be human, there are also plenty of cases where human-like behaviors from our machines will be the source of profits.

To start with, it’s important to build some AIs with human bodies so they can operate in environments built for humans which means being able to walk through buildings, ride elevators, climb stairs and ladders, sit in our chairs, ride in our cars, drive our cars, operate all the tools made for humans, including operating construction equipment, etc.

Though many of the tools currently built to be operated by humans will be redesigned in the age of AI there will always remain the need for an AI to operate within the environments built for humans, to perform services and to interact with humans so in this case, a humanoid body that can perform the tasks of a human will always be required - which means there will be a business model for it.

But in addition, humans like to interact with humans.  When I buy a cup of coffee, I like to have idle chat with the person behind the counter about how their day is going.  I like it when they they ask me how my life is going.  I like it when they notice I did something like get a hair cut, bought a new jacket.  We will be able to make coffee dispensing machines that have no human qualities at all - we just tell it what it wants, and it gives us the coffee.  But a machine that knows who we are, and can chat with us as human would, will always be more valuable, than a machine with no ability to understand us and say a kind thing or two to us.  There is a business model in having machines that understand us, and our needs, in very human-like ways.

And of course, there will be a huge market for highly anthropomorphic AI prostitutes.  The business model for that is obvious.

What Sterling got right, was the fact that there is no business model in making machines that will want to take control of the world away from us humans.  There is no business model for that.

Posted by Christian Corralejo  on  01/20  at  03:57 PM

Curt Welch

I don’t get why people would want to replace human employees with AIs for the qualities human employees already have, other than their bosses not having to pay AI employees.  I guess this is where the fear of machines taking our jobs comes into play.

Posted by Stefano Vaj  on  01/20  at  04:17 PM

Curt Welch: I am quite in agreement with what you say.

But by “anthropomorphic AIs” in my article I do not refer to human-shaped robots - yup, there are many conceivable uses for them, also given that many things around are made to be employed by humans… - but to computer programs emulating agency, Darwinian behaviours, consciousness, Turing-test interacting abilities, etc.

Now, such things are often an annoyance even in human employees or contractors. Why would I implement them in a robot or a computer program?

Add your comment here:




Remember my personal information

Notify me of follow-up comments?

Please enter the word you see in the image below:


RSSIEET Blog | email list | newsletter |
The IEET is a 501(c)3 non-profit, tax-exempt organization registered in the State of Connecticut in the United States.

Executive Director, Dr. James J. Hughes,
35 Harbor Point Blvd, #404, Boston, MA 02125-3242 USA
Email: director @