Will the future provide us with a genetically preprogrammed blissful paradise, or a global catastrophe? Will there be cessation of all suffering, or annihilation of all sentient life?
The history of futurology is not encouraging. Most “predictions” by futurists are more akin to prophecies that reveal more about personality, preoccupations and capacity for wish-fulfillment of the author than the future they purport to describe.
In any case, predicting the future behaviour of self-reflexive agents is not like predicting the behaviour of non-intelligent physical systems. Some predictions are self-fulfilling; other predictions are self-stultifying; and the public forecasts of politicians, social scientists, singularitarians and transhumanists should all be viewed in this light.
With this in mind, here goes….

Existential risk?
I think the greatest underlying source of existential and global catastrophic risk lies in male human primates doing what evolution “designed” male human primates to do, namely wage war. [1] Unfortunately, we now have thermonuclear weapons to do so.
Bad news? I fear we’re sleepwalking towards the abyss. Some of the trillions of dollars of weaponry we’re stockpiling designed to kill and maim rival humans will be used in armed conflict between nation states. Tens of millions and possibly hundreds of millions of people may perish in thermonuclear war. Multiple possible flash-points exist. I don’t know if global catastrophe can be averted. For evolutionary reasons, male humans are biologically primed for competition and violence. Perhaps the least sociologically implausible prevention-measure would be a voluntary transfer of the monopoly of violence currently claimed by state actors to the United Nations. But I wouldn’t count on any such transfer of power this side of Armageddon.
Good news?
I probably sound a naive optimist. I anticipate a future of paradise engineering. One species of recursively self-improving organic robot is poised to master its own genetic source code and bootstrap its way to full-spectrum superintelligence. The biology of suffering, aging and disease will shortly pass into history. A future discipline of compassionate biology will replace conservation biology. Our descendants will be animated by gradients of genetically preprogrammed bliss orders of magnitude richer than anything physiologically accessible today. A few centuries hence, no experience below “hedonic zero” will pollute our forward light-cone.
Freeman Dyson prophesies that soon we’ll “be writing genomes as fluently as Blake and Byron wrote verses”. If so, I’m not sure about timescales. However, “narrow” artificial intelligence and powerful gene-authoring software tools will shortly enable humans to edit our own genetic source code in accelerating cycles of recursive self-improvement. In consequence, human intelligence will be progressively amplified and enriched. Youth, vitality and lifespans will be extended indefinitely. Suffering, depression and experience below “hedonic zero” will be relegated to history. Human traits such as weakness of will, the struggle for meaning and significance, quasi-sociopathic empathy deficits, and a host of mediocre states of mind that currently pass for mental health will increasingly become optional as we bootstrap our way to posthumanity.
Not least, a growing mastery of our biological reward circuitry will allow the upper bounds of human “peak experiences” to be pushed unimaginably higher. Likewise, hedonic set-points can be genetically recalibrated. Everyday life later this century will potentially be animated by gradients of intelligent bliss.

Bioconservative critics will doubtless worry that “something valuable will be lost” when responsible prospective parents stop playing genetic roulette as the reproductive revolution of “designer babies” unfolds. Tomorrow’s parents-to-be will opt for preimplantation genetic diagnosis and “designer zygotes” to ensure invincible physical and mental health for their future children. Among young adults, novel states of consciousness as different as waking from dreaming are likely to migrate from psychedelic chemists working in the scientific counterculture to mainstream society. “Bad trips” will become physiologically impossible because their molecular signature is absent.
Unfortunately, words fail here. Post-Darwinian consciousness is likely to be incomprehensible to archaic Homo sapiens.
Ethically, I think the greatest ethical change ahead this century may be the antispeciest revolution. This global transition will probably follow rather than precede the commercialisation of gourmet in vitro meat and the end of factory farming and the death factories. It’s worth stressing that the antispeciesist doesn’t claim members of all species are of equal value. S/he argues simply that beings of equivalent sentience are of equal value. Hence they deserve to be treated accordingly - regardless of gender, race or species.
Pigs, sheep and cows are of equivalent sentience to human infants, prelinguistic toddlers, victims of Alzheimer’s disease and the severely intellectually handicapped. Only arbitrary anthropocentric bias leads us to kill, abuse and exploit the former and care for the latter. Despite superior intelligence, I suspect our grandchildren may struggle to comprehend what their grandparents did to other sentient beings.
AGI? Ben Goertzel has projected this timeline for AGI development:
2023—human-level AGI
2026—imposition of global AGI Nanny to ward off existential risks
2030—Singularity, managed by the AGI Nanny
Well, I’d argue [that AGI] is a form of anthropomorphic projection on our part to ascribe intelligence or mind to digital computers. Believers in digital sentience, let alone digital (super)intelligence, need to explain Moravec’s paradox. [2]
For sure, digital computers can be used to model everything from the weather to the Big Bang to thermonuclear reactions. Yet why is, say, a bumble bee more successful in navigating its environment in open-field contexts than the most advanced artificial robot the Pentagon can build today? The evolutionary success of biological lifeforms since the Cambrian Explosion has turned on the computational capacity of organic robots to solve the binding problem [3] and generate cross-morally matched, real-time simulations of the mind-independent world.
On theoretical grounds, I predict classical digital computers will never be capable of generating unitary phenomenal minds, unitary selves or unitary virtual worlds. In short, digital computers are invincibly ignorant zombies. [4] By their very nature, they can never “wake up” and explore the manifold varieties of sentience.
Notes
[1] http://www.facebook.com/l/cAQGiuhiIAQEsy6CGFU446aDXgUvEtedvnuWON799hdSSJA/ieet.org/
index.php/IEET/more/4576
[2] http://www.facebook.com/l/eAQF14fVKAQGdIIT2694DLG3BoSJUe6oAP0N2QtJpX6vwXA/
en.wikipedia.org/wiki/Moravec’s_paradox
[3] http://www.facebook.com/l/BAQEONQclAQHh1j2xn_xdwe7Z0yBQN-z-siR5htKDbkNC9A/
tracker.preterhuman.net/texts/body_and_health/Neurology/Binding.pdf
[4] http://www.facebook.com/l/FAQFGeaXwAQFqtzOF5KW5kXM_eJYk_ByILxQIV8EgjBMH7w/ieet.org/
index.php/IEET/more/pearce20120510
People who believe they will witness the “end of times” in their own life are delusional. In a way, to think we are the last generation of humans on Earth is giving ourselves too much importance. That’s why apocalyptic sects and religious groups attract people: you’re the chosen ones, you’re the special ones, the last ones, the ultimate humans, those who will witness “great and terrible things”. Eschatological beliefs have always impressed the weakest minds—that’s why date-based predictions such as the “year 1000 scare”, the “y2k robocalypse” or the “2012 mayan calendar fantasy” are given undue media coverage.
We’re always secretly waiting for something big to change our lives. Because we feel our life’s limitations are intolerable. We’re short-lived, mortal, and most of us ar mediocre pawns living in a depressingly limited world. Give us God, Hal, Gilgamesh, Warp 1, or a Wookie, so we can jump into the dream, so to speak. Give us Spice, Soma, the Fountain of Youth, the Golden Apple, the Catalyst. But at the same time, change scares us. A lot. That’s why Utopia, Dystopia, and the Apocalypse have always been parts of the same narratives.
In a way, we really CAN wipe ourselves out in many ways. And it’s been the case for centuries. lIn the Middle Ages, commercial contacts help spread the Black Death in multiple, deadly waves. The Exploration Age broughts old germs to the New World, which nearly wiped out the Native populations. More recently, the fear of a nuclear apocalypse is something real (and it’s still real in the 21th century). But so is climate change, pollution, groundwater/soil exhaustion, overpopulation, dwindling fish stocks, chemical pollution, and so on. And over all this, any nearby star can harm us with a gamma flash, a major impact even can toast us, a Toba-style volcano can make us starve and freeze to death, and so on.
The coming of Major Change to our world (“utopia”, “revolution”, “destructive events”) would be something terrible, disruptive. Even Minor Change (a moderate sea-level rise, changes in climate patterns, etc.) has the ability to wreck our economy, disrupt our civilization and turn our comfort into misery. We’re both fragile and resilient. I don’t think we’ll nuke ourselves out, or drown in a pool of grey goo, or dig a hole into the fabric of spacetime at the CERN, or end up with USB ports in our lower spine & trapped into a collective Plug&Play; hell.
We’ll just build bigger toys, break these toys, blow up things from time to time, make lots of people miserable, and make our planet stinkier than ever. But at the same time, we’ll understand things better, build better things, cure our illnesses, and eventually, it’ll all get better.