Institute for Ethics and Emerging Technologies


The IEET is a 501(c)3 non-profit, tax-exempt organization registered in the State of Connecticut in the United States. Please give as you are able, and help support our work for a brighter future.


Search the IEET
Subscribe and Contribute to:


Technoprogressive? BioConservative? Huh?
Quick overview of biopolitical points of view




whats new at ieet

Algocracy and Transhuamnism Podcast: Hannah Maslen on the Ethics of Neurointerventions

The World’s First Child-Sized Exoskeleton Will Melt Your Heart

How better tech could protect us from distraction

Worst case scenario – 2035 and no basic income.

The birth of virtual reality as an art form

How VR Gaming will Wake Us Up to our Fake Worlds


ieet books

Philosophical Ethics: Theory and Practice
Author
John G Messerly


comments

Pastor_Alex on 'On tragedy, ethics and the human condition.' (Jun 28, 2016)

instamatic on 'On tragedy, ethics and the human condition.' (Jun 28, 2016)

Pastor_Alex on 'On tragedy, ethics and the human condition.' (Jun 28, 2016)

instamatic on 'On tragedy, ethics and the human condition.' (Jun 28, 2016)

RJP8915 on 'How VR Gaming will Wake Us Up to our Fake Worlds' (Jun 28, 2016)

almostvoid on 'How VR Gaming will Wake Us Up to our Fake Worlds' (Jun 28, 2016)

almostvoid on 'The birth of virtual reality as an art form' (Jun 28, 2016)







Subscribe to IEET News Lists

Daily News Feed

Longevity Dividend List

Catastrophic Risks List

Biopolitics of Popular Culture List

Technoprogressive List

Trans-Spirit List



JET

Enframing the Flesh: Heidegger, Transhumanism, and the Body as “Standing Reserve”

Moral Enhancement and Political Realism

Intelligent Technologies and Lost Life

Hottest Articles of the Last Month


How VR Gaming will Wake Us Up to our Fake Worlds
Jun 28, 2016
(5967) Hits
(2) Comments

Will Transhumanism Change Racism in the Future?
Jun 2, 2016
(5544) Hits
(0) Comments

Dubai Is Building the World’s Largest Concentrated Solar Power Plant
Jun 20, 2016
(4146) Hits
(0) Comments

A snapshot on the fight against death
Jun 1, 2016
(3508) Hits
(4) Comments



IEET > Security > Biosecurity > Cyber > Eco-gov > Military > Resilience > SciTech > SpaceThreats > Vision > Artificial Intelligence > Affiliate Scholar > Phil Torres

Print Email permalink (2) Comments (2309) Hits •  subscribe Share on facebook Stumble This submit to reddit submit to digg


A New Doomsday Argument


Phil Torres
By Phil Torres
Ethical Technology

Posted: Feb 22, 2016

I want to elaborate briefly on an issue that I mentioned in a previous article for the IEET, in which I argue (among other things) that we may be systematically underestimating the overall probability of annihilation. The line of reasoning goes as follows:

All biological brains have mechanisms that are responsible for generating concepts. Concepts are mental representations of different aspects of the world. For example, the concept of an electron is a mental entity that represents a particular aspect of reality, namely one of the subatomic particles in the atom. It follows that if the mechanisms in one’s brain can’t generate the concept of an electron, then one can’t mentally represent the electron, and if one can’t mentally represent the electron, then one can’t have knowledge about electrons.

By analogy, consider the chipmunk: it lacks the mental mechanism necessary to generate the concept of an electron. Consequently, it can never grasp, understand, or comprehend what an electron is, in principle. As philosophers put it, electrons are unknowable “mysteries” for the chipmunk (rather than knowable “puzzles,” even if not yet known). The chipmunk’s brain is “cognitively closed” to the concept of an electron.

This being said, why think that humans are any different? Why think that the computers behind our eyes can generate all the concepts needed to mentally represent every type of phenomenon in the universe? We’re animals, after all, and evolution is an open-ended process that hasn’t stopped with Homo sapiens (and our particular brains). No doubt there are aspects of reality that not merely unknown, but unknowable to us — no doubt there are features of the world with respect to which we are cognitive closed. Like a square peg trying to fit through a round hole, our minds are simply not designed to grasp the relevant concepts.

But what if some of these concepts correspond to phenomena in the universe that pose risks to our survival? To use the chipmunk analogy again: the universe is full of cosmic dangers — such as asteroid impacts, super volcanoes, solar flares, black hole explosions or mergers, supernovae, galactic center outbursts, and gamma-ray bursts, to name a few — that the chipmunk can’t possibly comprehend. It’s not merely ignorant of such risks, but it’s ignorant of its ignorance. It has no idea that it’s utterly oblivious that annihilation could take so many exotic forms.

So, once more: why should we think that our epistemic situation in the universe is any different? What are the chances that the nervous system of Homo sapiens can generate all the concepts needed to exhaustively comprehend every aspect of our existential risk predicament? I see no reason for thinking that there aren’t risks that fall outside the domain of human knowability, just as there are risks that fall outside the domain of chipmunk knowability. We could, indeed, be surrounded by a vast swarm of risks with respect to which we’re ignorant in the second-order sense mentioned above. We have no idea that we’re in danger — nor could we.

Now, one might agree that our biological brains are conceptually limited and that some conceptually unknowable phenomena could be catastrophically risky, but respond that if such risks exist, they must be highly improbable, since the universe has existed for 13.7 billion years, our planet for 4.5 billion years, Earth-originating life for 3.5 billion years, and human beings for 2 million years. There’s been plenty of opportunity across cosmic history for a cataclysm to have destroyed the universe, the solar system, our planet, Earth-originating life, our genus, or our species. The fact that we’ve survived surely implies that a cosmic cataclysm — whether knowable or unknowable — probably isn’t going to happen anytime soon.

But this line of reasoning is deeply flawed. The problem is that certain types of annihilation risks are incompatible with the existence of observers like us, meaning that a record of past survival provides no useful information about the probability of such risks happening in the future. As Nick Bostrom and Milan Cirkovic write in Global Catastrophic Risks, “We are bound to find ourselves in one of those places and belonging to one of those intelligent species which have not yet been destroyed, whether planet or species-destroying disasters are common or rare” (italics added). It follows that certain annihilation scenarios could be highly probable, even though one hasn’t yet materialized.

This leads to the central idea of the present article: when one combines the fact of cognitive closure with the observation selection effect, it becomes clear that our existential predicament could be far more precarious than we would otherwise suspect — or could possibly suspect. Just as the chipmunk (if you will) has been systematically underestimating the probability of annihilation given the intrinsic limitations of its evolved mental machinery, so too might we be systematically underestimating the probability as well. The universe could be teeming with highly probable human-unknowable hazards capable of eliminating our species — or even the universe — in a flash. This should lead us to boost our prior probability estimates of total annihilation, whatever they happen to be.

* * * * *

Before ending this article, it’s worth pointing out an ambiguity with the term “unknowable.” In my recent book on existential risks and apocalyptic terrorism, I distinguish between knowledge-relative and mind-relative instances of unknowability. The discussion above concerned only the latter, but the former is worth mentioning as well. By way of example, consider that, given the nascent state of climatological research in the early twentieth century, the causal link between burning fossil fuels and climate change was unknowable to scientists at the time. We simply lacked the theoretical apparatuses and pool of evidence necessary to make this connection. (In fact, many people at the time saw the automobile as an environmental panacea: it would help clean up cities overflowing with horse urine, feces, and carcasses.) This contrasts with situations in which we fail to grasp an idea not because the human enterprise of science is insufficiently advanced, but because human science could never reveal certain truths no matter how advanced it becomes.

For instance: at present, there could be existential risks associated with experiments at the Large Hadron Collider that can only be known once one has developed Theory X, but Theory X won’t be developed for another 10 years. Or, alternatively, there could be existential risks that can only be known once one has developed Theory Z, but Theory Z requires one to grasp concepts A, B, and C that aren’t included in the library of concepts accessible to human minds. The conclusion of these considerations is the following: knowledge-relativity provides a strong argument for accelerating the advancement of science however possible.

Rather than wait 10 years for Theory X, it would surely be better for us to construct it in 5, or 1 year. After all, perhaps the dangerous experiment is set to occur in 6 years, but would be halted if Theory X is developed beforehand.

Meanwhile, mind-relativity provides a strong argument for the creation of superintelligence. As I write in another article, a super intelligence whose mystery-puzzle boundary is drawn differently (and more expansively) than ours could potentially see risks with respect to which our minds are forever conceptually blind.

Again, such risks could be numerous and highly probable. In both cases, the situation could very well be urgent.


Phil Torres is an author and artist. His forthcoming book is called The End: What Science and Religion Tell Us About the Apocalypse (Pitchstone Publishing). You can contact him here: philosophytorres@gmail.com.
Print Email permalink (2) Comments (2310) Hits •  subscribe Share on facebook Stumble This submit to reddit submit to digg


COMMENTS


I have some ideas about x-risks which I was not able to explain to anyone. They are not unknowable, but they expect from the reader some background in several contradictive domains. I may create a list, but my point here is that even if some ideas could be understood by a person, it doesn’t mean that it will happen, as it demands high cognitive load to get all needed conceptions.
It also happened with me in 1990 than I independently created quantum immortality theory but for 15 years I was not able to find anyone who could understand what I am speaking about.
So our minds are developing and sometimes they are able to grasp concepts which was unthinkable before. But there could be things in the universe which can’t be grasp by any mind - and they are still dangerous.

The story reminds me the following Castaneda passage:
“Before I can explain the Indescribable Force ‘s emanations, I have to talk about the known, the unknown, and the unknowable.
    The unknown is something that is veiled from man, shrouded perhaps by a terrifying context, but which, nonetheless, is within man’s reach.
    The unknown becomes the known at a given time. The unknowable, on the other hand, is the indescribable, the unthinkable, the unrealizable. It is something that will never be known to us, and yet it is there, dazzling and at the same time horrifying in its vastness.
    There is a simple rule of thumb: in the face of the unknown, man is adventurous. It is a quality of the unknown to give us a sense of hope and happiness. Man feels robust, exhilarated. Even the apprehension that it arouses is very fulfilling. The new seers saw that man is at his best in the face of the unknown.
    The unknown and the known are really on the same footing, because both are within the reach of human perception. Seers, can leave the known at a given moment and enter into the unknown.
    Whatever is beyond our capacity to perceive is the unknowable. And the distinction between it and the knowable is crucial. Confusing the two would put seers in a most precarious position whenever they are confronted with the unknowable. Most of what’s out there is beyond our comprehension.”





Only the ignorant would say ‘most of what;s out there is beyond our comprehension’. Really. Copernicus and Kepler sorted out the mess of the ignorant. Einstein and Heisenberg the basics cosmically and sub atomically. Great strides in medicine. The only discipline that seems to have lost its way is philosophy. They can’t make up their minds whether they are investigators such as scientists or thinkers who have problem defining definitions. Then build academic empires out of confused epistemological systems. As for the threat to ourselves in that to the paranoid our brain is planning our annihilation this mental trope is strongest amongst Judeaic-Christian theology given it glorifies the coming Apocalypse bringing on Armageddon. However if you go to India there they are calculating the 4th Kali Yuga. The adventure has just begun. The trick is to avoid self fulfilling prophesies. Exploring space will guarantee our survival.





YOUR COMMENT (IEET's comment policy)

Login or Register to post a comment.

Next entry: Does Giving Animals More Rights Improve the Quality of Human Life?

Previous entry: Ideasthesia and Art

HOME | ABOUT | FELLOWS | STAFF | EVENTS | SUPPORT  | CONTACT US
SECURING THE FUTURE | LONGER HEALTHIER LIFE | RIGHTS OF THE PERSON | ENVISIONING THE FUTURE
CYBORG BUDDHA PROJECT | AFRICAN FUTURES PROJECT | JOURNAL OF EVOLUTION AND TECHNOLOGY

RSSIEET Blog | email list | newsletter |
The IEET is a 501(c)3 non-profit, tax-exempt organization registered in the State of Connecticut in the United States.

East Coast Contact: Executive Director, Dr. James J. Hughes,
56 Daleville School Rd., Willington CT 06279 USA 
Email: director @ ieet.org     phone: 860-428-1837

West Coast Contact: Managing Director, Hank Pellissier
425 Moraga Avenue, Piedmont, CA 94611
Email: hank @ ieet.org