Institute for Ethics and Emerging Technologies


The IEET is a 501(c)3 non-profit, tax-exempt organization registered in the State of Connecticut in the United States. Please give as you are able, and help support our work for a brighter future.


Search the IEET
Subscribe and Contribute to:


Technoprogressive? BioConservative? Huh?
Quick overview of biopolitical points of view




whats new at ieet

A Pro- and Anti-War Dialogue

Hackers Will Be Tempted by Cyborg Vulnerabilities

Dangers de l’IA : une prophétie auto-réalisatrice ?

Online Companies Like Facebook Have Created a Meaningless Economy

IEET Affiliate Scholar Roland Benedikter New Contribution to the ACATECH Report

The Ethics of Intimate Surveillance (2): A Landscape of Objections


ieet books

Philosophical Ethics: Theory and Practice
Author
John G Messerly


comments

atomic geography on 'The Ethics of Intimate Surveillance (2): A Landscape of Objections' (May 1, 2016)

Nicholsp03 on 'Is The Singularity A Religious Doctrine?' (Apr 30, 2016)

rms on 'The Ethics of Intimate Surveillance (1)' (Apr 30, 2016)

spud100 on 'Immortality: When We Digitally Copy Our Minds, What Happens to Humanity?' (Apr 27, 2016)

almostvoid on 'Angels and Demons of A.I.' (Apr 27, 2016)

almostvoid on 'Immortality: When We Digitally Copy Our Minds, What Happens to Humanity?' (Apr 27, 2016)

instamatic on 'Why Woman-as-Abortion-Victim is Even Worse than Endorsing Punishment' (Apr 25, 2016)







Subscribe to IEET News Lists

Daily News Feed

Longevity Dividend List

Catastrophic Risks List

Biopolitics of Popular Culture List

Technoprogressive List

Trans-Spirit List



JET

Enframing the Flesh: Heidegger, Transhumanism, and the Body as “Standing Reserve”

Moral Enhancement and Political Realism

Intelligent Technologies and Lost Life

Hottest Articles of the Last Month


How Augmented and Virtual Realities Might Change Productivity Forever in the Next 10 Years
Apr 14, 2016
(4056) Hits
(0) Comments

Christianity and Transhumanism Are Much Closer Than You Think
Apr 10, 2016
(3940) Hits
(60) Comments

Is The Singularity A Religious Doctrine?
Apr 23, 2016
(2976) Hits
(8) Comments

Bruce Sterling urges us not to panic, just yet
Apr 6, 2016
(2919) Hits
(4) Comments



Comment on this article

Nine Ways to Bias Open-Source AGI Toward Friendliness


Ben Goertzel and Joel Pitt

Vol. 22 Issue 1 Feb, 2012

Link to article

While it seems unlikely that any method of guaranteeing human-friendliness (“Friendliness”) on the part of advanced Artificial General Intelligence (AGI) systems will be possible, this doesn’t mean the only alternatives are throttling AGI development to safeguard humanity, or plunging recklessly into the complete unknown. Without denying the presence of a certain irreducible uncertainty in such matters, it is still sensible to explore ways of biasing the odds in a favorable way, such that newly created AI systems are significantly more likely than not to be Friendly. Several potential methods of effecting such biasing are explored here, with a particular but non-exclusive focus on those that are relevant to open-source AGI projects, and with illustrative examples drawn from the OpenCog open-source AGI project. Issues regarding the relative safety of open versus closed approaches to AGI are discussed and then nine techniques for biasing AGIs in favor of Friendliness are presented.


COMMENTS



Posted by GamerFromJump  on  10/19  at  05:47 AM

The children of our minds need parenting.






Add your comment here:


Name:

Email:

Location:

Remember my personal information

Notify me of follow-up comments?

HOME | ABOUT | FELLOWS | STAFF | EVENTS | SUPPORT  | CONTACT US
SECURING THE FUTURE | LONGER HEALTHIER LIFE | RIGHTS OF THE PERSON | ENVISIONING THE FUTURE
CYBORG BUDDHA PROJECT | AFRICAN FUTURES PROJECT | JOURNAL OF EVOLUTION AND TECHNOLOGY

RSSIEET Blog | email list | newsletter |
The IEET is a 501(c)3 non-profit, tax-exempt organization registered in the State of Connecticut in the United States.

East Coast Contact: Executive Director, Dr. James J. Hughes,
56 Daleville School Rd., Willington CT 06279 USA 
Email: director @ ieet.org     phone: 860-428-1837

West Coast Contact: Managing Director, Hank Pellissier
425 Moraga Avenue, Piedmont, CA 94611
Email: hank @ ieet.org