Institute for Ethics and Emerging Technologies


The IEET is a 501(c)3 non-profit, tax-exempt organization registered in the State of Connecticut in the United States. Please give as you are able, and help support our work for a brighter future.


Search the IEET
Subscribe and Contribute to:


Technoprogressive? BioConservative? Huh?
Quick overview of biopolitical points of view




whats new at ieet

How fear of nuclear power is hurting the environment

Eurosymposium on Healthy Aging

Pushing Humans off the Loop: Automation and the Unsustainability Problem

Want to Be a Physicist? Develop an Affinity for the Weird

India Awakens Conference Fundraiser and Ticket Sale

Is Robust Moral Realism a kind of Religious Belief?


ieet books

Philosophical Ethics: Theory and Practice
Author
John G Messerly


comments

rms on 'Born Poor, Stay Poor: The Silent Caste System of America' (Sep 29, 2016)

rms on 'Here's Why The IoT Is Already Bigger Than You Realize' (Sep 28, 2016)

instamatic on 'Born Poor, Stay Poor: The Silent Caste System of America' (Sep 26, 2016)

Joseph Ratliff on 'Born Poor, Stay Poor: The Silent Caste System of America' (Sep 24, 2016)

rsbakker on 'Competitive Cognitive Artifacts and the Demise of Humanity: A Philosophical Analysis' (Sep 24, 2016)

Nicholsp03 on 'The dark side of the Simulation Argument' (Sep 24, 2016)

DavidJKelley on 'Critical Nature of Emotions in Artificial General Intelligence' (Sep 23, 2016)







Subscribe to IEET News Lists

Daily News Feed

Longevity Dividend List

Catastrophic Risks List

Biopolitics of Popular Culture List

Technoprogressive List

Trans-Spirit List



JET

Enframing the Flesh: Heidegger, Transhumanism, and the Body as “Standing Reserve”

Moral Enhancement and Political Realism

Intelligent Technologies and Lost Life

Hottest Articles of the Last Month


Homo Deus: A Brief History of Tomorrow by Yuval Noah Harari
Sep 1, 2016
(4361) Hits
(0) Comments

A Free Education for all the World’s People: Why is this Not yet a Thing?
Sep 20, 2016
(4160) Hits
(2) Comments

Here’s Why The IoT Is Already Bigger Than You Realize
Sep 26, 2016
(3873) Hits
(1) Comments

Defining the Blockchain Economy: What is Decentralized Finance?
Sep 17, 2016
(3538) Hits
(0) Comments



IEET > Rights > Privacy > Life > Vision > Affiliate Scholar > Melanie Swan

Print Email permalink (0) Comments (8373) Hits •  subscribe Share on facebook Stumble This submit to reddit submit to digg


What is Big Data and when will it be Smart Data?


Melanie Swan
By Melanie Swan
Ethical Techology

Posted: Jun 12, 2014

Big data is cell phone users having an average of 100 interactions with their phone per day, all of which generate computerized records (100s of trillions of records). Big data is every financial market transaction, every passenger on every airplane flight, every shipped container, every transportation conveyance, every tweet, and every Internet post (all in the 100s of billions or trillions of records). Every transaction for all time.

One area of long-standing data interest is mortgage statistics since mis-estimating prepayments can cost investors billions of dollars. This raises the question of how prepayment risk is still being mis-estimated. Irrespective, mortgage data is one of the fastest growing kinds of data, both by row and column of tracked data, growing at more than 2x Moore’s law on a log chart (Moore’s law reflects the hardware on which the data is stored and manipulated (algorithms somewhat fill the gap)). This begs the question of smart data rather than big data.


There is much talk about all types of data growing (and data scientists being the biggest category of job growth), but the size of big data should surely be one of its most basic attributes. What is much more relevant is the value that big data provides through its use. For example, how has having more rows and columns in mortgage-tracking spreadsheets improved (if at all) prepayment prediction?

‚Äč

Like genomics, many big data problems are in the early stages of ‘the diffs,’ not knowing which part of the data is salient to keep out of the 99% that may be useless. ‘The diffs’ are the differences, the differences between a sample data set and the reference/normal data set that constitute salience and allow the rest of the data to be discarded.  


Melanie Swan, MBA, is an Affiliate Scholar of the IEET. Ms. Swan, principal of the MS Futures Group, is a philosopher, science and technology futurist, and options trader.
Print Email permalink (0) Comments (8374) Hits •  subscribe Share on facebook Stumble This submit to reddit submit to digg


COMMENTS


YOUR COMMENT (IEET's comment policy)

Login or Register to post a comment.

Next entry: The Ethics of Benign Carnivorism

Previous entry: Turing Test ‘Passed’ by Chatbot ‘Eugene Goostman’ - What Does it Mean?

HOME | ABOUT | FELLOWS | STAFF | EVENTS | SUPPORT  | CONTACT US
SECURING THE FUTURE | LONGER HEALTHIER LIFE | RIGHTS OF THE PERSON | ENVISIONING THE FUTURE
CYBORG BUDDHA PROJECT | AFRICAN FUTURES PROJECT | JOURNAL OF EVOLUTION AND TECHNOLOGY

RSSIEET Blog | email list | newsletter |
The IEET is a 501(c)3 non-profit, tax-exempt organization registered in the State of Connecticut in the United States.

East Coast Contact: Executive Director, Dr. James J. Hughes,
56 Daleville School Rd., Willington CT 06279 USA 
Email: director @ ieet.org     phone: 860-428-1837

West Coast Contact: Managing Director, Hank Pellissier
425 Moraga Avenue, Piedmont, CA 94611
Email: hank @ ieet.org