Institute for Ethics and Emerging Technologies


The IEET is a 501(c)3 non-profit, tax-exempt organization registered in the State of Connecticut in the United States. Please give as you are able, and help support our work for a brighter future.


Search the IEET
Subscribe and Contribute to:


Technoprogressive? BioConservative? Huh?
Quick overview of biopolitical points of view




whats new at ieet

Bio-Cryptoeconomy: Nanorobotic DACs for Cell Repair and Enhancement

3 moons and a planet that could have alien life

New Transhumanism Book by Stefan L. Sorgner To Be Printed

A small country with big ideas to get rid of fossil fuels

Want to Find Aliens? Look for Planets That Have Become Stars

What a planet needs to sustain life


ieet books

Philosophical Ethics: Theory and Practice
Author
John G Messerly


comments

instamatic on 'The Science of Fear-Mongering: How to Protect Your Mind from Demagogues' (Aug 29, 2016)

instamatic on 'No Mans Sky: A Deist Simulated Universe' (Aug 29, 2016)

Giulio Prisco on 'No Mans Sky: A Deist Simulated Universe' (Aug 29, 2016)

instamatic on 'No Mans Sky: A Deist Simulated Universe' (Aug 28, 2016)

RJP8915 on 'No Mans Sky: A Deist Simulated Universe' (Aug 27, 2016)

instamatic on 'No Mans Sky: A Deist Simulated Universe' (Aug 27, 2016)

RJP8915 on 'No Mans Sky: A Deist Simulated Universe' (Aug 27, 2016)







Subscribe to IEET News Lists

Daily News Feed

Longevity Dividend List

Catastrophic Risks List

Biopolitics of Popular Culture List

Technoprogressive List

Trans-Spirit List



JET

Enframing the Flesh: Heidegger, Transhumanism, and the Body as “Standing Reserve”

Moral Enhancement and Political Realism

Intelligent Technologies and Lost Life

Hottest Articles of the Last Month


Op-ed: Climate Change Is the Most Urgent Existential Risk
Aug 7, 2016
(5670) Hits
(4) Comments

Consciousness, Reality, and the Simulation Hypothesis
Aug 4, 2016
(4990) Hits
(15) Comments

Shedding Light on Peter Thiel’s Dark Enlightenment
Aug 15, 2016
(4947) Hits
(2) Comments

Cognitive Buildings!
Aug 1, 2016
(3901) Hits
(1) Comments



IEET > Rights > Privacy > Life > Vision > Affiliate Scholar > Melanie Swan

Print Email permalink (0) Comments (8276) Hits •  subscribe Share on facebook Stumble This submit to reddit submit to digg


What is Big Data and when will it be Smart Data?


Melanie Swan
By Melanie Swan
Ethical Techology

Posted: Jun 12, 2014

Big data is cell phone users having an average of 100 interactions with their phone per day, all of which generate computerized records (100s of trillions of records). Big data is every financial market transaction, every passenger on every airplane flight, every shipped container, every transportation conveyance, every tweet, and every Internet post (all in the 100s of billions or trillions of records). Every transaction for all time.

One area of long-standing data interest is mortgage statistics since mis-estimating prepayments can cost investors billions of dollars. This raises the question of how prepayment risk is still being mis-estimated. Irrespective, mortgage data is one of the fastest growing kinds of data, both by row and column of tracked data, growing at more than 2x Moore’s law on a log chart (Moore’s law reflects the hardware on which the data is stored and manipulated (algorithms somewhat fill the gap)). This begs the question of smart data rather than big data.


There is much talk about all types of data growing (and data scientists being the biggest category of job growth), but the size of big data should surely be one of its most basic attributes. What is much more relevant is the value that big data provides through its use. For example, how has having more rows and columns in mortgage-tracking spreadsheets improved (if at all) prepayment prediction?

‚Äč

Like genomics, many big data problems are in the early stages of ‘the diffs,’ not knowing which part of the data is salient to keep out of the 99% that may be useless. ‘The diffs’ are the differences, the differences between a sample data set and the reference/normal data set that constitute salience and allow the rest of the data to be discarded.  


Melanie Swan, MBA, is an Affiliate Scholar of the IEET. Ms. Swan, principal of the MS Futures Group, is a philosopher, science and technology futurist, and options trader.
Print Email permalink (0) Comments (8277) Hits •  subscribe Share on facebook Stumble This submit to reddit submit to digg


COMMENTS


YOUR COMMENT (IEET's comment policy)

Login or Register to post a comment.

Next entry: The Ethics of Benign Carnivorism

Previous entry: Turing Test ‘Passed’ by Chatbot ‘Eugene Goostman’ - What Does it Mean?

HOME | ABOUT | FELLOWS | STAFF | EVENTS | SUPPORT  | CONTACT US
SECURING THE FUTURE | LONGER HEALTHIER LIFE | RIGHTS OF THE PERSON | ENVISIONING THE FUTURE
CYBORG BUDDHA PROJECT | AFRICAN FUTURES PROJECT | JOURNAL OF EVOLUTION AND TECHNOLOGY

RSSIEET Blog | email list | newsletter |
The IEET is a 501(c)3 non-profit, tax-exempt organization registered in the State of Connecticut in the United States.

East Coast Contact: Executive Director, Dr. James J. Hughes,
56 Daleville School Rd., Willington CT 06279 USA 
Email: director @ ieet.org     phone: 860-428-1837

West Coast Contact: Managing Director, Hank Pellissier
425 Moraga Avenue, Piedmont, CA 94611
Email: hank @ ieet.org