Institute for Ethics and Emerging Technologies


The IEET is a 501(c)3 non-profit, tax-exempt organization registered in the State of Connecticut in the United States. Please give as you are able, and help support our work for a brighter future.


Search the IEET
Subscribe and Contribute to:


Technoprogressive? BioConservative? Huh?
Overview of technopolitics


whats new at ieet

First Republican “Hamilton Elector” Breaks Ranks Against Trump

Cybathlon 2016 : entre sport, handicap et transhumanisme

U.S. To Forgive $108 Billion In Student Debt

The informal sector Singularity

Global Trends - The Rising Longevity Industry

Mark Blyth ─ Global Trumpism


ieet books

TECHNOPROG, le transhumanisme au service du progrès social
Author
Marc Roux and Didier Coeurnelle





JET

Enframing the Flesh: Heidegger, Transhumanism, and the Body as “Standing Reserve”

Moral Enhancement and Political Realism

Intelligent Technologies and Lost Life


IEET > Rights > HealthLongevity > Vision > Affiliate Scholar > Melanie Swan > PrivacySurveillance

Print Email permalink (0) Comments (8575) Hits •  subscribe Share on facebook Stumble This submit to reddit submit to digg


What is Big Data and when will it be Smart Data?


Melanie Swan
By Melanie Swan
Ethical Techology

Posted: Jun 12, 2014

Big data is cell phone users having an average of 100 interactions with their phone per day, all of which generate computerized records (100s of trillions of records). Big data is every financial market transaction, every passenger on every airplane flight, every shipped container, every transportation conveyance, every tweet, and every Internet post (all in the 100s of billions or trillions of records). Every transaction for all time.

One area of long-standing data interest is mortgage statistics since mis-estimating prepayments can cost investors billions of dollars. This raises the question of how prepayment risk is still being mis-estimated. Irrespective, mortgage data is one of the fastest growing kinds of data, both by row and column of tracked data, growing at more than 2x Moore’s law on a log chart (Moore’s law reflects the hardware on which the data is stored and manipulated (algorithms somewhat fill the gap)). This begs the question of smart data rather than big data.


There is much talk about all types of data growing (and data scientists being the biggest category of job growth), but the size of big data should surely be one of its most basic attributes. What is much more relevant is the value that big data provides through its use. For example, how has having more rows and columns in mortgage-tracking spreadsheets improved (if at all) prepayment prediction?

‚Äč

Like genomics, many big data problems are in the early stages of ‘the diffs,’ not knowing which part of the data is salient to keep out of the 99% that may be useless. ‘The diffs’ are the differences, the differences between a sample data set and the reference/normal data set that constitute salience and allow the rest of the data to be discarded.  


Melanie Swan, MBA, is an Affiliate Scholar of the IEET. Ms. Swan, principal of the MS Futures Group, is a philosopher, science and technology futurist, and options trader.
Print Email permalink (0) Comments (8576) Hits •  subscribe Share on facebook Stumble This submit to reddit submit to digg


COMMENTS


YOUR COMMENT (IEET's comment policy)

Login or Register to post a comment.

Next entry: The Ethics of Benign Carnivorism

Previous entry: Turing Test ‘Passed’ by Chatbot ‘Eugene Goostman’ - What Does it Mean?

HOME | ABOUT | STAFF | EVENTS | SUPPORT  | CONTACT US
JOURNAL OF EVOLUTION AND TECHNOLOGY

RSSIEET Blog | email list | newsletter |
The IEET is a 501(c)3 non-profit, tax-exempt organization registered in the State of Connecticut in the United States.

Executive Director, Dr. James J. Hughes,
35 Harbor Point Blvd, #404, Boston, MA 02125-3242 USA
Email: director @ ieet.org