<?xml version="1.0" encoding="UTF-8"?>
<!--Generated by Squarespace V5 Site Server v5.13.158 (http://www.squarespace.com) on Wed, 22 May 2013 01:16:41 GMT--><feed xmlns="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/"><title>OCDQ Blog Feed</title><subtitle>OCDQ Blog</subtitle><id>http://www.ocdqblog.com/home/</id><link rel="alternate" type="application/xhtml+xml" href="http://www.ocdqblog.com/home/"/><link rel="self" type="application/atom+xml" href="http://www.ocdqblog.com/home/atom.xml"/><updated>2013-05-16T21:35:22Z</updated><generator uri="http://five.squarespace.com/" version="Squarespace V5 Site Server v5.13.158 (http://www.squarespace.com)">Squarespace</generator><entry><title>The Need for Data Philosophers</title><category term="Big Data"/><category term="Books"/><category term="Data Quality"/><category term="Data Science"/><category term="Debates"/><category term="Philosophy"/><id>http://www.ocdqblog.com/home/the-need-for-data-philosophers.html</id><link rel="alternate" type="text/html" href="http://www.ocdqblog.com/home/the-need-for-data-philosophers.html"/><author><name>Jim Harris</name></author><published>2013-05-16T22:00:00Z</published><updated>2013-05-16T22:00:00Z</updated><content type="html" xml:lang="en-US"><![CDATA[<p>In my post <a title="ocdqblog.com/home/on-philosophy-science-and-data.html" href="http://www.ocdqblog.com/home/on-philosophy-science-and-data.html"><em>On Philosophy, Science, and Data</em></a>, I explained that although some argue philosophy only reigns in the absence of data while science reigns in the analysis of data, a conceptual bridge still remains between analysis and insight, the crossing of which is itself a philosophical exercise.  Therefore, I argued that an endless oscillation persists between science and philosophy, which is why, despite the fact that all we hear about is the need for <strong>data scientists</strong>, there’s also a need for data philosophers.</p>
<p>Of course, the debate between science and philosophy is a very old one, as is the argument we need both.  In my previous post, I slightly paraphrased <a title="wikipedia.org/wiki/Immanuel_Kant" href="http://en.wikipedia.org/wiki/Immanuel_Kant" target="_blank">Immanuel Kant</a> (“perception without conception is blind and conception without perception is empty”) by saying that science without philosophy is blind and philosophy without science is empty.</p>
<p>In his book <a title="amazon.com/Cosmic-Apprentice-Dispatches-Edges-Science/dp/081668135X" href="http://www.amazon.com/Cosmic-Apprentice-Dispatches-Edges-Science/dp/081668135X" target="_blank"><em>Cosmic Apprentice: Dispatches from the Edges of Science</em></a>, Dorion Sagan explained that science and philosophy hang “in a kind of odd balance, watching each other, holding hands.  Science’s eye for detail, buttressed by philosophy’s broad view, makes for a kind of <a title="wikipedia.org/wiki/Alembic" href="http://en.wikipedia.org/wiki/Alembic" target="_blank">alembic</a>, an antidote to both.  Although philosophy isn’t fiction, it can be more personal, creative and open, a kind of counterbalance for science even as it argues that science, with its emphasis on a kind of impersonal materialism, provides a crucial reality check for philosophy and a tendency to over-theorize that’s inimical to the scientific spirit.  Ideally, in the search for truth, science and philosophy, the impersonal and autobiographical, can keep each other honest in a kind of open circuit.”</p>
<p>“Science’s spirit is philosophical,” Sagan concluded.  “It is the spirit of questioning, of curiosity, of critical inquiry combined with fact-checking.  It is the spirit of being able to admit you’re wrong, of appealing to data, not authority.”</p>
<p>“Science,” as his father <a title="wikipedia.org/wiki/Carl_Sagan" href="http://en.wikipedia.org/wiki/Carl_Sagan" target="_blank">Carl Sagan</a> said, “is a way of thinking much more than it is a body of knowledge.”  By extension, we could say that data science is about a way of thinking much more than it is about big data or <a title="bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1123/It-s-Not-about-being-Data-Driven.aspx" href="http://bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1123/It-s-Not-about-being-Data-Driven.aspx" target="_blank">about being data-driven</a>.</p>
<p>I have previously blogged that science has always been about <a title="openmethodology.org/blogs/information-development/2013/04/30/bigger-questions-not-bigger-data" href="http://mike2.openmethodology.org/blogs/information-development/2013/04/30/bigger-questions-not-bigger-data/" target="_blank">bigger questions, not bigger data</a>.  As <a title="wikipedia.org/wiki/Claude_Lévi-Strauss" href="http://en.wikipedia.org/wiki/Claude_Lévi-Strauss" target="_blank">Claude Lévi-Strauss</a> said, “the scientist is not a person who gives the right answers, but one who asks the right questions.”  As far as data science goes, what are the right questions?  Data scientist <a title="melindathielbar.com/2013/03/17/three-questions-that-can-make-data-science-built-to-last" href="http://melindathielbar.com/2013/03/17/three-questions-that-can-make-data-science-built-to-last/" target="_blank">Melinda Thielbar proposes three key questions</a> (Actionable? Verifiable? Repeatable?).</p>
<p>Here again we see the interdependence of science and philosophy.  “Philosophy,” <a title="wikipedia.org/wiki/Marilyn_McCord_Adams" href="http://en.wikipedia.org/wiki/Marilyn_McCord_Adams" target="_blank">Marilyn McCord Adams</a> said, “is thinking really hard about the most important questions and trying to bring analytic clarity both to the questions and the answers.”</p>
<p>“Philosophy is critical thinking,” <a title="wikipedia.org/wiki/Don_Cupitt" href="http://en.wikipedia.org/wiki/Don_Cupitt" target="_blank">Don Cupitt</a> said. “Trying to become aware of how one’s own thinking works, of all the things one takes for granted, of the way in which one’s own thinking shapes the things one’s thinking about.”  Yes, even a data scientist’s own thinking could shape the things they are thinking scientifically about.  Big data evangelist <a title="ibmbigdatahub.com/blog/data-scientist-bias-backlash-and-brutal-self-criticism" href="http://www.ibmbigdatahub.com/blog/data-scientist-bias-backlash-and-brutal-self-criticism" target="_blank">James Kobielus recently blogged</a> about five biases that may crop up in a data scientist’s work (Cognitive, Selection, Sampling, Modeling, Funding).</p>
<p>“Data science has a bright future ahead,” explained <a title="mashable.com/2013/05/14/hilary-mason-data" href="http://mashable.com/2013/05/14/hilary-mason-data/" target="_blank">Hilary Mason in a recent interview</a>.  “There will only be more data, and more of a need for people who can find meaning and value in that data.  We’re also starting to see a greater need for <strong>data engineers</strong>, people to build infrastructure around data and algorithms, and <strong>data artists</strong>, people who can visualize the data.”</p>
<p>I agree with Mason, and I would add that we are also starting to see a greater need for <strong>data philosophers</strong>, people who can, borrowing the words that <a title="wikipedia.org/wiki/Anthony_Kenny" href="http://en.wikipedia.org/wiki/Anthony_Kenny" target="_blank">Anthony Kenny</a> used to define philosophy, “think as clearly as possible about the most fundamental concepts that reach through all the disciplines.”</p>
<p> </p>
<h2>Related Posts</h2>
<table width="873" border="0" cellspacing="3" cellpadding="3">
<tbody>
<tr>
<td valign="top" width="435">
<p><a title="ocdqblog.com/home/on-philosophy-science-and-data.html" href="http://www.ocdqblog.com/home/on-philosophy-science-and-data.html">On Philosophy, Science, and Data</a></p>
<p><a title="ocdqblog.com/home/demystifying-data-science.html" href="http://www.ocdqblog.com/home/demystifying-data-science.html">OCDQ Radio - Demystifying Data Science</a></p>
<p><a title="ocdqblog.com/home/data-quality-and-big-data.html" href="http://www.ocdqblog.com/home/data-quality-and-big-data.html">OCDQ Radio - Data Quality and Big Data </a></p>
<p><a title="ocdqblog.com/home/big-data-and-the-infinite-inbox.html" href="http://www.ocdqblog.com/home/big-data-and-the-infinite-inbox.html">Big Data and the Infinite Inbox</a></p>
<p><a title="ocdqblog.com/home/the-laugh-in-effect-of-big-data.html" href="http://www.ocdqblog.com/home/the-laugh-in-effect-of-big-data.html">The Laugh-In Effect of Big Data</a></p>
<p><a title="ocdqblog.com/home/hoardabytes-and-the-big-data-lebowski.html" href="http://www.ocdqblog.com/home/hoardabytes-and-the-big-data-lebowski.html">HoardaBytes and the Big Data Lebowski</a></p>
<p><a title="ocdqblog.com/home/magic-elephants-data-psychics-and-invisible-gorillas.html" href="http://www.ocdqblog.com/home/magic-elephants-data-psychics-and-invisible-gorillas.html">Magic Elephants, Data Psychics, and Invisible Gorillas</a></p>
<p><a title="ocdqblog.com/home/the-graystone-effects-of-big-data.html" href="http://www.ocdqblog.com/home/the-graystone-effects-of-big-data.html">The Graystone Effects of Big Data</a></p>
<p><a title="ocdqblog.com/home/information-overload-revisited.html" href="http://www.ocdqblog.com/home/information-overload-revisited.html">Information Overload Revisited</a></p>
<p><a title="ocdqblog.com/home/exercise-better-data-management.html" href="http://www.ocdqblog.com/home/exercise-better-data-management.html">Exercise Better Data Management</a></p>
<p><a title="ocdqblog.com/home/a-tale-of-two-datas.html" href="http://www.ocdqblog.com/home/a-tale-of-two-datas.html">A Tale of Two Datas</a></p>
<p><a title="ocdqblog.com/home/the-wisdom-of-crowds-friends-and-experts.html" href="http://www.ocdqblog.com/home/the-wisdom-of-crowds-friends-and-experts.html">The Wisdom of Crowds, Friends, and Experts</a></p>
</td>
<td valign="top" width="435">
<p><a class="offsite-link-inline" title="bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1181/Why-Data-Science-Storytelling-Needs-a-Good-Editor.aspx" href="http://bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1181/Why-Data-Science-Storytelling-Needs-a-Good-Editor.aspx" target="_blank">Why Data Science Storytelling Needs a Good Editor</a></p>
<p><a class="offsite-link-inline" title="bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1187/Predictive-Analytics-the-Data-Effect-and-Jed-Clampett.aspx" href="http://bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1187/Predictive-Analytics-the-Data-Effect-and-Jed-Clampett.aspx" target="_blank">Predictive Analytics, the Data Effect, and Jed Clampett</a></p>
<p><a class="offsite-link-inline" title="openmethodology.org/blogs/information-development/2013/04/30/bigger-questions-not-bigger-data" href="http://mike2.openmethodology.org/blogs/information-development/2013/04/30/bigger-questions-not-bigger-data/" target="_blank">Bigger Questions, not Bigger Data</a></p>
<p><a class="offsite-link-inline" title="bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1175/The-Flying-Monkeys-of-Big-Data.aspx" href="http://bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1175/The-Flying-Monkeys-of-Big-Data.aspx" target="_blank">The Flying Monkeys of Big Data</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=12862" href="http://www.dataroundtable.com/?p=12862" target="_blank">Cargo Cult Data Science</a></p>
<p><a class="offsite-link-inline" title="bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1149/Speed-Up-Your-Data-to-Slow-Down-Your-Decisions.aspx" href="http://bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1149/Speed-Up-Your-Data-to-Slow-Down-Your-Decisions.aspx" target="_blank">Speed Up Your Data to Slow Down Your Decisions</a></p>
<p><a class="offsite-link-inline" title="bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1123/It-s-Not-about-being-Data-Driven.aspx" href="http://bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1123/It-s-Not-about-being-Data-Driven.aspx" target="_blank">It’s Not about being Data-Driven</a></p>
<p><a class="offsite-link-inline" title="bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1129/Big-Data-Sporks-and-Decision-Frames.aspx" href="http://bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1129/Big-Data-Sporks-and-Decision-Frames.aspx" target="_blank">Big Data, Sporks, and Decision Frames</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=10689" href="http://www.dataroundtable.com/?p=10689" target="_blank">Big Data: Structure and Quality</a></p>
<p><a class="offsite-link-inline" title="bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1088/Darth-Vader-Big-Data-and-Predictive-Analytics.aspx" href="http://bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1088/Darth-Vader-Big-Data-and-Predictive-Analytics.aspx" target="_blank">Darth Vader, Big Data, and Predictive Analytics</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=10993" href="http://www.dataroundtable.com/?p=10993" target="_blank">What Magic Tricks teach us about Data Science</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=10951" href="http://www.dataroundtable.com/?p=10951" target="_blank">What Mozart for Babies teaches us about Data Science</a></p>
</td>
</tr>
</tbody>
</table>

<p>
<a href="http://twitter.com/share" class="twitter-share-button" data-url="http://www.ocdqblog.com/home/the-need-for-data-philosophers.html" data-text="The Need for Data Philosophers #DataQuality #BigData #DataScience #FutureOfDS" data-count="vertical" data-via="ocdqblog">Tweet</a><script type="text/javascript" src="http://platform.twitter.com/widgets.js"></script>
<script type="text/javascript" src="http://platform.linkedin.com/in.js"></script><script type="in/share" data-url="http://www.ocdqblog.com/home/the-need-for-data-philosophers.html" data-counter="top"></script>
</p>]]></content></entry><entry><title>Keep Looking Up Insights in Data</title><category term="Books"/><category term="Data Quality"/><category term="Debates"/><category term="Philosophy"/><id>http://www.ocdqblog.com/home/keep-looking-up-insights-in-data.html</id><link rel="alternate" type="text/html" href="http://www.ocdqblog.com/home/keep-looking-up-insights-in-data.html"/><author><name>Jim Harris</name></author><published>2013-05-07T14:00:00Z</published><updated>2013-05-07T14:00:00Z</updated><content type="html" xml:lang="en-US"><![CDATA[<p>In a previous post, I used the history of the <a title="wikipedia.org/wiki/Hubble_Space_Telescope" href="http://en.wikipedia.org/wiki/Hubble_Space_Telescope" target="_blank">Hubble Space Telescope</a> to explain <a title="ocdqblog.com/home/how-data-cleansing-saves-lives.html" href="http://www.ocdqblog.com/home/how-data-cleansing-saves-lives.html">how data cleansing saves lives</a>, based on a true story I read in the book&nbsp;<a title="amazon.com/Space-Chronicles-Facing-Ultimate-Frontier/dp/0393082105" href="http://www.amazon.com/Space-Chronicles-Facing-Ultimate-Frontier/dp/0393082105" target="_blank"><em>Space Chronicles: Facing the Ultimate Frontier</em></a> by Neil deGrasse Tyson. &nbsp;In this post, Hubble and Tyson once again provide the inspiration for an insightful metaphor about data quality.</p>
<p>Hubble is one of dozens of space telescopes of assorted sizes and shapes orbiting the Earth. &nbsp;&ldquo;Each one,&rdquo; Tyson explained, &ldquo;provides a view of the cosmos that is unobstructed, unblemished, and undiminished by Earth&rsquo;s turbulent and murky atmosphere. &nbsp;They are designed to detect bands of light invisible to the human eye, some of which never penetrate Earth&rsquo;s atmosphere. &nbsp;Hubble is the first and only space telescope to observe the universe using primarily visible light. &nbsp;Its stunningly crisp, colorful, and detailed images of the cosmos make Hubble a kind of supreme version of the human eye in space.&rdquo;</p>
<p>This is how we&rsquo;d like the quality of data to be when we&rsquo;re looking for business insights. &nbsp;High-quality data provides stunningly crisp, colorful, and detailed images of the business cosmos, acting&nbsp;as a kind of supreme version of the human eye in data.</p>
<p>However, despite their less-than-perfect vision, the limitations of Earth-based telescopes still facilitated significant scientific breakthroughs long before Hubble became the first space telescope in 1990.</p>
<p>In 1609, when the Italian physicist and astronomer <a title="wikipedia.org/wiki/Galileo_Galilei" href="http://en.wikipedia.org/wiki/Galileo_Galilei" target="_blank">Galileo Galilei</a> turned a telescope of his own design to the sky, as Tyson explained, he &ldquo;heralded a new era of technology-aided discovery, whereby the capacities of the human senses could be extended, revealing the natural world in unprecedented, even heretical ways. &nbsp;The fact that Galileo revealed the Sun to have spots, the planet Jupiter to have satellites [its four moons: Callisto, Ganymede, Europa, Io], and Earth not to be the center of all celestial motion was enough to unsettle centuries of Aristotelian teachings by the Catholic Church and to put Galileo under house arrest.&rdquo;</p>
<p>And in 1964, another Earth-based telescope, this one operated by the American astronomers Arno Penzias and Robert Wilson at AT&amp;T Bell Labs, was responsible for what is widely considered the most important single discovery in astrophysics, what&rsquo;s now known as <a title="wikipedia.org/wiki/Cosmic_microwave_background_radiation" href="http://en.wikipedia.org/wiki/Cosmic_microwave_background_radiation" target="_blank">cosmic microwave background radiation</a>, and for which Penzias and Wilson won the 1978 Nobel Prize in Physics.</p>
<p>Recently, I&rsquo;ve blogged about how there are times&nbsp;<a title="ocdqblog.com/home/when-poor-data-quality-kills.html" href="http://www.ocdqblog.com/home/when-poor-data-quality-kills.html">when perfect data quality is necessary</a>, when we need the equivalent of a space telescope, and times <a title="ocdqblog.com/home/data-quality-and-the-ok-plateau.html" href="http://www.ocdqblog.com/home/data-quality-and-the-ok-plateau.html">when okay data quality is good enough</a>, when the equivalent of an Earth-based telescope will do.</p>
<p>What I would like you to take away from this post is that perfect data quality is not a prerequisite for the discovery of new business insights. &nbsp;Even when data doesn&rsquo;t provide a perfect view of the business cosmos, even when it&rsquo;s partially obstructed, blemished, or diminished by the turbulent and murky atmosphere of poor quality, data can still provide business insights.</p>
<p>This doesn&rsquo;t mean that you should settle for poor data quality, just that <a title="ocdqblog.com/home/to-our-data-perfectionists.html" href="http://www.ocdqblog.com/home/to-our-data-perfectionists.html">you shouldn’t demand perfection</a> before using data.</p>
<p>Tyson ends each episode of his <a title="startalkradio.net" href="http://www.startalkradio.net/" target="_blank">StarTalk Radio</a> program by saying &ldquo;keep looking up,&rdquo; so I will end this blog post by saying, even when its quality isn&rsquo;t perfect, keep looking up insights in data.</p>
<p>&nbsp;</p>
<h2>Related Posts</h2>
<table border="0" cellspacing="3" cellpadding="3" width="873">
<tbody>
<tr>
<td width="435" valign="top">
<p><a title="ocdqblog.com/home/data-quality-and-the-ok-plateau.html" href="http://www.ocdqblog.com/home/data-quality-and-the-ok-plateau.html">Data Quality and the OK Plateau</a></p>
<p><a title="ocdqblog.com/home/when-poor-data-quality-kills.html" href="http://www.ocdqblog.com/home/when-poor-data-quality-kills.html">When Poor Data Quality Kills</a></p>
<p><a title="ocdqblog.com/home/how-data-cleansing-saves-lives.html" href="http://www.ocdqblog.com/home/how-data-cleansing-saves-lives.html">How Data Cleansing Saves Lives</a></p>
<p><a title="ocdqblog.com/home/the-dichotomy-paradox-data-quality-and-zero-defects.html" href="http://www.ocdqblog.com/home/the-dichotomy-paradox-data-quality-and-zero-defects.html">The Dichotomy Paradox, Data Quality and Zero Defects</a></p>
<p><a title="ocdqblog.com/home/the-asymptote-of-data-quality.html" href="http://www.ocdqblog.com/home/the-asymptote-of-data-quality.html">The Asymptote of Data Quality</a></p>
<p><a title="ocdqblog.com/home/to-our-data-perfectionists.html" href="http://www.ocdqblog.com/home/to-our-data-perfectionists.html">To Our Data Perfectionists</a></p>
<p><a title="ocdqblog.com/home/data-quality-and-miracle-exceptions.html" href="http://www.ocdqblog.com/home/data-quality-and-miracle-exceptions.html">Data Quality and Miracle Exceptions</a></p>
<p><a title="ocdqblog.com/home/data-quality-quo-vadimus.html" href="http://www.ocdqblog.com/home/data-quality-quo-vadimus.html">Data Quality: Quo Vadimus?</a></p>
</td>
<td width="435" valign="top">
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=11810" href="http://www.dataroundtable.com/?p=11810" target="_blank">The Seventh Law of Data Quality</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=1711" href="http://www.dataroundtable.com/?p=1711" target="_blank">A Tale of Two Q&rsquo;s</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=1560" href="http://www.dataroundtable.com/?p=1560" target="_blank">Data Quality and The Middle Way</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=12780" href="http://www.dataroundtable.com/?p=12780" target="_blank">Stop Poor Data Quality STOP</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=8537" href="http://www.dataroundtable.com/?p=8537" target="_blank">Freudian Data Quality</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=3348" href="http://www.dataroundtable.com/?p=3348" target="_blank">Predictably Poor Data Quality</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=12719" href="http://www.dataroundtable.com/?p=12719" target="_blank">This isn&rsquo;t Jeopardy</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=8998" href="http://www.dataroundtable.com/?p=8998" target="_blank">Satisficing Data Quality</a></p>
</td>
</tr>
</tbody>
</table>

<p>
<a href="http://twitter.com/share" class="twitter-share-button" data-url="http://www.ocdqblog.com/home/keep-looking-up-insights-in-data.html" data-text="Keep Looking Up Insights in Data #DataQuality" data-count="vertical" data-via="ocdqblog">Tweet</a><script type="text/javascript" src="http://platform.twitter.com/widgets.js"></script>
<script type="text/javascript" src="http://platform.linkedin.com/in.js"></script><script type="in/share" data-url="http://www.ocdqblog.com/home/keep-looking-up-insights-in-data.html" data-counter="top"></script>
</p>]]></content></entry><entry><title>Business Intelligence for Midsize Businesses</title><category term="Books"/><category term="Business Intelligence"/><category term="Cloud"/><category term="IBM for Midsize Business"/><category term="IT"/><category term="Lyndsay Wise"/><category term="Mobile"/><category term="Open Source"/><category term="Sponsored Blog Posts"/><id>http://www.ocdqblog.com/home/business-intelligence-for-midsize-businesses.html</id><link rel="alternate" type="text/html" href="http://www.ocdqblog.com/home/business-intelligence-for-midsize-businesses.html"/><author><name>Jim Harris</name></author><published>2013-04-30T22:00:00Z</published><updated>2013-04-30T22:00:00Z</updated><content type="html" xml:lang="en-US"><![CDATA[<p><em>Business intelligence</em> is one of those phrases that everyone agrees is something all organizations, regardless of their size, should be doing. &nbsp;After all, no organization would admit to doing&nbsp;<em>business stupidity</em>. &nbsp;Nor, I presume, would any vendor admit to selling it.</p>
<p>But not everyone seems to agree on what the phrase&nbsp;means. &nbsp;Personally, I have always defined business intelligence as the data analytics performed in support of making informed business decisions (i.e., for me, business intelligence = decision support).</p>
<p>Oftentimes, this analytics is performed on data integrated, cleansed, and consolidated into a repository (e.g., a data warehouse). &nbsp;Other times, it&rsquo;s performed on a single data set (e.g., a customer information file). &nbsp;Either way, business decision makers interact with the analytical results via static reports, data visualizations, dynamic dashboards, and ad hoc querying and reporting tools.</p>
<p>But robust business intelligence and analytics solutions used to be perceived as something only implemented by big businesses, as evinced in the big price tags usually associated with them. &nbsp;However, free and open source software,&nbsp;<a title="ocdqblog.com/home/cloud-computing-for-midsize-businesses.html" href="http://www.ocdqblog.com/home/cloud-computing-for-midsize-businesses.html">cloud computing</a>,&nbsp;<a title="ocdqblog.com/home/devising-a-mobile-device-strategy.html" href="http://www.ocdqblog.com/home/devising-a-mobile-device-strategy.html">mobile</a>, <a title="ocdqblog.com/home/social-business-is-more-than-social-marketing.html" href="http://www.ocdqblog.com/home/social-business-is-more-than-social-marketing.html">social</a>, and a variety of&nbsp;<a title="ocdqblog.com/home/a-swift-kick-in-the-aas.html" href="http://www.ocdqblog.com/home/a-swift-kick-in-the-aas.html">as-a-service</a> technologies drove&nbsp;<a title="ocdqblog.com/home/the-diffusion-of-the-consumerization-of-it.html" href="http://www.ocdqblog.com/home/the-diffusion-of-the-consumerization-of-it.html">the consumerization of IT</a>, driving down the costs of solutions,&nbsp;enabling small and midsize businesses to afford them. &nbsp;Additionally, the&nbsp;open data movement lead to a wealth of free public data sets that can be incorporated into business intelligence and analytics solutions (examples can be found at&nbsp;<a href="http://www.kdnuggets.com/datasets/" target="_blank">kdnuggets.com/datasets</a>).</p>
<p><a title="wiseanalytics.com" href="http://www.wiseanalytics.com/" target="_blank">Lyndsay Wise</a>, author of the insightful book&nbsp;<em><a title="wiseanalytics.com/book/book.php" href="http://wiseanalytics.com/book/book.php" target="_blank">Using Open Source Platforms for Business Intelligence</a></em> (to listen to a podcast about the book, click here:&nbsp;<a title="ocdqblog.com/home/open-source-business-intelligence.html" href="http://www.ocdqblog.com/home/open-source-business-intelligence.html">OSBI on OCDQ Radio</a>),&nbsp;recently blogged about&nbsp;<a title="wiseanalytics.com/blog/2013/03/24/the-time-is-ripe-for-business-intelligence-bi-for-smbs" href="http://www.wiseanalytics.com/blog/2013/03/24/the-time-is-ripe-for-business-intelligence-bi-for-smbs/" target="_blank">business intelligence for small and midsize businesses</a>.</p>
<p>Wise advised that &ldquo;recent market changes have shifted the market in favor of small and midsize businesses. &nbsp;Before this, most were limited by requirements for large infrastructures, high-cost licensing, and limited solution availability. &nbsp;With this newly added flexibility and access to lower price points, business intelligence and analytics solutions are no longer out of reach.&rdquo;</p>
<p>&nbsp;</p>
<p><img style="float: left;" src="http://www.ocdqblog.com/storage/website-images/IBM%20Logo.jpg" border="0" alt="" width="188" height="76" /></p>
<p style="text-align: right;"><em>This post was written as part of the <a title="IBM Midsize Business Solutions" href="http://goo.gl/t3fgW" target="_blank">IBM for Midsize Business</a> program, which provides midsize businesses with the tools, expertise and solutions they need to become engines of a smarter planet. I&rsquo;ve been compensated to contribute to this program, but the opinions expressed in this post are my own and don&rsquo;t necessarily represent IBM&rsquo;s positions, strategies, or opinions.</em></p>
<p>&nbsp;</p>
<h2>Related Posts</h2>
<table border="0" cellspacing="3" cellpadding="3" width="873">
<tbody>
<tr>
<td width="435" valign="top">
<p><a title="ocdqblog.com/home/the-big-datastillery.html" href="http://www.ocdqblog.com/home/the-big-datastillery.html">The Big Datastillery</a></p>
<p><a title="ocdqblog.com/home/smart-big-data-adoption-for-midsize-businesses.html" href="http://www.ocdqblog.com/home/smart-big-data-adoption-for-midsize-businesses.html">Smart Big Data Adoption for Midsize Businesses</a></p>
<p><a title="ocdqblog.com/home/big-data-is-not-just-for-big-businesses.html" href="http://www.ocdqblog.com/home/big-data-is-not-just-for-big-businesses.html">Big Data is not just for Big Businesses</a></p>
<p><a title="ocdqblog.com/home/big-data-lessons-from-orbitz.html" href="http://www.ocdqblog.com/home/big-data-lessons-from-orbitz.html">Big Data Lessons from Orbitz</a></p>
<p><a title="ocdqblog.com/home/the-graystone-effects-of-big-data.html" href="http://www.ocdqblog.com/home/the-graystone-effects-of-big-data.html">The Graystone Effects of Big Data</a></p>
<p><a title="ocdqblog.com/home/will-big-data-be-blinded-by-data-science.html" href="http://www.ocdqblog.com/home/will-big-data-be-blinded-by-data-science.html">Will Big Data be Blinded by Data Science?</a></p>
<p><a title="ocdqblog.com/home/social-business-is-more-than-social-marketing.html" href="http://www.ocdqblog.com/home/social-business-is-more-than-social-marketing.html">Social Business is more than Social Marketing</a></p>
<p><a title="ocdqblog.com/home/social-media-marketing-from-monologues-to-dialogues.html" href="http://www.ocdqblog.com/home/social-media-marketing-from-monologues-to-dialogues.html">Social Media Marketing: From Monologues to Dialogues</a></p>
<p><a title="ocdqblog.com/home/social-media-for-midsize-businesses.html" href="http://www.ocdqblog.com/home/social-media-for-midsize-businesses.html">Social Media for Midsize Businesses</a></p>
</td>
<td width="435" valign="top">
<p><a title="ocdqblog.com/home/barriers-to-cloud-adoption.html" href="http://www.ocdqblog.com/home/barriers-to-cloud-adoption.html">Barriers to Cloud Adoption</a></p>
<p><a title="ocdqblog.com/home/leveraging-the-cloud-for-application-development.html" href="http://www.ocdqblog.com/home/leveraging-the-cloud-for-application-development.html">Leveraging the Cloud for Application Development</a></p>
<p><a title="ocdqblog.com/home/cloud-computing-for-midsize-businesses.html" href="http://www.ocdqblog.com/home/cloud-computing-for-midsize-businesses.html">Cloud Computing for Midsize Businesses</a></p>
<p><a title="ocdqblog.com/home/cloud-computing-is-the-new-nimbyism.html" href="http://www.ocdqblog.com/home/cloud-computing-is-the-new-nimbyism.html">Cloud Computing is the New Nimbyism</a></p>
<p><a title="ocdqblog.com/home/devising-a-mobile-device-strategy.html" href="http://www.ocdqblog.com/home/devising-a-mobile-device-strategy.html">Devising a Mobile Device Strategy</a></p>
<p><a title="ocdqblog.com/home/the-age-of-the-mobile-device.html" href="http://www.ocdqblog.com/home/the-age-of-the-mobile-device.html">The Age of the Mobile Device</a></p>
<p><a title="ocdqblog.com/home/word-of-mouth-has-become-word-of-data.html" href="http://www.ocdqblog.com/home/word-of-mouth-has-become-word-of-data.html">Word of Mouth has become Word of Data</a></p>
<p><a title="ocdqblog.com/home/information-asymmetry-versus-empowered-customers.html" href="http://www.ocdqblog.com/home/information-asymmetry-versus-empowered-customers.html">Information Asymmetry versus Empowered Customers</a></p>
<p><a title="ocdqblog.com/home/talking-business-about-the-weather.html" href="http://www.ocdqblog.com/home/talking-business-about-the-weather.html">Talking Business about the Weather</a></p>
</td>
</tr>
</tbody>
</table>

<p>
<a href="http://twitter.com/share" class="twitter-share-button" data-url="http://www.ocdqblog.com/home/business-intelligence-for-midsize-businesses.html" data-text="Business Intelligence for Midsize Businesses #BusinessIntelligence #IBMsmb" data-count="vertical" data-via="ocdqblog">Tweet</a><script type="text/javascript" src="http://platform.twitter.com/widgets.js"></script>
<script type="text/javascript" src="http://platform.linkedin.com/in.js"></script><script type="in/share" data-url="http://www.ocdqblog.com/home/business-intelligence-for-midsize-businesses.html" data-counter="top"></script>
</p>

<!-- Start of StatCounter Code for Default Guide -->
<script type="text/javascript">
var sc_project=7819984;
var sc_invisible=1;
var sc_security="b93f7b04";
</script>
<script type="text/javascript"
src="http://www.statcounter.com/counter/counter.js"></script>
<noscript><div class="statcounter"><a title="tumblr visitor"
href="http://statcounter.com/tumblr/" target="_blank"><img
class="statcounter"
src="http://c.statcounter.com/7819984/0/b93f7b04/1/"
alt="tumblr visitor"></a></div></noscript>
<!-- End of StatCounter Code for Default Guide -->]]></content></entry><entry><title>The Laugh-In Effect of Big Data</title><category term="Big Data"/><category term="Books"/><category term="Data Quality"/><category term="Humor"/><category term="Philosophy"/><id>http://www.ocdqblog.com/home/the-laugh-in-effect-of-big-data.html</id><link rel="alternate" type="text/html" href="http://www.ocdqblog.com/home/the-laugh-in-effect-of-big-data.html"/><author><name>Jim Harris</name></author><published>2013-04-23T14:00:00Z</published><updated>2013-04-23T14:00:00Z</updated><content type="html" xml:lang="en-US"><![CDATA[<p>Although I am an advocate for data science and big data done right, lately I have been <strong>sounding the Anti-Hype Horn</strong> with blog posts offering <a title="openmethodology.org/blogs/information-development/2013/03/28/a-contrarians-view-of-unstructured-data" href="http://mike2.openmethodology.org/blogs/information-development/2013/03/28/a-contrarians-view-of-unstructured-data/" target="_blank">a contrarian’s view of unstructured data</a>, forewarning you about <a title="bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1175/The-Flying-Monkeys-of-Big-Data.aspx" href="http://bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1175/The-Flying-Monkeys-of-Big-Data.aspx" target="_blank">the flying monkeys of big data</a>, cautioning you against performing <a title="dataroundtable.com/?p=12862" href="http://www.dataroundtable.com/?p=12862" target="_blank">Cargo Cult Data Science</a>, and inviting you to ponder the perils of <a title="ocdqblog.com/home/big-data-and-the-infinite-inbox.html" href="http://www.ocdqblog.com/home/big-data-and-the-infinite-inbox.html">the Infinite Inbox</a>.</p>
<p><a title="ocdqblog.com/home/hoardabytes-and-the-big-data-lebowski.html" href="http://www.ocdqblog.com/home/hoardabytes-and-the-big-data-lebowski.html">The hype of big data</a> has resulted in a lot of people and vendors extolling its virtues with stories about how <a title="ocdqblog.com/home/the-data-cold-war.html" href="http://www.ocdqblog.com/home/the-data-cold-war.html">Internet companies</a>, <a title="technologyreview.com/featuredstory/508856/obamas-data-techniques-will-rule-future-elections" href="http://www.technologyreview.com/featuredstory/508856/obamas-data-techniques-will-rule-future-elections/" target="_blank">political campaigns</a>, and <a title="forbes.com/sites/oreillymedia/2012/02/07/apache-hadoop-what-you-need-to-know-about-this-important-big-data-tool" href="http://www.forbes.com/sites/oreillymedia/2012/02/07/apache-hadoop-what-you-need-to-know-about-this-important-big-data-tool/" target="_blank">new technologies</a> have profited, or otherwise benefited, from big data.  These stories are served up as alleged business cases for investing in big data and data science.  Although some of these stories are fluff pieces, many of them accurately, and in some cases comprehensively, describe a real-world application of big data and data science.  However, these messages most often lack a critically important component — <strong>applicability to your specific business</strong>.  In <a title="amazon.com/Made-Stick-Ideas-Survive-Others/dp/1400064287" href="http://www.amazon.com/Made-Stick-Ideas-Survive-Others/dp/1400064287" target="_blank"><em>Made to Stick: Why Some Ideas Survive and Others Die</em></a>, Chip Heath and Dan Heath explained that “an accurate but useless idea is still useless.  If a message can’t be used to make predictions or decisions, it is without value, no matter how accurate or comprehensive it is.”</p>
<p><a title="Wikipedia article about Rowan &amp; Martin’s Laugh-In" href="http://en.wikipedia.org/wiki/Rowan_%26_Martin%27s_Laugh-In" target="_blank"><em>Rowan &amp; Martin’s Laugh-In</em></a> was an American sketch comedy television series, which aired from 1968 to 1973.  One of the recurring characters portrayed by <a title="wikipedia.org/wiki/Arte_Johnson" href="http://en.wikipedia.org/wiki/Arte_Johnson" target="_blank">Arte Johnson</a> was Wolfgang the German soldier, who would often comment on the previous comedy sketch by saying (in a heavy and long-drawn-out German accent): “Very interesting . . . but stupid!”</p>
<p>From now on whenever someone shares another interesting story masquerading as a solid business case for big data that lacks any applicability beyond the specific scenario in the story, a common phenomenon I call <strong>The Laugh-In Effect of Big Data</strong>, my unapologetic response will resoundingly be: “Very interesting . . . but stupid!”</p>
<p> </p>
<h2>Related Posts</h2>
<table border="0" cellspacing="3" cellpadding="3" width="873">
<tbody>
<tr>
<td width="435" valign="top">
<p><a title="ocdqblog.com/home/on-philosophy-science-and-data.html" href="http://www.ocdqblog.com/home/on-philosophy-science-and-data.html">On Philosophy, Science, and Data</a></p>
<p><a title="ocdqblog.com/home/demystifying-data-science.html" href="http://www.ocdqblog.com/home/demystifying-data-science.html">OCDQ Radio - Demystifying Data Science</a></p>
<p><a title="ocdqblog.com/home/data-quality-and-big-data.html" href="http://www.ocdqblog.com/home/data-quality-and-big-data.html">OCDQ Radio - Data Quality and Big Data </a></p>
<p><a title="ocdqblog.com/home/big-data-and-the-infinite-inbox.html" href="http://www.ocdqblog.com/home/big-data-and-the-infinite-inbox.html">Big Data and the Infinite Inbox</a></p>
<p><a title="ocdqblog.com/home/hoardabytes-and-the-big-data-lebowski.html" href="http://www.ocdqblog.com/home/hoardabytes-and-the-big-data-lebowski.html">HoardaBytes and the Big Data Lebowski</a></p>
<p><a title="ocdqblog.com/home/will-big-data-be-blinded-by-data-science.html" href="http://www.ocdqblog.com/home/will-big-data-be-blinded-by-data-science.html">Will Big Data be Blinded by Data Science?</a></p>
<p><a title="ocdqblog.com/home/data-silence.html" href="http://www.ocdqblog.com/home/data-silence.html">Data Silence</a></p>
<p><a title="ocdqblog.com/home/magic-elephants-data-psychics-and-invisible-gorillas.html" href="http://www.ocdqblog.com/home/magic-elephants-data-psychics-and-invisible-gorillas.html">Magic Elephants, Data Psychics, and Invisible Gorillas</a></p>
<p><a title="ocdqblog.com/home/the-graystone-effects-of-big-data.html" href="http://www.ocdqblog.com/home/the-graystone-effects-of-big-data.html">The Graystone Effects of Big Data</a></p>
<p><a title="ocdqblog.com/home/big-data-el-memorioso.html" href="http://www.ocdqblog.com/home/big-data-el-memorioso.html">Big Data el Memorioso</a></p>
<p><a title="ocdqblog.com/home/information-overload-revisited.html" href="http://www.ocdqblog.com/home/information-overload-revisited.html">Information Overload Revisited</a></p>
<p><a title="ocdqblog.com/home/exercise-better-data-management.html" href="http://www.ocdqblog.com/home/exercise-better-data-management.html">Exercise Better Data Management</a></p>
<p><a title="ocdqblog.com/home/a-tale-of-two-datas.html" href="http://www.ocdqblog.com/home/a-tale-of-two-datas.html">A Tale of Two Datas</a></p>
<p><a title="http://www.ocdqblog.com/home/dot-collectors-and-dot-connectors.html" href="http://www.ocdqblog.com/home/dot-collectors-and-dot-connectors.html">Dot Collectors and Dot Connectors</a></p>
<p><a title="ocdqblog.com/home/the-wisdom-of-crowds-friends-and-experts.html" href="http://www.ocdqblog.com/home/the-wisdom-of-crowds-friends-and-experts.html">The Wisdom of Crowds, Friends, and Experts</a></p>
</td>
<td width="435" valign="top">
<p><a class="offsite-link-inline" title="openmethodology.org/blogs/information-development/2013/03/28/a-contrarians-view-of-unstructured-data/" href="http://mike2.openmethodology.org/blogs/information-development/2013/03/28/a-contrarians-view-of-unstructured-data/">A Contrarian’s View of Unstructured Data</a></p>
<p><a class="offsite-link-inline" title="bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1175/The-Flying-Monkeys-of-Big-Data.aspx" href="http://bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1175/The-Flying-Monkeys-of-Big-Data.aspx">The Flying Monkeys of Big Data</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=12862" href="http://www.dataroundtable.com/?p=12862">Cargo Cult Data Science</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=12194" href="http://www.dataroundtable.com/?p=12194" target="_blank">A Statistically Significant Resolution for 2013</a></p>
<p><a class="offsite-link-inline" title="bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1149/Speed-Up-Your-Data-to-Slow-Down-Your-Decisions.aspx" href="http://bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1149/Speed-Up-Your-Data-to-Slow-Down-Your-Decisions.aspx">Speed Up Your Data to Slow Down Your Decisions</a></p>
<p><a class="offsite-link-inline" title="bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1139/Rage-against-the-Machines-Learning.aspx" href="http://bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1139/Rage-against-the-Machines-Learning.aspx">Rage against the Machines Learning</a></p>
<p><a class="offsite-link-inline" title="bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1123/It-s-Not-about-being-Data-Driven.aspx" href="http://bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1123/It-s-Not-about-being-Data-Driven.aspx" target="_blank">It’s Not about being Data-Driven</a></p>
<p><a class="offsite-link-inline" title="bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1129/Big-Data-Sporks-and-Decision-Frames.aspx" href="http://bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1129/Big-Data-Sporks-and-Decision-Frames.aspx" target="_blank">Big Data, Sporks, and Decision Frames</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=10689" href="http://www.dataroundtable.com/?p=10689" target="_blank">Big Data: Structure and Quality</a></p>
<p><a class="offsite-link-inline" title="bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1088/Darth-Vader-Big-Data-and-Predictive-Analytics.aspx" href="http://bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1088/Darth-Vader-Big-Data-and-Predictive-Analytics.aspx" target="_blank">Darth Vader, Big Data, and Predictive Analytics</a></p>
<p><a class="offsite-link-inline" title="bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1117/Big-Data-Predictive-Analytics-and-the-Ideal-Chronicler.aspx" href="http://bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1117/Big-Data-Predictive-Analytics-and-the-Ideal-Chronicler.aspx" target="_blank">Big Data, Predictive Analytics, and the Ideal Chronicler</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=10190" href="http://www.dataroundtable.com/?p=10190" target="_blank">The Big Data Theory</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=10144" href="http://www.dataroundtable.com/?p=10144" target="_blank">Swimming in Big Data</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=10993" href="http://www.dataroundtable.com/?p=10993" target="_blank">What Magic Tricks teach us about Data Science</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=10951" href="http://www.dataroundtable.com/?p=10951" target="_blank">What Mozart for Babies teaches us about Data Science</a></p>
</td>
</tr>
</tbody>
</table>

<p>
<a href="http://twitter.com/share" class="twitter-share-button" data-url="http://www.ocdqblog.com/home/the-laugh-in-effect-of-big-data.html" data-text="The Laugh-In Effect of Big Data #DataQuality #BigData" data-count="vertical" data-via="ocdqblog">Tweet</a><script type="text/javascript" src="http://platform.twitter.com/widgets.js"></script>
<script type="text/javascript" src="http://platform.linkedin.com/in.js"></script><script type="in/share" data-url="http://www.ocdqblog.com/home/the-laugh-in-effect-of-big-data.html" data-counter="top"></script>
</p>]]></content></entry><entry><title>The Costs and Profits of Poor Data Quality</title><category term="Data Quality"/><category term="Debates"/><category term="Philosophy"/><id>http://www.ocdqblog.com/home/the-costs-and-profits-of-poor-data-quality.html</id><link rel="alternate" type="text/html" href="http://www.ocdqblog.com/home/the-costs-and-profits-of-poor-data-quality.html"/><author><name>Jim Harris</name></author><published>2013-04-16T20:00:00Z</published><updated>2013-04-16T20:00:00Z</updated><content type="html" xml:lang="en-US"><![CDATA[<p>Continuing the theme of my two previous posts, which discussed <a title="ocdqblog.com/home/data-quality-and-the-ok-plateau.html" href="http://www.ocdqblog.com/home/data-quality-and-the-ok-plateau.html">when it’s okay to call data quality as good as it needs to get</a> and <a title="ocdqblog.com/home/when-poor-data-quality-kills.html" href="http://www.ocdqblog.com/home/when-poor-data-quality-kills.html">when perfect data quality is necessary</a>, in this post I want to briefly discuss the costs — and <a title="ocdqblog.com/home/promoting-poor-data-quality.html" href="http://www.ocdqblog.com/home/promoting-poor-data-quality.html">profits</a> — of poor data quality.</p>
<p>Loraine Lawson interviewed Ted Friedman of Gartner Research about <a title="itbusinessedge.com/interviews/how-to-measure-the-cost-of-data-quality-problems.html" href="http://www.itbusinessedge.com/interviews/how-to-measure-the-cost-of-data-quality-problems.html" target="_blank"><em>How to Measure the Cost of Data Quality Problems</em></a>, such as the costs associated with reduced productivity, redundancies, business processes breaking down because of data quality issues, <a title="ocdqblog.com/home/solvency-ii-and-data-quality.html" href="http://www.ocdqblog.com/home/solvency-ii-and-data-quality.html">regulatory compliance risks</a>, and lost business opportunities.  <a title="dataqualitybook.com/?p=300" href="http://dataqualitybook.com/?p=300" target="_blank">David Loshin blogged</a> about the challenge of estimating the cost of poor data quality, noting that many estimates, upon close examination, seem to rely exclusively on <a title="dataroundtable.com/?p=8384" href="http://www.dataroundtable.com/?p=8384" target="_blank">anecdotal evidence</a>.</p>
<p>A recent <em>Mental Floss</em> article recounted <a title="mentalfloss.com/article/49935/10-very-costly-typos" href="http://mentalfloss.com/article/49935/10-very-costly-typos" target="_blank"><em>10 Very Costly Typos</em></a>, including the 1962 $80 million dollar missing hyphen in the programming code that led to the destruction of the <a title="wikipedia.org/wiki/Mariner_1" href="http://en.wikipedia.org/wiki/Mariner_1" target="_blank">Mariner 1 spacecraft</a>, the 2007 Roswell, New Mexico car dealership promotion where instead of 1 out of 50,000 scratch lottery tickets revealing a $1,000 cash grand prize, <em>all of the tickets</em> were printed as grand-prize winners, which would have been a $50 million payout, but $250,000 in Walmart gift certificates were given out instead, and, more recently, the March 2013 typographical error in the price of pay-per-ride cards on 160,000 maps and posters that cost New York City’s Transportation Authority approximately $500,000.</p>
<p>Although we often only think about the costs of poor data quality, the article also shared some 2010 research performed by Harvard University claiming that Google profits an estimated $497 million dollars a year from people mistyping the names of popular websites and landing on <a title="wikipedia.org/wiki/Typosquatting" href="http://en.wikipedia.org/wiki/Typosquatting" target="_blank">typosquatter sites</a>, which just happen to be conveniently littered with Google ads.</p>
<p>Poor data quality has also long played an important role in improving Google Search, where misspellings of search terms entered by users (and not just <a title="ocdqblog.com/home/data-quality-and-the-cupertino-effect.html" href="http://www.ocdqblog.com/home/data-quality-and-the-cupertino-effect.html">a spellchecker program</a>) is leveraged by the algorithm providing the <em>Did you mean</em>, <em>Including results for</em>, and <em>Search instead for</em> help text displayed at the top of the first page of Google Search results.</p>
<p>What examples (or calculation methods) can you provide about either the costs or profits associated with poor data quality?</p>
<p> </p>
<h2>Related Posts</h2>
<table border="0" cellspacing="3" cellpadding="3" width="873">
<tbody>
<tr>
<td width="435" valign="top">
<p><a title="ocdqblog.com/home/promoting-poor-data-quality.html" href="http://www.ocdqblog.com/home/promoting-poor-data-quality.html">Promoting Poor Data Quality</a></p>
<p><a title="ocdqblog.com/home/data-quality-and-the-cupertino-effect.html" href="http://www.ocdqblog.com/home/data-quality-and-the-cupertino-effect.html">Data Quality and the Cupertino Effect</a></p>
<p><a title="ocdqblog.com/home/the-data-quality-wager.html" href="http://www.ocdqblog.com/home/the-data-quality-wager.html">The Data Quality Wager</a></p>
<p><a title="ocdqblog.com/home/data-quality-and-the-ok-plateau.html" href="http://www.ocdqblog.com/home/data-quality-and-the-ok-plateau.html">Data Quality and the OK Plateau</a></p>
<p><a title="ocdqblog.com/home/when-poor-data-quality-kills.html" href="http://www.ocdqblog.com/home/when-poor-data-quality-kills.html">When Poor Data Quality Kills</a></p>
<p><a title="ocdqblog.com/home/how-data-cleansing-saves-lives.html" href="http://www.ocdqblog.com/home/how-data-cleansing-saves-lives.html">How Data Cleansing Saves Lives</a></p>
<p><a title="ocdqblog.com/home/the-dichotomy-paradox-data-quality-and-zero-defects.html" href="http://www.ocdqblog.com/home/the-dichotomy-paradox-data-quality-and-zero-defects.html">The Dichotomy Paradox, Data Quality and Zero Defects</a></p>
<p><a title="ocdqblog.com/home/data-quality-and-miracle-exceptions.html" href="http://www.ocdqblog.com/home/data-quality-and-miracle-exceptions.html">Data Quality and Miracle Exceptions</a></p>
<p><a title="ocdqblog.com/home/data-quality-quo-vadimus.html" href="http://www.ocdqblog.com/home/data-quality-quo-vadimus.html">Data Quality: Quo Vadimus?</a></p>
<p><a title="ocdqblog.com/home/data-and-its-relationships-with-quality.html" href="http://www.ocdqblog.com/home/data-and-its-relationships-with-quality.html">Data and its Relationships with Quality</a></p>
</td>
<td width="435" valign="top">
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=11810" href="http://www.dataroundtable.com/?p=11810" target="_blank">The Seventh Law of Data Quality</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=1711" href="http://www.dataroundtable.com/?p=1711" target="_blank">A Tale of Two Q’s</a></p>
<p><a class="offsite-link-inline" title="Paleolithic Rhythm and Data Quality" href="http://www.dataroundtable.com/?p=7948" target="_blank">Paleolithic Rhythm and Data Quality</a></p>
<p><a class="offsite-link-inline" title="Groundhog Data Quality Day by Jim Harris on the Data Roundtable" href="http://www.dataroundtable.com/?p=6031" target="_blank">Groundhog Data Quality Day</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=1560" href="http://www.dataroundtable.com/?p=1560" target="_blank">Data Quality and The Middle Way</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=12780" href="http://www.dataroundtable.com/?p=12780" target="_blank">Stop Poor Data Quality STOP</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=12366" href="http://www.dataroundtable.com/?p=12366" target="_blank">When Poor Data Quality Calls</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=8537" href="http://www.dataroundtable.com/?p=8537" target="_blank">Freudian Data Quality</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=3348" href="http://www.dataroundtable.com/?p=3348" target="_blank">Predictably Poor Data Quality</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=8998" href="http://www.dataroundtable.com/?p=8998" target="_blank">Satisficing Data Quality</a></p>
</td>
</tr>
</tbody>
</table>

<p>
<a href="http://twitter.com/share" class="twitter-share-button" data-url="http://www.ocdqblog.com/home/the-costs-and-profits-of-poor-data-quality.html" data-text="The Costs and Profits of Poor Data Quality #DataQuality" data-count="vertical" data-via="ocdqblog">Tweet</a><script type="text/javascript" src="http://platform.twitter.com/widgets.js"></script>
<script type="text/javascript" src="http://platform.linkedin.com/in.js"></script><script type="in/share" data-url="http://www.ocdqblog.com/home/the-costs-and-profits-of-poor-data-quality.html" data-counter="top"></script>
</p>]]></content></entry><entry><title>When Poor Data Quality Kills</title><category term="Books"/><category term="Data Matching"/><category term="Data Quality"/><category term="Debates"/><id>http://www.ocdqblog.com/home/when-poor-data-quality-kills.html</id><link rel="alternate" type="text/html" href="http://www.ocdqblog.com/home/when-poor-data-quality-kills.html"/><author><name>Jim Harris</name></author><published>2013-04-09T20:00:00Z</published><updated>2013-04-09T20:00:00Z</updated><content type="html" xml:lang="en-US"><![CDATA[<p>In my <a title="ocdqblog.com/home/data-quality-and-the-ok-plateau.html" href="http://www.ocdqblog.com/home/data-quality-and-the-ok-plateau.html">previous post</a>, I made the argument that many times it’s okay to call data quality as good as it needs to get, as opposed to <a title="ocdqblog.com/home/to-our-data-perfectionists.html" href="http://www.ocdqblog.com/home/to-our-data-perfectionists.html">demanding data perfection</a>.  However, a balanced perspective demands acknowledging there are times when nothing less than perfect data quality is necessary.  In fact, there are times when poor data quality can have deadly consequences.</p>
<p>In his book <a title="amazon.com/Information-History-Theory-Flood/dp/0375423729" href="http://www.amazon.com/Information-History-Theory-Flood/dp/0375423729" target="_blank"><em>The Information: A History, a Theory, a Flood</em></a>, James Gleick explained “pharmaceutical names are a special case: a subindustry has emerged to coin them, research them, and vet them.  In the United States, the Food and Drug Administration reviews proposed drug names for possible collisions, and this process is complex and uncertain.  <strong>Mistakes cause death</strong>.”</p>
<p>“Methadone, for opiate dependence, has been administrated in place of Metadate, for attention-deficit disorder, and Taxcol, a cancer drug, for Taxotere, a different cancer drug, with fatal results.  Doctors fear both look-alike errors and sound-alike errors: Zantac/Xanax; Verelan/Virilon.  Linguists devise scientific measures of the <em>distance</em> between names.  But Lamictal and Lamisil and Ludiomil and Lomotil are all approved drug names.”</p>
<p>All <a title="ocdqblog.com/home/the-art-of-data-matching.html" href="http://www.ocdqblog.com/home/the-art-of-data-matching.html">data matching techniques</a>, such as edit distance functions, phonetic comparisons, and more complex algorithms, provide a way to represent (e.g., numeric probabilities, weighted percentages, odds ratios, etc.) the likelihood that two non-exact matching data items are the same.  No matter what data quality software vendors tell you, all data matching techniques are susceptible to <strong>false negatives</strong> (data that <em>did not match</em>, but <em>should have</em>) and <strong>false positives</strong> (data that <em>matched</em>, but <em>should not have</em>).</p>
<p>This pharmaceutical example is one case where a false positive could be deadly, a time when poor data quality kills.  Admittedly, this is an extreme example.  What other examples can you offer where perfect data quality is actually a necessity?</p>
<p> </p>
<h2>Related Posts</h2>
<table border="0" cellspacing="3" cellpadding="3" width="873">
<tbody>
<tr>
<td width="435" valign="top">
<p><a title="ocdqblog.com/home/data-quality-and-the-ok-plateau.html" href="http://www.ocdqblog.com/home/data-quality-and-the-ok-plateau.html">Data Quality and the OK Plateau</a></p>
<p><a title="ocdqblog.com/home/how-data-cleansing-saves-lives.html" href="http://www.ocdqblog.com/home/how-data-cleansing-saves-lives.html">How Data Cleansing Saves Lives</a></p>
<p><a title="ocdqblog.com/home/what-going-to-the-dentist-taught-me-about-data-quality.html" href="http://www.ocdqblog.com/home/what-going-to-the-dentist-taught-me-about-data-quality.html">What going to the dentist taught me about data quality</a></p>
<p><a title="ocdqblog.com/home/the-dichotomy-paradox-data-quality-and-zero-defects.html" href="http://www.ocdqblog.com/home/the-dichotomy-paradox-data-quality-and-zero-defects.html">The Dichotomy Paradox, Data Quality and Zero Defects</a></p>
<p><a title="ocdqblog.com/home/the-asymptote-of-data-quality.html" href="http://www.ocdqblog.com/home/the-asymptote-of-data-quality.html">The Asymptote of Data Quality</a></p>
<p><a title="ocdqblog.com/home/to-our-data-perfectionists.html" href="http://www.ocdqblog.com/home/to-our-data-perfectionists.html">To Our Data Perfectionists</a></p>
<p><a title="ocdqblog.com/home/data-quality-and-miracle-exceptions.html" href="http://www.ocdqblog.com/home/data-quality-and-miracle-exceptions.html">Data Quality and Miracle Exceptions</a></p>
<p><a title="ocdqblog.com/home/data-quality-quo-vadimus.html" href="http://www.ocdqblog.com/home/data-quality-quo-vadimus.html">Data Quality: Quo Vadimus?</a></p>
<p><a title="ocdqblog.com/home/data-and-its-relationships-with-quality.html" href="http://www.ocdqblog.com/home/data-and-its-relationships-with-quality.html">Data and its Relationships with Quality</a></p>
<p><a title="ocdqblog.com/home/dq-tip-there-is-no-such-thing-as-data-accuracy.html" href="http://www.ocdqblog.com/home/dq-tip-there-is-no-such-thing-as-data-accuracy.html">DQ-Tip: “There is no such thing as data accuracy...”</a></p>
</td>
<td width="435" valign="top">
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=11810" href="http://www.dataroundtable.com/?p=11810" target="_blank">The Seventh Law of Data Quality</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=1711" href="http://www.dataroundtable.com/?p=1711" target="_blank">A Tale of Two Q’s</a></p>
<p><a class="offsite-link-inline" title="Paleolithic Rhythm and Data Quality" href="http://www.dataroundtable.com/?p=7948" target="_blank">Paleolithic Rhythm and Data Quality</a></p>
<p><a class="offsite-link-inline" title="Groundhog Data Quality Day by Jim Harris on the Data Roundtable" href="http://www.dataroundtable.com/?p=6031" target="_blank">Groundhog Data Quality Day</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=1560" href="http://www.dataroundtable.com/?p=1560" target="_blank">Data Quality and The Middle Way</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=12780" href="http://www.dataroundtable.com/?p=12780" target="_blank">Stop Poor Data Quality STOP</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=12366" href="http://www.dataroundtable.com/?p=12366" target="_blank">When Poor Data Quality Calls</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=8537" href="http://www.dataroundtable.com/?p=8537" target="_blank">Freudian Data Quality</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=3348" href="http://www.dataroundtable.com/?p=3348" target="_blank">Predictably Poor Data Quality</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=8998" href="http://www.dataroundtable.com/?p=8998" target="_blank">Satisficing Data Quality</a></p>
</td>
</tr>
</tbody>
</table>

<p>
<a href="http://twitter.com/share" class="twitter-share-button" data-url="http://www.ocdqblog.com/home/when-poor-data-quality-kills.html" data-text="When Poor Data Quality Kills #DataQuality" data-count="vertical" data-via="ocdqblog">Tweet</a><script type="text/javascript" src="http://platform.twitter.com/widgets.js"></script>
<script type="text/javascript" src="http://platform.linkedin.com/in.js"></script><script type="in/share" data-url="http://www.ocdqblog.com/home/when-poor-data-quality-kills.html" data-counter="top"></script>
</p>]]></content></entry><entry><title>Data Quality and the OK Plateau</title><category term="Books"/><category term="Data Quality"/><category term="Debates"/><category term="Philosophy"/><id>http://www.ocdqblog.com/home/data-quality-and-the-ok-plateau.html</id><link rel="alternate" type="text/html" href="http://www.ocdqblog.com/home/data-quality-and-the-ok-plateau.html"/><author><name>Jim Harris</name></author><published>2013-04-02T20:00:00Z</published><updated>2013-04-02T20:00:00Z</updated><content type="html" xml:lang="en-US"><![CDATA[<p>In his book <a title="amazon.com/Moonwalking-Einstein-Science-Remembering-Everything/dp/0143120530" href="http://www.amazon.com/Moonwalking-Einstein-Science-Remembering-Everything/dp/0143120530" target="_blank"><em>Moonwalking with Einstein: The Art and Science of Remembering</em></a>, Joshua Foer explained that “when people first learn to use a keyboard, they improve very quickly from sloppy single-finger pecking to careful two-handed typing, until eventually the fingers move so effortlessly across the keys that the whole process becomes unconscious and the fingers seem to take on a mind of their own.”</p>
<p>“At this point,” Foer continued, “most people’s typing skills stop progressing.  They reach a plateau.  If you think about it, it’s a strange phenomenon.  After all, we’ve always been told that practice makes perfect, and many people sit behind a keyboard for at least several hours a day in essence practicing their typing.  Why don’t they just keep getting better and better?”</p>
<p>Foer then recounted research performed in the 1960s by the psychologists Paul Fitts and Michael Posner, which described the three stages that everyone goes through when acquiring a new skill:</p>
<ol>
<li><strong>Cognitive</strong> — During this stage, you intellectualize the task and discover new strategies to accomplish it more proficiently.</li>
<li><strong>Associative</strong> — During this stage, you concentrate less, make fewer major errors, and generally become more efficient.</li>
<li><strong>Autonomous</strong> — During this stage, you have gotten as good as you need to get, and are basically running on autopilot.</li>
</ol>
<p>“During that autonomous stage,” Foer explained, “you lose conscious control over what you are doing.  Most of the time that’s a good thing.  Your mind has one less thing to worry about.  In fact, the autonomous stage seems to be one of those handy features that evolution worked out for our benefit.  The less you have to focus on the repetitive tasks of everyday life, the more you can concentrate on the stuff that really matters, the stuff you haven’t seen before.  And so, once we’re just good enough at typing, we move it to the back of our mind’s filing cabinet and stop paying it any attention.”</p>
<p>“You can see this shift take place in fMRI scans of people learning new skills.  As a task becomes automated, parts of the brain involved in conscious reasoning become less active and other parts of the brain take over.  You could call it the <strong>OK plateau</strong>, the point at which you decide you’re OK with how good you are at something, turn on autopilot, and stop improving.”</p>
<p>“We all reach OK plateaus in most things we do,” Foer concluded.  “We learn how to drive when we’re in our teens and once we’re good enough to avoid tickets and major accidents, we get only incrementally better.  My father has been playing golf for forty years, and he’s still a duffer.  In four decades his handicap hasn’t fallen even a point.  Why?  He reached an OK plateau.”</p>
<p>I believe that data quality improvement initiatives also eventually reach an OK Plateau, <a title="ocdqblog.com/home/the-asymptote-of-data-quality.html" href="http://www.ocdqblog.com/home/the-asymptote-of-data-quality.html">a point just short of data perfection</a>, where the diminishing returns of <a title="ocdqblog.com/home/the-dichotomy-paradox-data-quality-and-zero-defects.html" href="http://www.ocdqblog.com/home/the-dichotomy-paradox-data-quality-and-zero-defects.html">chasing after zero defects</a> gives way to calling data quality as good as it needs to get.</p>
<p>As long as the autopilot is on, accepting <a title="ocdqblog.com/home/data-quality-quo-vadimus.html" href="http://www.ocdqblog.com/home/data-quality-quo-vadimus.html">data quality is a journey not a destination</a>, preventing data quality from getting worse, and making sure best practices don’t stop being practiced, then I’m OK with data quality and the OK plateau.  Are you OK?</p>
<p> </p>
<h2>Related Posts</h2>
<table border="0" cellspacing="3" cellpadding="3" width="873">
<tbody>
<tr>
<td width="435" valign="top">
<p><a title="ocdqblog.com/home/the-dichotomy-paradox-data-quality-and-zero-defects.html" href="http://www.ocdqblog.com/home/the-dichotomy-paradox-data-quality-and-zero-defects.html">The Dichotomy Paradox, Data Quality and Zero Defects</a></p>
<p><a title="ocdqblog.com/home/the-asymptote-of-data-quality.html" href="http://www.ocdqblog.com/home/the-asymptote-of-data-quality.html">The Asymptote of Data Quality</a></p>
<p><a title="ocdqblog.com/home/to-our-data-perfectionists.html" href="http://www.ocdqblog.com/home/to-our-data-perfectionists.html">To Our Data Perfectionists</a></p>
<p><a title="ocdqblog.com/home/data-quality-and-miracle-exceptions.html" href="http://www.ocdqblog.com/home/data-quality-and-miracle-exceptions.html">Data Quality and Miracle Exceptions</a></p>
<p><a title="ocdqblog.com/home/data-quality-quo-vadimus.html" href="http://www.ocdqblog.com/home/data-quality-quo-vadimus.html">Data Quality: Quo Vadimus?</a></p>
</td>
<td width="435" valign="top">
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=11810" href="http://www.dataroundtable.com/?p=11810" target="_blank">The Seventh Law of Data Quality</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=1560" href="http://www.dataroundtable.com/?p=1560" target="_blank">Data Quality and The Middle Way</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=8537" href="http://www.dataroundtable.com/?p=8537" target="_blank">Freudian Data Quality</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=3348" href="http://www.dataroundtable.com/?p=3348" target="_blank">Predictably Poor Data Quality</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=8998" href="http://www.dataroundtable.com/?p=8998" target="_blank">Satisficing Data Quality</a></p>
</td>
</tr>
</tbody>
</table>

<p>
<a href="http://twitter.com/share" class="twitter-share-button" data-url="http://www.ocdqblog.com/home/data-quality-and-the-ok-plateau.html" data-text="Data Quality and the OK Plateau #DataQuality" data-count="vertical" data-via="ocdqblog">Tweet</a><script type="text/javascript" src="http://platform.twitter.com/widgets.js"></script>
<script type="text/javascript" src="http://platform.linkedin.com/in.js"></script><script type="in/share" data-url="http://www.ocdqblog.com/home/data-quality-and-the-ok-plateau.html" data-counter="top"></script>
</p>]]></content></entry><entry><title>The Big Datastillery</title><category term="Aberdeen Group"/><category term="Big Data"/><category term="IBM"/><category term="IBM for Midsize Business"/><category term="Marketing"/><category term="Sponsored Blog Posts"/><category term="Vendors"/><category term="Videos"/><id>http://www.ocdqblog.com/home/the-big-datastillery.html</id><link rel="alternate" type="text/html" href="http://www.ocdqblog.com/home/the-big-datastillery.html"/><author><name>Jim Harris</name></author><published>2013-03-28T20:00:00Z</published><updated>2013-03-28T20:00:00Z</updated><content type="html" xml:lang="en-US"><![CDATA[<iframe src="http://player.vimeo.com/video/62832190" width="853" height="480" frameborder="0" webkitAllowFullScreen mozallowfullscreen allowFullScreen></iframe>
<p><em>If you’re having trouble viewing this video, you can watch it on Vimeo by clicking on this link:</em> <a title="vimeo.com/62832190" href="http://vimeo.com/62832190" target="_blank">The Big Datastillery on Vimeo</a></p>
<p>To view or download the infographic featured in the video, click on this direct link to its PDF: <a title="ibmbigdatahub.com/sites/default/files/infographic_file/IBM%20Big%20Datastillery.pdf" href="http://www.ibmbigdatahub.com/sites/default/files/infographic_file/IBM%20Big%20Datastillery.pdf" target="_blank">The Big Datastillery.pdf</a></p>
<p> </p>
<p><img style="float: left;" src="http://www.ocdqblog.com/storage/website-images/IBM%20Logo.jpg" border="0" alt="" width="188" height="76" /></p>
<p style="text-align: right;"><em>This video was sponsored by the <a title="IBM Midsize Business Solutions" href="http://goo.gl/t3fgW" target="_blank">IBM for Midsize Business</a> program, which provides midsize businesses with the tools, expertise and solutions they need to become engines of a smarter planet. I’ve been compensated to contribute to this program, but the opinions expressed in this video are my own and don’t necessarily represent IBM’s positions, strategies, or opinions.</em></p>
<p> </p>
<h2>Related Posts</h2>
<table border="0" cellspacing="3" cellpadding="3" width="873">
<tbody>
<tr>
<td width="435" valign="top">
<p><a title="ocdqblog.com/home/smart-big-data-adoption-for-midsize-businesses.html" href="http://www.ocdqblog.com/home/smart-big-data-adoption-for-midsize-businesses.html">Smart Big Data Adoption for Midsize Businesses</a></p>
<p><a title="ocdqblog.com/home/big-data-is-not-just-for-big-businesses.html" href="http://www.ocdqblog.com/home/big-data-is-not-just-for-big-businesses.html">Big Data is not just for Big Businesses</a></p>
<p><a title="ocdqblog.com/home/social-business-is-more-than-social-marketing.html" href="http://www.ocdqblog.com/home/social-business-is-more-than-social-marketing.html">Social Business is more than Social Marketing</a></p>
<p><a title="ocdqblog.com/home/social-media-marketing-from-monologues-to-dialogues.html" href="http://www.ocdqblog.com/home/social-media-marketing-from-monologues-to-dialogues.html">Social Media Marketing: From Monologues to Dialogues</a></p>
<p><a title="ocdqblog.com/home/social-media-for-midsize-businesses.html" href="http://www.ocdqblog.com/home/social-media-for-midsize-businesses.html">Social Media for Midsize Businesses</a></p>
<p><a title="ocdqblog.com/home/cloud-computing-is-the-new-nimbyism.html" href="http://www.ocdqblog.com/home/cloud-computing-is-the-new-nimbyism.html">Cloud Computing is the New Nimbyism</a></p>
<p><a title="ocdqblog.com/home/leveraging-the-cloud-for-application-development.html" href="http://www.ocdqblog.com/home/leveraging-the-cloud-for-application-development.html">Leveraging the Cloud for Application Development</a></p>
<p><a title="ocdqblog.com/home/barriers-to-cloud-adoption.html" href="http://www.ocdqblog.com/home/barriers-to-cloud-adoption.html">Barriers to Cloud Adoption</a></p>
</td>
<td width="435" valign="top">
<p><a title="ocdqblog.com/home/will-big-data-be-blinded-by-data-science.html" href="http://www.ocdqblog.com/home/will-big-data-be-blinded-by-data-science.html">Will Big Data be Blinded by Data Science?</a></p>
<p><a title="ocdqblog.com/home/big-data-lessons-from-orbitz.html" href="http://www.ocdqblog.com/home/big-data-lessons-from-orbitz.html">Big Data Lessons from Orbitz</a></p>
<p><a title="ocdqblog.com/home/the-graystone-effects-of-big-data.html" href="http://www.ocdqblog.com/home/the-graystone-effects-of-big-data.html">The Graystone Effects of Big Data</a></p>
<p><a title="ocdqblog.com/home/talking-business-about-the-weather.html" href="http://www.ocdqblog.com/home/talking-business-about-the-weather.html">Talking Business about the Weather</a></p>
<p><a title="ocdqblog.com/home/word-of-mouth-has-become-word-of-data.html" href="http://www.ocdqblog.com/home/word-of-mouth-has-become-word-of-data.html">Word of Mouth has become Word of Data</a></p>
<p><a title="ocdqblog.com/home/information-asymmetry-versus-empowered-customers.html" href="http://www.ocdqblog.com/home/information-asymmetry-versus-empowered-customers.html">Information Asymmetry versus Empowered Customers</a></p>
<p><a title="ocdqblog.com/home/the-age-of-the-mobile-device.html" href="http://www.ocdqblog.com/home/the-age-of-the-mobile-device.html">The Age of the Mobile Device</a></p>
<p><a title="ocdqblog.com/home/devising-a-mobile-device-strategy.html" href="http://www.ocdqblog.com/home/devising-a-mobile-device-strategy.html">Devising a Mobile Device Strategy</a></p>
</td>
</tr>
</tbody>
</table>

<p>
<a href="http://twitter.com/share" class="twitter-share-button" data-url="http://www.ocdqblog.com/home/the-big-datastillery.html" data-text="The Big Datastillery #BigData #Marketing #IBMSMB" data-count="vertical" data-via="ocdqblog">Tweet</a><script type="text/javascript" src="http://platform.twitter.com/widgets.js"></script>
<script type="text/javascript" src="http://platform.linkedin.com/in.js"></script><script type="in/share" data-url="http://www.ocdqblog.com/home/the-big-datastillery.html" data-counter="top"></script>
</p>

<!-- Start of StatCounter Code for Default Guide -->
<script type="text/javascript">
var sc_project=7819984;
var sc_invisible=1;
var sc_security="b93f7b04";
</script>
<script type="text/javascript"
src="http://www.statcounter.com/counter/counter.js"></script>
<noscript><div class="statcounter"><a title="tumblr visitor"
href="http://statcounter.com/tumblr/" target="_blank"><img
class="statcounter"
src="http://c.statcounter.com/7819984/0/b93f7b04/1/"
alt="tumblr visitor"></a></div></noscript>
<!-- End of StatCounter Code for Default Guide -->]]></content></entry><entry><title>Expectation and Data Quality</title><category term="Best of 2013"/><category term="Books"/><category term="Data Quality"/><category term="Data Warehousing"/><category term="Philosophy"/><id>http://www.ocdqblog.com/home/expectation-and-data-quality.html</id><link rel="alternate" type="text/html" href="http://www.ocdqblog.com/home/expectation-and-data-quality.html"/><author><name>Jim Harris</name></author><published>2013-03-21T18:23:00Z</published><updated>2013-03-21T18:23:00Z</updated><content type="html" xml:lang="en-US"><![CDATA[<p>One of my favorite recently read books is <a title="amazon.com/You-Are-Not-So-Smart/dp/1592406599" href="http://www.amazon.com/You-Are-Not-So-Smart/dp/1592406599" target="_blank"><em>You Are Not So Smart</em></a> by <a title="twitter.com/davidmcraney" href="http://twitter.com/davidmcraney" target="_blank">David McRaney</a>.  Earlier this week, the book’s chapter about <strong>expectation</strong> was  excerpted as an online article on <a title="lifehacker.com/5990737/why-we-cant-tell-good-wine-from-bad" href="http://lifehacker.com/5990737/why-we-cant-tell-good-wine-from-bad" target="_blank"><em>Why We Can’t Tell Good Wine From Bad</em></a>, which also provided additional examples about how we can be fooled by altering our expectations.</p>
<p>“In one Dutch study,” McRaney explained, “participants were put in a room with posters proclaiming the awesomeness of high-definition, and were told they would be watching a new high-definition program.  Afterward, the subjects said they found the sharper, more colorful television to be a superior experience to standard programming.”</p>
<p>No surprise there, right?  After all, a high-definition television is expected to produce a high-quality image.</p>
<p>“What they didn’t know,” McRaney continued, “was they were actually watching a standard-definition image.  The expectation of seeing a better quality image led them to believe they had.  Recent research shows about 18 percent of people who own high-definition televisions are still watching standard-definition programming on the set, but think they are getting a better picture.”</p>
<p>I couldn’t help but wonder if establishing an expectation of delivering high-quality data could lead business users to believe that, for example, <a title="blogs.informatica.com/perspectives/2013/03/04/turn-the-data-warehouse-into-a-glass-house-data-quality/" href="http://blogs.informatica.com/perspectives/2013/03/04/turn-the-data-warehouse-into-a-glass-house-data-quality/" target="_blank">the data quality of the data warehouse</a> met or exceeded their expectations.  Could business users actually be fooled by altering their expectations about data quality?  Wouldn’t their experience of using the data eventually reveal the truth?</p>
<p>Retailers expertly manipulate us with presentation, price, good marketing, and great service in order to create an expectation of quality in the things we buy.  “The actual experience is less important,” McRaney explained.  “As long as it isn’t total crap, your experience will match up with your expectations.  The build up to an experience can completely change how you interpret the information reaching your brain from your otherwise objective senses.  In psychology, true objectivity is pretty much considered to be impossible.  Memories, emotions, conditioning, and all sorts of other mental flotsam taint every new experience you gain.  In addition to all this, your expectations powerfully influence the final vote in your head over <a title="ocdqblog.com/home/platos-data.html" href="http://www.ocdqblog.com/home/platos-data.html">what you believe to be reality</a>.”</p>
<p>“Your expectations are the horse,” McRaney concluded, “and your experience is the cart.”  You might think it should be the other way around, but when your expectations determine your direction, you shouldn’t be surprised by the journey you experience.</p>
<p>If you find it difficult to imagine a positive expectation causing people to overlook poor quality in their experience with data, how about the opposite?  I have seen the first impression of a data warehouse initially affected by poor data quality create a negative expectation causing people to overlook the improved data quality in their subsequent experiences with the data warehouse.  Once people <strong>expect to experience</strong> poor data quality when using it, <a title="Download my Informatica Whitepaper: Build a Data Warehouse the People Actually Use – and Trust (Registration Required)" href="http://vip.informatica.com/?elqPURLPage=10880" target="_blank">people stop trusting, and stop using, the data warehouse</a>.</p>
<p>Data warehousing is only one example of how expectation can affect the data quality experience.  How are your organization’s expectations affecting its experiences with data quality?</p>
<p> </p>
<h2>Related Posts</h2>
<table border="0" cellspacing="3" cellpadding="3" width="873">
<tbody>
<tr>
<td width="435" valign="top">
<p><a title="ocdqblog.com/home/the-data-outhouse.html" href="http://www.ocdqblog.com/home/the-data-outhouse.html">The Data Outhouse</a></p>
<p><a title="ocdqblog.com/home/data-quality-and-antons-syndrome.html" href="http://www.ocdqblog.com/home/data-quality-and-antons-syndrome.html">Data Quality and Anton’s Syndrome</a></p>
<p><a title="ocdqblog.com/home/data-quality-and-chicken-little-syndrome.html" href="http://www.ocdqblog.com/home/data-quality-and-chicken-little-syndrome.html">Data Quality and Chicken Little Syndrome</a></p>
<p><a title="ocdqblog.com/home/data-quality-and-miracle-exceptions.html" href="http://www.ocdqblog.com/home/data-quality-and-miracle-exceptions.html">Data Quality and Miracle Exceptions</a></p>
<p><a title="ocdqblog.com/home/availability-bias-and-data-quality-improvement.html" href="http://www.ocdqblog.com/home/availability-bias-and-data-quality-improvement.html">Availability Bias and Data Quality Improvement</a></p>
<p><a title="ocdqblog.com/home/dq-view-the-five-stages-of-data-quality.html" href="http://www.ocdqblog.com/home/dq-view-the-five-stages-of-data-quality.html">DQ-View: The Five Stages of Data Quality</a></p>
<p><a title="ocdqblog.com/home/data-quality-and-the-bystander-effect.html" href="http://www.ocdqblog.com/home/data-quality-and-the-bystander-effect.html">Data Quality and the Bystander Effect</a></p>
<p><a title="ocdqblog.com/home/data-quality-and-the-q-test.html" href="http://www.ocdqblog.com/home/data-quality-and-the-q-test.html">Data Quality and the Q Test</a></p>
<p><a title="ocdqblog.com/home/data-myopia-and-business-relativity.html" href="http://www.ocdqblog.com/home/data-myopia-and-business-relativity.html">Data Myopia and Business Relativity</a></p>
<p><a title="ocdqblog.com/home/platos-data.html" href="http://www.ocdqblog.com/home/platos-data.html">Plato’s Data</a></p>
</td>
<td width="435" valign="top">
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=10429" href="http://www.dataroundtable.com/?p=10429" target="_blank">The Illusion-of-Quality Effect</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=10578" href="http://www.dataroundtable.com/?p=10578" target="_blank">Perception Filters and Data Quality</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=9910" href="http://www.dataroundtable.com/?p=9910" target="_blank">WYSIWYG and WYSIATI</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=12559" href="http://www.dataroundtable.com/?p=12559" target="_blank">Do the Eyes Have It?</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=3348" href="http://www.dataroundtable.com/?p=3348" target="_blank">Predictably Poor Data Quality</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=8537" href="http://www.dataroundtable.com/?p=8537" target="_blank">Freudian Data Quality</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/??p=8936" href="http://www.dataroundtable.com/?p=8936" target="_blank">Data Psychedelicatessen</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=8597" href="http://www.dataroundtable.com/?p=8597" target="_blank">Data Geeks and Business Blindness</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=11319" href="http://www.dataroundtable.com/?p=11319" target="_blank">The Data Sharpshooter Fallacy</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=11231" href="http://www.dataroundtable.com/?p=11231" target="_blank">Data Quality and the Barber’s Paradox</a></p>
</td>
</tr>
</tbody>
</table>

<p>
<a href="http://twitter.com/share" class="twitter-share-button" data-url="http://www.ocdqblog.com/home/expectation-and-data-quality.html" data-text="Expectation and Data Quality #DataQuality #DataWarehousing" data-count="vertical" data-via="ocdqblog">Tweet</a><script type="text/javascript" src="http://platform.twitter.com/widgets.js"></script>
<script type="text/javascript" src="http://platform.linkedin.com/in.js"></script><script type="in/share" data-url="http://www.ocdqblog.com/home/expectation-and-data-quality.html" data-counter="top"></script>
</p>]]></content></entry><entry><title>On Philosophy, Science, and Data</title><category term="Best of 2013"/><category term="Big Data"/><category term="Books"/><category term="Data Quality"/><category term="Data Science"/><category term="Philosophy"/><id>http://www.ocdqblog.com/home/on-philosophy-science-and-data.html</id><link rel="alternate" type="text/html" href="http://www.ocdqblog.com/home/on-philosophy-science-and-data.html"/><author><name>Jim Harris</name></author><published>2013-03-14T23:28:00Z</published><updated>2013-03-14T23:28:00Z</updated><content type="html" xml:lang="en-US"><![CDATA[<p>Ever since <a title="melindathielbar.wordpress.com" href="http://melindathielbar.wordpress.com/" target="_blank">Melinda Thielbar</a> helped me <a title="ocdqblog.com/home/demystifying-data-science.html" href="http://www.ocdqblog.com/home/demystifying-data-science.html">demystify data science on OCDQ Radio</a>, I have been pondering my paraphrasing of an old idea: Science without philosophy is blind; Philosophy without science is empty; Data needs both science and philosophy.</p>
<p>“A philosopher’s job is to find out things about the world by thinking rather than observing,” the philosopher <a title="wikipedia.org/wiki/Bertrand_Russell" href="http://en.wikipedia.org/wiki/Bertrand_Russell" target="_blank">Bertrand Russell</a> once said.  One could say a scientist’s job is to find out things about the world by observing and experimenting.  In fact, Russell observed that “the most essential characteristic of scientific technique is that it proceeds from experiment, not from tradition.”</p>
<p>Russell also said that “science is what we know, and philosophy is what we don’t know.”  However, Stuart Firestein, in his book <a title="amazon.com/Ignorance-Drives-Science-Stuart-Firestein/dp/0199828075" href="http://www.amazon.com/Ignorance-Drives-Science-Stuart-Firestein/dp/0199828075" target="_blank"><em>Ignorance: How It Drives Science</em></a>, explained “there is no surer way to screw up an experiment than to be certain of its outcome.”</p>
<p>Although it seems it would make more sense for science to be driven by what we know, by facts, “working scientists,” according to Firestein, “don’t get bogged down in the factual swamp because they don’t care that much for facts.  It’s not that they discount or ignore them, but rather that they don’t see them as an end in themselves.  They don’t stop at the facts; they begin there, right beyond the facts, where the facts run out.  Facts are selected for the questions they create, for the ignorance they point to.”</p>
<p>In this sense, philosophy and science work together to help us think about and experiment with what we do and don’t know.</p>
<p>Some might argue that while anyone can be a philosopher, being a scientist requires more rigorous training.  A commonly stated requirement in the era of big data is to hire data scientists, but this begs the question: Is data science only for data scientists?</p>
<p>“Clearly what we need,” Firestein explained, “is a crash course in <em>citizen science</em>—a way to humanize science so that it can be both appreciated and judged by an informed citizenry.  Aggregating facts is useless if you don’t have a context to interpret them.”</p>
<p>I would argue that clearly what organizations need is a crash course in data science—a way to humanize data science so that it can be both appreciated and judged by an informed business community.  Big data is useless if you don’t have a business context to interpret it.  Firestein also made great points about science not being exclusionary (i.e., not just for scientists).  Just as you can enjoy watching sports without being a professional athlete and you can appreciate music without being a professional musician, you can—and should—learn the basics of data science (especially statistics) without being a professional data scientist.</p>
<p>In order to truly deliver business value to organizations, data science can not be exclusionary.  This doesn’t mean you shouldn’t hire data scientists.  In many cases, you will need the expertise of professional data scientists.  However, you will not be able to direct them or interpret their findings without understanding the basics, what could be called the philosophy of data science.</p>
<p>Some might argue that philosophy only reigns in the absence of data, while science reigns in the analysis of data.  Although in the era of big data there seems to be fewer areas truly absent of data, a conceptual bridge still remains between analysis and insight, the crossing of which is itself a philosophical exercise.  So, an endless oscillation persists between science and philosophy, which is why science without philosophy is blind, and philosophy without science is empty.  Data needs both science and philosophy.</p>
<p> </p>
<h2>Related OCDQ Radio Episodes</h2>
<p><em>Clicking on the link will take you to the episode’s blog post:</em></p>
<ul>
<li><a title="ocdqblog.com/home/demystifying-data-science.html" href="http://www.ocdqblog.com/home/demystifying-data-science.html">Demystifying Data Science </a> — Guest <a title="melindathielbar.wordpress.com" href="http://melindathielbar.wordpress.com/" target="_blank">Melinda Thielbar</a>, a Ph.D. Statistician, discusses what a data scientist does and provides a straightforward explanation of key concepts such as signal-to-noise ratio, uncertainty, experimentation, and correlation.</li>
</ul>
<ul>
<li><a title="ocdqblog.com/home/data-quality-and-big-data.html" href="http://www.ocdqblog.com/home/data-quality-and-big-data.html">Data Quality and Big Data </a> — Guest <a title="Data Driven: Profiting from Your Most Important Business Asset by Thomas C. Redman" href="http://www.amazon.com/Data-Driven-Profiting-Important-Business/dp/1422119122" target="_blank">Tom Redman</a> (aka the “Data Doc”) discusses Data Quality and Big Data, including if data quality matters less in larger data sets, and if statistical outliers represent business insights or data quality issues.</li>
</ul>
<ul>
<li><a title="ocdqblog.com/home/decision-management-systems.html" href="http://www.ocdqblog.com/home/decision-management-systems.html">Decision Management Systems</a> — Guest James Taylor discusses data-driven decision making and analytical concepts from his book <a title="Decision Management Systems by James Taylor on Amazon.com" href="http://www.amazon.com/Decision-Management-Systems-Practical-Predictive/dp/0132884380" target="_blank"><em>Decision Management Systems: A Practical Guide to Using Business Rules and Predictive Analytics</em></a>.</li>
</ul>
<ul>
<li><a title="ocdqblog.com/home/good-enough-data-for-fast-enough-decisions.html" href="http://www.ocdqblog.com/home/good-enough-data-for-fast-enough-decisions.html">Good-Enough Data for Fast-Enough Decisions</a> — Guest <a title="http://www.juliehuntconsulting.com/" href="http://www.juliehuntconsulting.com/" target="_blank">Julie Hunt</a> discusses Data Quality and Business Intelligence, including the speed versus quality debate of near-real-time decision making, and the future of predictive analytics.</li>
</ul>
<ul>
<li><a title="ocdqblog.com/home/so-long-2011-and-thanks-for-all-the.html" href="http://www.ocdqblog.com/home/so-long-2011-and-thanks-for-all-the.html">So Long 2011, and Thanks for All the . . .</a> — The OCDQ Radio 2011 Year in Review, featuring <a title="LinkedIn Profile for Jarrett Goldfedder" href="http://www.linkedin.com/in/jarrettgoldfedder" target="_blank">Jarrett Goldfedder</a>, who discusses Big Data, <a title="LinkedIn Profile for Nicola Askham" href="http://www.linkedin.com/in/nicolaaskham" target="_blank">Nicola Askham</a>, who discusses Data Governance, and <a title="LinkedIn Profile for Daragh O Brien" href="http://www.linkedin.com/in/daraghobrien" target="_blank">Daragh O Brien</a>, who discusses Data Privacy.</li>
</ul>
<p> </p>
<h2>Related Posts</h2>
<table border="0" cellspacing="3" cellpadding="3" width="873">
<tbody>
<tr>
<td width="435" valign="top">
<p><a title="ocdqblog.com/home/big-data-and-the-infinite-inbox.html" href="http://www.ocdqblog.com/home/big-data-and-the-infinite-inbox.html">Big Data and the Infinite Inbox</a></p>
<p><a title="ocdqblog.com/home/hoardabytes-and-the-big-data-lebowski.html" href="http://www.ocdqblog.com/home/hoardabytes-and-the-big-data-lebowski.html">HoardaBytes and the Big Data Lebowski</a></p>
<p><a title="ocdqblog.com/home/will-big-data-be-blinded-by-data-science.html" href="http://www.ocdqblog.com/home/will-big-data-be-blinded-by-data-science.html">Will Big Data be Blinded by Data Science?</a></p>
<p><a title="ocdqblog.com/home/data-silence.html" href="http://www.ocdqblog.com/home/data-silence.html">Data Silence</a></p>
<p><a title="ocdqblog.com/home/magic-elephants-data-psychics-and-invisible-gorillas.html" href="http://www.ocdqblog.com/home/magic-elephants-data-psychics-and-invisible-gorillas.html">Magic Elephants, Data Psychics, and Invisible Gorillas</a></p>
<p><a title="ocdqblog.com/home/the-graystone-effects-of-big-data.html" href="http://www.ocdqblog.com/home/the-graystone-effects-of-big-data.html">The Graystone Effects of Big Data</a></p>
<p><a title="ocdqblog.com/home/big-data-el-memorioso.html" href="http://www.ocdqblog.com/home/big-data-el-memorioso.html">Big Data el Memorioso</a></p>
<p><a title="ocdqblog.com/home/information-overload-revisited.html" href="http://www.ocdqblog.com/home/information-overload-revisited.html">Information Overload Revisited</a></p>
<p><a title="ocdqblog.com/home/exercise-better-data-management.html" href="http://www.ocdqblog.com/home/exercise-better-data-management.html">Exercise Better Data Management</a></p>
<p><a title="ocdqblog.com/home/a-tale-of-two-datas.html" href="http://www.ocdqblog.com/home/a-tale-of-two-datas.html">A Tale of Two Datas</a></p>
<p><a title="http://www.ocdqblog.com/home/dot-collectors-and-dot-connectors.html" href="http://www.ocdqblog.com/home/dot-collectors-and-dot-connectors.html">Dot Collectors and Dot Connectors</a></p>
<p><a title="ocdqblog.com/home/the-wisdom-of-crowds-friends-and-experts.html" href="http://www.ocdqblog.com/home/the-wisdom-of-crowds-friends-and-experts.html">The Wisdom of Crowds, Friends, and Experts</a></p>
</td>
<td width="435" valign="top">
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=12194" href="http://www.dataroundtable.com/?p=12194" target="_blank">A Statistically Significant Resolution for 2013</a></p>
<p><a class="offsite-link-inline" title="bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1149/Speed-Up-Your-Data-to-Slow-Down-Your-Decisions.aspx" href="http://bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1149/Speed-Up-Your-Data-to-Slow-Down-Your-Decisions.aspx">Speed Up Your Data to Slow Down Your Decisions</a></p>
<p><a class="offsite-link-inline" title="bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1139/Rage-against-the-Machines-Learning.aspx" href="http://bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1139/Rage-against-the-Machines-Learning.aspx">Rage against the Machines Learning</a></p>
<p><a class="offsite-link-inline" title="bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1123/It-s-Not-about-being-Data-Driven.aspx" href="http://bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1123/It-s-Not-about-being-Data-Driven.aspx" target="_blank">It’s Not about being Data-Driven</a></p>
<p><a class="offsite-link-inline" title="bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1129/Big-Data-Sporks-and-Decision-Frames.aspx" href="http://bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1129/Big-Data-Sporks-and-Decision-Frames.aspx" target="_blank">Big Data, Sporks, and Decision Frames</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=10689" href="http://www.dataroundtable.com/?p=10689" target="_blank">Big Data: Structure and Quality</a></p>
<p><a class="offsite-link-inline" title="bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1088/Darth-Vader-Big-Data-and-Predictive-Analytics.aspx" href="http://bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1088/Darth-Vader-Big-Data-and-Predictive-Analytics.aspx" target="_blank">Darth Vader, Big Data, and Predictive Analytics</a></p>
<p><a class="offsite-link-inline" title="bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1117/Big-Data-Predictive-Analytics-and-the-Ideal-Chronicler.aspx" href="http://bigdata.pervasive.com/Blog/Big-Data-Blog/EntryId/1117/Big-Data-Predictive-Analytics-and-the-Ideal-Chronicler.aspx" target="_blank">Big Data, Predictive Analytics, and the Ideal Chronicler</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=10190" href="http://www.dataroundtable.com/?p=10190" target="_blank">The Big Data Theory</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=10144" href="http://www.dataroundtable.com/?p=10144" target="_blank">Swimming in Big Data</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=10993" href="http://www.dataroundtable.com/?p=10993" target="_blank">What Magic Tricks teach us about Data Science</a></p>
<p><a class="offsite-link-inline" title="dataroundtable.com/?p=10951" href="http://www.dataroundtable.com/?p=10951" target="_blank">What Mozart for Babies teaches us about Data Science</a></p>
</td>
</tr>
</tbody>
</table>

<p>
<a href="http://twitter.com/share" class="twitter-share-button" data-url="http://www.ocdqblog.com/home/on-philosophy-science-and-data.html" data-text="On Philosophy, Science, and Data #BigData #Analytics #FutureOfDS" data-count="vertical" data-via="ocdqblog">Tweet</a><script type="text/javascript" src="http://platform.twitter.com/widgets.js"></script>
<script type="text/javascript" src="http://platform.linkedin.com/in.js"></script><script type="in/share" data-url="http://www.ocdqblog.com/home/on-philosophy-science-and-data.html" data-counter="top"></script>
</p>]]></content></entry></feed>