Is data mining reliable?
What's the best way to guarantee our enterprise data mining is accurate and that the trends/associations it picks up are reliable?

    Requires Free Membership to View

    When you register, you'll receive targeted emails designed to keep you informed of the latest BI, analytics, corporate performance management (CPM) trends and more.

    Hannah Smalltree, Editorial Director

    By submitting your registration information to SearchBusinessAnalytics.com you agree to receive email communications from TechTarget and TechTarget partners. We encourage you to read our Privacy Policy which contains important disclosures about how we collect and use your registration and other information. If you reside outside of the United States, by submitting this registration information you consent to having your personal data transferred to and processed in the United States. Your use of SearchBusinessAnalytics.com is governed by our Terms of Use. You may contact us at webmaster@TechTarget.com.

With data mining, I am not sure what guarantees you would be looking for. There is the exact science part of data mining, which is looking back into historical data and determining, for example, that 20% of customers who bought x also bought y. Backward-looking correlation analysis and the plotting of trends to a regression line are exact sciences and as good as the data they are trained on. When it comes to the more interesting, future-facing part of data mining, if it is applying any data mining smarts whatsoever, it is never any better than an educated guess. As they say, in the future, anything can and will happen. By the very nature of "knowing" what may happen in the future, we actually change it. I've also seen a few end clients determine data mining was useless after a small, flawed "test." Data mining is really a mindset and should be adopted once its merits are determined… and given a chance. It may or may not be deemed successful if the results are not incorporated into a holistic program geared to the desired business result. In other words, data mining does not stand alone on its own merits within an organization.

We do want those guesses our data mining makes to be as educated a guess as possible and that's where the due diligence over the software selected comes in.

This was first published in February 2007

Join the conversationComment

Share
Comments

    Results

    Contribute to the conversation

    All fields are required. Comments will appear at the bottom of the article.