If you were asked to define "big data," what would you say? In the past, most people probably would have focused...
on the famous three Vs: volume, velocity and variety. But the talk about what big data is -- and how to take advantage of it -- has moved beyond that.
Earlier this month, SearchBusinessAnalytics held a #TalkingBigData tweet jam to sift through the hype surrounding big data and to address big data skills and project management issues. Wayne Eckerson, an industry analyst at TechTarget and president of consultancy Eckerson Group Inc., and Boris Evelson, an analyst at Forrester Research Inc., joined Executive Editor Craig Stedman, Site Editor Ed Burns and other TechTarget writers and editors to lead the half-hour discussion.
Our first question -- originally intended as a brief intro to the subject -- asked Eckerson and Evelson (and others) for their definitions of big data. Their answers, while quite different, proved helpful in showing just how murky the topic is.
Evelson went on to say that on average organizations currently transform only 12.5% of their raw data into actionable information, according to Forrester surveys. Companies need to use new approaches, such as Hadoop and other big data technologies, to try to make sense of the rest of their data, he added. Eckerson agreed, saying that in addition to being less expensive than traditional data warehousing systems, big data tools "let us tackle more data."
SearchSoftwareQuality Site Editor James Denman was quick to pose a follow-up question:
To which Evelson responded:
Like it or not as a term, though, big data appears to be here to stay. The #TalkingBigData conversation turned to one of the top problems facing many organizations today: how to find workers with the big data management and analytics skills necessary for orchestrating initiatives.
Lack of skilled data professionals comes up in almost every interview I do. Colleges are gearing up. Cant come soon enough #talkingbigdata— Ed Burns (@EdBurnsTT) February 5, 2014
That tweet by Burns voiced a concern facing many businesses. For example, a 2013 survey conducted by software vendor Lavastorm Analytics found that 47.8% of 427 analytics professionals, corporate executives and other respondents felt their organizations lacked statistical, math or other quantitative skills. Such results raise the question of whether companies are prepared to effectively mine mountains of big data.
Evelson said he views big data skills as a combination of business intelligence and data mining know-how, and he suggested nurturing those skills internally:
Eckerson recommended a more unconventional approach for acquiring big data talent:
Rent-a-Data-Scientist? Don't be shocked. Eckerson said it's a viable option for organizations that don't need data scientists on a full-time basis. Especially when, according to Evelson, "it's the IT pro market," with the high salaries that entails.
It would be easy to say that more and more organizations are jumping aboard the big data train -- and you wouldn't be wrong, based on recent big data survey results. But all big data projects are not the same. When it comes to big data strategies, there's no prescribed method of finding the "correct" one. And you aren't alone if you're looking for the answer for your company, according to Eckerson: