Access your Pro+ Content below.
Data warehouses must learn new tricks in 'big data' era
This article is part of the Issue 6, June 2012 issue of BI Trends + Strategies
The buy vs. build debate in data warehousing has taken a wickedly humorous turn with the choice being rewritten as buy vs. suffer. To wit: Either buy packaged systems, even if some modest amount of integration is required, or suffer the pains of reinventing the wheel. But for high-end, challenging applications integrating business intelligence (BI) data with other information such as Internet clickstream and social networking data, the pendulum is swinging back in the direction of build. The drivers? The usual suspects: growing data volumes (accompanied by high numbers of concurrent users and a high velocity of update activity), technology innovations and business opportunities. These variables are challenging old data warehouses to adapt to new environments and acquire new tactics, techniques and tricks. Let’s look at some of the numbers. The exponential growth of data is staggering. A sense of the continuing explosion is provided by an estimate in a McKinsey Global Institute report published in May 2011 that the 800 exabytes...
Features in this issue
Eradicating the use of Excel in business intelligence applications turned out to be a pipe dream in most organizations. Now the focus is on controlling it -- as best you can.
News in this issue
These databases, mammoth by definition, are evolving to accommodate the influx of new data types, technical innovations and increasing volumes brought on by the rise of “big data.”
A shortage of workers with analytical skills threatens to derail efforts to derive business value from “big data.” It’s time for colleges to do more on BI and analytics education.