40% CAGR for Big Data Market From 2010 to 2015

International Data Corporation released a worldwide big data technology and services forecast showing the market is expected to grow from $3.2 billion in 2010 to $16.9 billion in 2015.

This represents a CAGR of 40% or about 7 times that of the overall information and communications technology market.

"The big data market is expanding rapidly as large IT companies and startups vie for customers and market share," said Dan Vesset, program vice president, Business Analytics Solutions at IDC. "For technology buyers, opportunities exist to use big data technology to improve operational efficiency and to drive innovation. Use cases are already present across industries and geographic regions."

"There are also big data opportunities for both large IT vendors and start-ups," Vesset continued. "Major IT vendors are offering both database solutions and configurations supporting big data by evolving their own products as well as by acquisition. At the same time, more than half a billion dollars in venture capital has been invested in new big data technology."

Additional findings:

While the five-year CAGR for the worldwide market is expected to be nearly 40%, the growth of individual segments varies from 27.3% for servers and 34.2% for software to 61.4% for storage.
The growth in appliances, cloud, and outsourcing deals for big data technology will likely mean that over time end users will pay increasingly less attention to technology capabilities and will focus instead on the business value arguments. System performance, availability, security, and manageability will all matter greatly. However, how they are achieved will be less of a point for differentiation among vendors.
Today there is a shortage of trained big data technology experts, in addition to a shortage of analytics experts. This labor supply constraint will act as an inhibitor of adoption and use of big data technologies, and it will also encourage vendors to deliver big data technologies as cloud-based solutions.

"While software and services make up the bulk of the market opportunity through 2015, infrastructure technology for big data deployments is expected to grow slightly faster at 44% CAGR. Storage, in particular, shows the strongest growth opportunity, growing at 61.4% CAGR through 2015," said Benjamin S. Woo, program VP, Storage Systems at IDC. "The significant growth rate in revenue is underscored by the large number of new open source projects that drive infrastructure investments."

IDC methodology for sizing the big data technology and services market includes evaluation of current and expected deployments that follow one of the following three scenarios:

Deployments where the data collected is over 100TB. IDC is using data collected, not stored, to account for the use of in-memory technology where data may not be stored on a disk.
Deployments of ultra-high-speed messaging technology for real-time, streaming data capture and monitoring. This scenario represents big data in motion as opposed to big data at rest.
Deployments where the data sets may not be very large today, but are growing very rapidly at a rate of 60% or more annually.

Additionally, IDC requires that in each of these three scenarios, the technology is deployed on scale-out infrastructure and deployments that include either two or more data types or data sources or those that include high-speed data sources such as click-stream tracking or monitoring of machine-generated data.

The study, Worldwide Big Data Technology and Services 2012-2015 Forecast (IDC #233485, $4,500) examines the big data technology and services market for 2010–2015.

IDC defines big data technologies as a new generation of technologies and architectures designed to extract value economically from very large volumes of a wide variety of data by enabling high-velocity capture, discovery, and/or analysis. Further, the study segments the big data market into server, storage, networking, software, and services segments