Cloudera and EMC Collaborate on New Apache Hadoop API Plug-in

Cloudera, Inc., a provider of data management and analytics platform built on Apache Hadoop, has expanded its technology relationship with EMC Corporation and has collaborated on a new API plug-in to enable storage innovations to the Apache Hadoop ecosystem.

EMC’s DSSD D5 provides a shared flash storage platform that provides another powerful alternative for new workloads on Apache Hadoop, the de facto framework for processing and analyzing large data sets in distributed computing environments. Cloudera’s entire application suite has been certified against DSSD D5. For customers that require the combination of secure processing and analytics on fast, persistent memory, EMC’s DSSD D5 appliance running with Cloudera Enterprise will realize an order of magnitude better performance across multiple workloads for example, random-access Apache HBase workloads.

In order for companies to differentiate themselves, break new ground and transform into a digital enterprise they must be able to access, store and analyze data in real-time. To do so, companies have been turning to Hadoop to execute sophisticated real-time analytics on an enterprise-wide basis.

“When we began working with EMC on Isilon, and when that grew to include DSSD, it was because we believed a big data architecture needed to support both local and remote storage well,” said Mike Olson, founder and chief strategy officer, Cloudera. “That work is now paying off, and I’m really excited to see what new use cases our customers and partners can realize.“

As the first-ever system to offer direct memory access (DMA) to flash in HDFS and its novel low-latency multi-host fabric connectivity, the DSSD D5 is ideal for running demanding real-time analytics on streaming data for applications that power sectors like the industrial internet, connected vehicles, and financial services. DSSD D5 also maximizes efficient use of flash and EMC’s solution with Cloudera reduces the number of copies required to one while still providing enterprise data availability.

“Analytics capabilities aren’t nice to have-they’re absolutely critical to businesses for enhancing the customer experience, driving revenue and staying ahead of the competition,” said Jeremy Burton, president of products and marketing, EMC. “Our relationship with Cloudera is enabling our joint customers to extract more value from their Hadoop environments with the highest-performance flash platform of all time – it has the potential to be a true game changer.“

Read also:
EMC DSSD D5 Flash Storage Rack System
10 million IO/s, 100μs latency, 100GB/s bandwidth, 100TB in 5U
2016.03.07 | Press Release