Quobyte Hadoop Native Driver to Unlock Power of Enterprise Analytics, ML, Streaming, and Real-Time Applications

Quobyte Inc. announced the availability of its Hadoop Driver.

The company’s native driver for Hadoop addresses the limitations of the Hadoop Distributed File System’s (HDFS) high-capacity design within the enterprise. This native driver brings benefits in optimizing Hadoop clusters for a much wider range of applications and workloads, and true file system sharing across object storage and applications.

“Today’s analytics solutions allow enterprises to extract important insight from large volumes of data, but with the increasing prevalence of AI and ML in data analytics applications HDFS’s batch processing limitations have been exposed,” said Bjӧrn Kolbeck, CEO. “By deploying Quobyte’s native Hadoop/HDFS driver, enterprises can now seamlessly share large amounts of file data with high performance across Hadoop/analytics, ML, and any Linux or Windows application.“

Hadoop is a framework for big data processing, distributed across large amounts of commodity hardware within the enterprise. It has proven critical in helping enterprises manage the exponential growth of data, but in today’s data-driven environment, it lacks the ability to manage the real-time requirements from the new breed of analytic applications. Engineers have been working hard, with limited success, to enable small file processing by using NFS connectors.

The company offers the ability to integrate small file processing into the Hadoop Framework, without the need for a new file system, to deliver the speedy and scalable file I/O that is needed for modern analytic and real-time applications, while integrating well with container technology.

Accelerated by the rapid evolution of analytic and real-time applications, Gartner predicts that by 2024, 50% of global storage capacity will be deployed as SDS, either on-premises or on the public cloud (up from less than 15% in 2020).

With this announcement, the company and Hadoop bring together the ability to run on any distributed commodity x86 hardware, which unlocks the benefits of Hadoop while removing the storage limitations of HDFS and NFS, ensuring these modern workloads can run efficiently on Hadoop clusters.

In addition, this native driver removes security complexities by leveraging an alternative to HDFS that allows for encryption at both the storage and networking levels.

The company‘s deploy-anywhere software is hardware agnostic, running on bare metal and the public cloud.

Resources:
Blog: The Native Quobyte HDFS Driver
Free Edition of Quobyte for use in data center with up to 150TB of capacity