Index Engines Indexing 1TB/Hour/Node

Index Engines, Inc. announced the validation of the Index Engines platform performance of content and metadata indexing of NetApp and HP network attached storage (NAS) data at sustained rates of up to 1 Terabyte per hour using only a single indexing node.

These speeds demonstrate the power of Index Engines’ purpose-built operating system for indexing enterprise class data environment versus traditional data processing solutions that are based upon public domain or other third party cores originally designed for the Internet. This unmatched speed has been validated by NetApp for data residing on the NetApp FAS3100 platform using NDPM indexing. The 1 TB per hour indexing was also validated on the HP StorageWorks 9100 Extreme Data Storage System.

Other common data indexing tools, used for legal discovery or storage optimization applications, site indexing speeds significantly below the proven Index Engines performance. Index Engines is a purpose-built platform that supports enterprise-class discovery requiring the rapid processing of large volumes of data. The performance rate of 1 TB/hr was implemented through a single Index Engines node. The validations of the NetApp and HP platforms rounds out Index Engines support for 1 TB per hour indexing of market leading storage systems. The suite of previously-validated storage platforms includes Data Domain, EMC Celerra and BlueArc.

The NetApp performance validation consisted of Index Engines appliance connected to the NetApp FAS3170 via a direct connection of bounded GigE connections receiving eight simultaneous NDMP data streams. Data combinations of Exchange data (.EDBs and .STMs) with Files System data, Files System data only, and Exchange data only were all tested with indexing results above 1 Terabyte per hour.

The HP performance validation was configured with the Index Engines appliance direct-connected to an HP StorageWorks 9100 Extreme Data Storage System using four GigE network cables. The test data consisting of combinations of Exchange data (.EDBs and .STMs) with Files System data, Files System data only, and Exchange data only was indexed over the network using 18 simultaneous NFS crawl jobs. These crawl jobs combined for a total throughput of 1TB per hour for the single node.

"As enterprise data continues to grow, the ability to find, organize and manage that data must keep pace. Index Engines is committed to fulfilling that need with systems that remove the indexing bottleneck from enterprise discovery," said Jim McGann, Vice President of Information Discovery at Index Engines. "The indexing performance benchmark of 1 TB/hr per node brings enterprise data indexing to a whole new level. Index Engines also delivers a unified discovery platform across all network and backup data to enable efficient and cost effective electronic discovery."

The Index Engines platform also supports index and search capabilities up to one billion data objects in a single engine. The average Index Engines index footprint ranges from 4 to 8%. Base price for the Index Engines platform for online network deployment is $85,000. Orders are now being accepted, with shipments within four weeks of the order date.