Lab Results Show Performance Benefits for In-Memory Database Systems

McObject LLC, developer of real-time database system software for embedded systems and real-time enterprise applications, announced lab results that show performance benefits for in-memory database systems (IMDSs) with transaction logging over disk-based database management systems.

The tests refute the myth that adding recoverability to an IMDS eliminates its performance edge over traditional database management systems (DBMSs).

In-memory database systems – which work with data in main memory – are faster than conventional DBMSs, because the latter rely on slower persistent storage. But some potential users shy away from IMDSs due to the higher volatility of keeping records in RAM.

Transaction logging, which keeps a record of changes to the database, addresses this concern by enabling recovery in the event of system failure. Naysayers argue that the persistent storage required to keep this transaction log defeats the purpose of using an IMDS, and counters any performance gains.

In one of the first tests of its kind, and using database system software from its eXtremeDB product family, McObject measured the performance of an on-disk DBMS against an IMDS with transaction logging (IMDS+TL) using a variety of storage devices. For the database operations most likely to induce latency, the IMDS+TL storing its transaction log on a HDD outperformed the conventional DBMS using HDD storage several times over (even with the disk-based DBMS employing caching to minimize I/O).

The gains were even more dramatic using flash memory technology from Fusion-io, Inc. Swapping the hard drive used by the in-memory database system to store log data with a Fusion ioDrive enabled the IMDS with transaction logging to turn in a stunning 15.33x speed advantage over the disk-based DBMS.

"Near real-time performance is a key goal for telecommunications and high performance computing, but data must also be recoverable in case of unexpected events. Transaction logging solutions like eXtremeDB and Fusion ioMemory can ensure customers have comprehensive protection for the data that runs their business," said Tyler Smith, Fusion-io VP of Alliances. "We are pleased to work with McObject to achieve such impressive results, and we look forward to continuing to collaborate with innovative database experts to deliver ultra-low latency, flash memory performance."

"These tests have important implications for high performance systems, chief among them that you don’t need to sacrifice data durability in order to gain high performance," said Steve Graves, co-founder and CEO of McObject. "With transaction logging, software gains database recoverability yet still benefits from in-memory DBMSs’ tremendous speed. The performance advantage of an IMDS with transaction logging turns out to be dramatic even using basic hard disk storage; by moving to Fusion-io’s state-of-the-art memory tier storage, real-time embedded systems can obtain an advantage that is truly game-changing."

Preview of the testing process

McObject counts among its customers BAE Systems, Siemens, Phillips, EADS, JVC, Tyco Thermal Controls, F5 Networks, CA, Motorola and Boeing.