SwiftStack, Inc. announced enhancements to its data platform for performance, data utilization, and services at ultra-scale.
Click to enlarge
The SwiftStack 7 enables demanding workloads such as ML, media analytics, and scientific research, in environments like autonomous vehicle development, ingest and processing of 4K/8K video, and other compute-intensive processes.
Emerging data-intensive applications require a storage architecture with the ability to feed thousands of GPUs working in parallel, from a single global namespace spanning edge, core, and cloud data stores.
The company’s platform accommodates data sets that scale to hundreds of petabytes and even exabytes, enabling data access at speeds to more than 100GB/s to thousands of workers. The v.7 offers features to enable this ultra-scale performance, distributed flash-based caching, data immutability, and workflow integration all with standards-based APIs.
V.7 offers following enhancements:
Ultra-scale Performance Architecture
SwiftStack drives previously unseen throughput performance at massive multi-petabyte scale and can handle thousands of simultaneous workers accessing data. Independent third-party testing on similar hardware and workloads validates SwiftStack 7 is multiple times faster than competitors, realizing high production throughput speeds at over 100GB/s. The simple, open architecture allows linear scaling of both performance and capacity.
ProxyFS Edge extends the firm’s platform’s file services to be distributed at the edge, close to the application, for high-throughput, data-intensive use cases. The containerized ProxyFS agent at the edge provides caching capabilities to minimize latency while providing massive throughput to large datasets stored at the core. ProxyFS Edge is an extension of the existing ProxyFS clustered filesystem that allows for file and object API access to the same data sets.
Click to enlarge
1space file connector
This component of SwiftStack 1space, the 1space file connector, brings existing enterprise file data into the cloud namespace so cloud-native applications can access data via S3 or Swift object APIs without complex migration. The containerized connector interacts with NAS and can scale out to provided performance access of files to modern applications. This allows businesses and organizations to modernize their workflows incrementally and apply 1space data placement and protection policies (copy, move, tier) to file data when needed.
SwiftStack PRO (Professional Remote Operations) is an optional service employed by hundreds of large-scale customers, includes advanced professional service- and software-based capabilities to allow 24×7 remote management and monitoring of SwiftStack production clusters. It ensures teams of any size can keep a highly-utilized storage and management platform optimized for demanding uses.
SwiftStack 7 for AI
The v.7’s capabilities are for deep learning at ultra-scale. This customer-proven architecture stack satisfies the storage performance needed by GPU compute complexes and AI frameworks accessing and processing hundreds of petabytes of data. The solution’s architecture delivers elasticity from edge to core to cloud, data immutability for long-term referencability, and viable TCO.
Click to enlarge
“Data scientists are constrained by inherited infrastructure, particularly in performance, scalability, cost, metadata enrichment, workflow integration, and portability to accommodate data at the edge, core, and cloud,” said George Crump, chief steward, Storage Switzerland. “Large enterprise customers need to architect a data pipeline and framework to deliver business outcomes and intelligence, and SwiftStack’s software is a strategic component supporting these modern applications.“
“Right now, data is changing the world, applications can exist anywhere from the edge to the core data center to the cloud, and data management and control has been decoupled from core infrastructure,” said Joe Arnold, founder and chief product officer, SwiftStack. “Our customers are pushing the boundaries in demanding environments, such as deep learning, and SwiftStack 7 is the foundation for delivering performance, capacity, and services at scale.“
SwiftStack 7 will be released in November, containing the ultra-scale performance enhancements and the 1space File Connector.
ProxyFS Edge is currently in beta and will be available in early 2020.
SwiftStack PRO and the AI architecture are available.
Video: ProxyFS Architecture Overview for SwiftStack File Access
The SwiftStack AI Architecturered WP (registration required)
SwiftStack and InfiniteIO Introduce Integrated Solution for Enterprise NAS With Unites File and Object Stores and Shifts Data to Cloud
Joint solution transforms tier-one NAS into scalable, economical, performance, cloud-ready environment for file data.
October 25, 2019 | Press Release
Works With SwiftStack Released
And technology partner program to simplify cloud storage deployments
August 23, 2019 | Press Release
SwiftStack Unveils Data Analytics Solution With “10x Performance” and Massive Scale
For big data analytics and ML for hybrid cloud and multi-cloud environments
June 17, 2019 | Press Release