Cerebras Systems Selects Vast Data

Cerebras Systems, Inc. has selected Vast Data Ltd. to help deliver advanced data solutions that will accelerate the training and accuracy of generative AI workloads.

By leveraging the scalable and secure multi-tenant Vast Data Platform, Cerebras scales capacity and performance of its CS-2 AI HPCs, including the recently announced Condor Galaxy, an AI HPC network built in partnership with G42 Cloud, now part of Core42.

“The data requirements for training generative AI workloads continues to increase at an exponential and unprecedented pace,” said Andrew Feldman, CEO and co-founder, Cerebras. “The Vast Data team have industry-leading expertise in managing EBs of data from edge to cloud, and helping evolve that data into information. With Vast’s enhanced data capabilities, we enable optimal utilization of Condor Galaxy, built in strategic partnership with G42, and our other AI HPCs. This will allow users to build and train the next wave of cutting-edge foundational models, while greatly reducing training times and accelerating time-to-insight.“

Training large models requires massive amounts of AI compute, huge datasets, and specialized AI expertise. Cerebras and Core42 introduced Condor Galaxy, a network of 9 interconnected AI HPCs that will provide 36 exaFLOPs of AI compute, which delivers on all 3 elements and was used to train Jais, an Arabic large language model. By collaborating with Vast Data, the Condor Galaxy super-computing network furthers its leadership in the storage and enhanced data management of vast and diverse datasets. The Vast Data Platform provides scalable, secure, and efficient access to the massive amount of data required for training workloads conducted on Condor Galaxy.

“Our strategic partnerships with Cerebras and Vast Data deliver on our mission to deploy AI-optimized cloud infrastructure that addresses the most pressing needs of global organizations and uses data-intensive AI computing to solve real-world challenges,” said Talal Alkaissi, EVP and chief product and global partnerships officer, Core42. “We are thrilled to be delivering meaningful results, including the newly announced clinical LLM, Med42, a leading 70 billion parameter open-access model launched by M42 and trained on Condor Galaxy 1, with its curated medical dataset stored and secured by Vast.“

“As AI model training continues to grow and expand, so too does the need for more memory in each GPU, and Cerebras is delivering a new approach to solve this problem,” said Jeff Denworth, co-founder, Vast Data. “Through our joint collaboration with Core42, the Vast Data Platform is helping organizations reimagine the future of data-intensive AI training and inference with infrastructure that was designed for these high-performance demanding workloads, and the simplicity and zero trust, multi-layer security that modern enterprises require. Together, we’re excited to provide the data foundation for a global network of next gen AI HPCs.“