What are you looking for ?
Infinidat
Articles_top

Amazon Web Services Announcing Two HDD-Backed Storage Options for Amazon EBS

Starting at $0.025/GB /month

Amazon Web Services, Inc. (AWS), an Amazon.com company , announced the availability of two low-cost HDD drive (HDD)-backed storage options for Amazon Elastic Block Store (EBS), offering customers predictable performance for throughput-intensive and big data workloads with large data sets, large I/O block sizes, and sequential I/O patterns.

AWS_solutions-slides-webapplicationsEBS Throughput Optimized HDD (st1) and EBS Cold HDD (sc1) volumes deliver customers consistent baseline performance with the ability to ‘burst’ to higher throughput in order to meet the performance needs of MapReduce, Kafka, Extract/Transform and Load (ETL), log processing, and data warehouse workloads.

EBS customers pay only for the storage they provision, with no additional charges for throughput, and prices start at $0.025/GB month.

To get started with EBS Throughput Optimized HDD (st1) and Cold HDD (sc1) volumes.

Since launching Amazon EBS in 2008, AWS has continually innovated to offer block storage options which allow customers to optimize their storage performance and cost for a wide range of workloads. In 2012, AWS began offering EBS volumes that incorporated advances in SSD technology to deliver high-performance persistent storage for latency-sensitive transactional workloads like databases that require consistently high IO/s.

In 2014, the company introduced a price/performance optimized SSD-based storage service that pioneered an IO/s ‘bursting’ model to cost-effectively deliver the IO/s performance required for a broad range of transactional workloads, including boot volumes, development/test, and low-latency interactive applications. With today’s announcement, the company continues this innovation, delivering the industry’s best price/performance block storage for big data workloads. Designed as the new generation of firm’s HDD-based storage, these EBS volumes are optimized for throughput-intensive, big data workloads like processing logs or streaming data with Kafka, performing cluster data analytics with MapReduce, data warehousing, or for less-frequently accessed workloads. EBS Throughput Optimized HDD (st1) and Cold HDD (sc1) volumes deliver low cost HDD storage with the predictable high-throughput required to meet the processing needs of big data applications.

Throughput Optimized HDD (st1) volumes include a maximum throughput up to 500MB/s per volume and Cold HDD (sc1) volumes have a maximum throughput of 250MB/s per volume. All EBS volume types offer durable snapshot capabilities and are designed for 99.999% availability.

Over the last several years, AWS has delivered a series of SSD-based Amazon EBS volumes that enabled customers to run their most IO/s-intensive applications successfully and cost-effectively,” said Peter DeSantis, VP, compute services, AWS. “But, for big data workloads, HDDs still remain the optimal block storage solution, yet little to no innovation has taken place on HDDs – until today. These two new Amazon EBS volumes represent a step-level change in the cost and performance of HDDs, and make it more efficient to run throughput-intensive, big data workloads.

Localytics is a lifecycle engagement platform for web and mobile apps used in more than 37,000 apps on more than 2.7 billion devices.

With petabytes of magnetic storage under our Vertica cluster, we are always looking for ways to improve performance and lower our costs,” said Mohit Dilawari, director, back-end engineering, Localytics, Inc.The release of Amazon EBS Cold HDD (sc1) allowed us to migrate our Vertica cluster, saving us over 50% of our monthly storage costs, while still providing the reliable throughput we need to run our queries. Larger volume sizes also removed the need to stripe multiple volumes, simplifying our management and operations of the cluster while allowing for easier scaling.

Infor provides business applications specialized by industry and built for the cloud, with more than 73,000 customers and 58 million cloud users.

We’re excited about the announcement of Amazon EBS Throughput Optimized HDD (st1) and Cold HDD (sc1) and are looking forward to using the volumes to reduce costs, moving some of our big data workloads to Throughput Optimized HDD (st1) and colder data to Cold HDD (sc1),” said Jim Plourde, VP, cloud services, Infor Global Solutions. “Moving some of our colder data to Cold HDD (sc1) could lead to substantial savings on storage costs.

Confluent, founded by the creators of Apache Kafka, enables organizations to harness business value from stream data.

From the benchmark tests we ran across various high throughput workloads, we found the new Amazon EBS Throughput Optimized HDD (st1) and Cold HDD (sc1) volumes consistently deliver the necessary throughput, performance, and reliability to run Kafka,” said Jay Kreps, co-founder and CEO, Confluent, Inc.The new volumes can save customers as much as 50% on their Amazon EBS storage and provide the same throughput and performance with Kafka. Additionally, the new volumes open up more options for customers running Kafka on AWS, because customers can use low-cost instances such as Amazon EC2 C4 or M4 with these new Amazon EBS volumes to optimize for performance and save costs.

Following table describes use cases
and performance characteristics for each volume type:

  Solid-State Drives (SSD) Hard disk Drives (HDD)
Volume Type General Purpose SSD (gp2)* Provisioned IOPS SSD (io1) Throughput Optimized HDD (st1) Cold HDD (sc1)
Description General purpose SSD volume that balances price and performance for a wide variety of transactional workloads Highest-performance SSD volume designed for mission-critical applications Low cost HDD volume designed for frequently accessed, throughput-intensive workloads Lowest cost HDD volume designed for less frequently accessed workloads
Use Cases
  • Recommended for most workloads

  • System boot volumes

  • Virtual desktops

  • Low-latency interactive apps

  • Development and test environments

  • Critical business applications that require sustained IOPS performance, or more than 10,000 IOPS or 160 MiB/s of throughput per volume

  • Large database workloads, such as:

    • MongoDB

    • Cassandra

    • Microsoft SQL Server

    • MySQL

    • PostgreSQL

    • Oracle

  • Streaming workloads requiring consistent, fast throughput at a low price

  • Big data

  • Data warehouses

  • Log processing

  • Cannot be a boot volume

  • Throughput-oriented storage for large volumes of data that is infrequently accessed

  • Scenarios where the lowest storage cost is important

  • Cannot be a boot volume

API Name gp2 io1 st1 sc1
Volume Size 1 GiB – 16 TiB 4 GiB – 16 TiB 500 GiB – 16 TiB 500 GiB – 16 TiB
Max. IOPS**/Volume 10,000 20,000 500 250
Max. Throughput/Volume 160MB/s 320MB/s 500MB/s 250MB/s
Max. IOPS/Instance 48,000 48,000 48,000 48,000
Max. Throughput/Instance 800MB/s 80MB/s 800MB/s 800MB/s
Dominant Performance Attribute IOPS IOPS MB/s MB/s

* Default volume type
** gp2/io1 based on 16KiB I/O size, st1/sc1 based on 1 MiB I/O size

Customers can launch EBS Throughput Optimized HDD (st1) and Cold HDD (sc1) volumes using the AWS Management Console, AWS Command Line Interface (CLI), or AWS SDKs. EBS Throughput Optimized HDD (st1) and EBS Cold HDD (sc1) volumes are available in all commercial AWS regions.

Articles_bottom
AIC
ATTO
OPEN-E