Wednesday, 24 February 2016 08:39

Nimble goes all flash with AF Arrays


Nimble Storage has announced a new range of all flash storage arrays to complement its existing adaptive flash arrays.

The AF series of all flash arrays initially consists of four models, the AF3000, AF5000, AF7000 and AF9000.

Describing the launch as "a really important milestone, CEO Suresh Vasudevan (pictured) said the AF series is "dramatically more scalable than other all-flash arrays."

The company also claims the total cost of ownership of the AF series is up to 33 to 66% lower than competing products from other vendors.

This is the result of several factors. The AF controller requires one tenth to one thirtieth as much memory than competing products, so at the entry level a single controller is cheaper, and then as the array is expanded fewer controllers are needed to support large amounts of storage.

AF arrays also support 3D V-NAND as used in the Samsung PM863 Series SSDs, with endurance management and integrated hot sparing that extends flash lifespan to seven years while providing 20% more usable capacity in half the footprint and cost of competing eMLC-based all flash arrays.

Vasudevan said Nimble had chosen to stay with SSDs rather than adopting a proprietary flash technology because the latter would provide no cost advantage. The company packs two SSDs into the space of one 3.5in drive, and handles endurance management in the file system.

As with earlier models, the AF series includes inline variable block compression but adds variable block deduplication. Combined with zero pattern elimination, this means the AF series provides up to five times greater effective capacity than competing products. Support for thin provisioning and zero copy clones provides additional savings.

Nimble plans to add variable block deduplication to its adaptive flash arrays over time, said vice president of products, solutions and alliances Dan Leary.

Since Nimble's adaptive flash arrays run the same release of NimbleOS as the new all-flash arrays, they can be used to provide backup, disaster recovery and archiving at lower cost while maintaining a single architecture. The cost is sufficiently low that customers can afford to retain several months worth of data, Leary said.

Adaptive flash and all-flash arrays can be assembled into a single cluster, so the most demanding workloads can be assigned to all-flash. Applications can be moved from one to the other without downtime.

The top of the range AF9000 delivers up to 350,000 IOPS with sub-millisecond latency and scales to more than 2PB effective capacity in 12U.

Up to four arrays can be clustered for up to 1.2M IOPS and effective capacity of more than 8PB, said to an order of magnitude greater than competitive all flash arrays. Such clusters can be managed as a single unit.

Storage can be added, controllers upgraded and arrays clustered without disrupting normal operation.

The AF series can provide ten times the effective capacity and twice the performance of an EMC XtremeIO system, said Leary, or five times the effective capacity and equivalent performance to a Pure Storage system that lacks Nimble's scale-out capability.

"Substantial changes" were made in the development of the AF series, vice president of engineering Varun Mehta told iTWire. Adaptive flash used flash storage as a caching layer, but that is not needed in an all-flash array.

But the biggest change comes from the introduction of inline deduplication, he said. Data is initially written to NVRAM to deliver the required performance, and from there a 'fingerprint' is generated to determine whether or not an identical block has already been stored.

The problem is that the fingerprint table can become very large, so Nimble allows it to spill from memory into flash storage. "That's good and bad," he said. The good thing is that it allows Nimble to support more storage at lower cost, as a controller with a given amount of memory can keep track of more data blocks and hence more SSDs.

The bad is that retrieving table entries from flash takes longer. So Nimble has developed a new algorithm to predict which entries are likely to be needed and bring them back into memory ahead of time, thus providing sustained write performance.

"Everybody touts their read performance, hardly anyone publicly canvasses their write performance,"said Mehta. "We did a lot of work to make sure our write performance remains very high" because "in real life, writes dominate... typically by a 2:1 ratio."

Making provision for compression of variably sized blocks also makes a difference. Applications typically write data with a consistent block size, but the actual size varies among different applications, he explained.

Matching the compression block size to the application's block size results in greater efficiency, but "it's not commonly done" because it is easier to use a fixed block size such as 512 bytes or 4KB, Mehta said.

Nimble's software lets users tell the array which application will use a particular volume, and it sets the block size accordingly and applies specific optimisations. For example, Windows system partitions use 4K blocks, while Exchange 2012 uses 32K blocks. Users can manually set the compression block size if the application is unknown to the Nimble software.

While compression is more efficient with larger blocks, a mismatch between the size of application writes and compression block sizes reduces overall efficiency.

Reliability and availability have been an important part of Nimble's pitch from the outset. The company has achieved 99.9997% uptime across all its customers, equivalent to eight seconds of downtime per system per month.

As with previous Nimble arrays, the AF series protects against the simultaneous failure of three SSDs. The new 'Triple+' parity scheme takes account of the different failure characteristics of SSDs compared with spinning disks. A complete failure equivalent to a hard drive crash is "exceedingly rare" with SSD, Mehta told iTWire. A more likely cause of failure is that certain cells wear out before others, and intra-drive parity helps protect against this problem by providing four rather than three places to recover data before turning to snapshots or replicated copies, he said.

Nimble's analytics (see below) help prevent multiple simultaneous drive failures by recommending early replacement of some drives, otherwise the efficient wear-levelling mechanism could make that situation more likely. But some customers like to run their systems into the ground before replacing any parts, so Triple+ parity reduces the risk that such practices could result in lost data, Mehta said.

An important feature of Nimble's platform is the InfoSight cloud analytics system that collects more data points every four hours than there are stars in the Milky Way. By pooling infrastructure data from many customers the company is able to prevent issues from arising by alerting customers of the need to take particular actions (nine out of ten issues are detected by Nimble before the customer notices), perform rapid root-cause analysis across the technology stack, and predict future requirements to simplify planning.

Data from non-Nimble elements is collected using standard APIs such as those provided by VMware's vCenter, vice president of customer support Rod Bagg told iTWire. Support for additional hypervisors such as Microsoft Hyper-V is planned, along with data collection from Windows and other operating systems. "We have a roadmap for that sort of thing," he said.

InfoSight is included with all Nimble support contracts, and can be used by as many people as the customer requires.

The new AF arrays can be ordered immediately.

"Our engineers are so confident in the readiness of our all flash arrays that we've been powering core Nimble production engineering infrastructure services on an AF7000 array for several weeks and have experienced flawless service," said vice president of product management Ajay Singh.

Disclosure: The writer travelled to San Francisco as a guest of Nimble Storage.

Subscribe to ITWIRE UPDATE Newsletter here


The much awaited iTWire Shop is now open to our readers.

Visit the iTWire Shop, a leading destination for stylish accessories, gear & gadgets, lifestyle products and everyday portable office essentials, drones, zoom lenses for smartphones, software and online training.

PLUS Big Brands include: Apple, Lenovo, LG, Samsung, Sennheiser and many more.

Products available for any country.

We hope you enjoy and find value in the much anticipated iTWire Shop.



iTWire TV offers a unique value to the Tech Sector by providing a range of video interviews, news, views and reviews, and also provides the opportunity for vendors to promote your company and your marketing messages.

We work with you to develop the message and conduct the interview or product review in a safe and collaborative way. Unlike other Tech YouTube channels, we create a story around your message and post that on the homepage of ITWire, linking to your message.

In addition, your interview post message can be displayed in up to 7 different post displays on our the site to drive traffic and readers to your video content and downloads. This can be a significant Lead Generation opportunity for your business.

We also provide 3 videos in one recording/sitting if you require so that you have a series of videos to promote to your customers. Your sales team can add your emails to sales collateral and to the footer of their sales and marketing emails.

See the latest in Tech News, Views, Interviews, Reviews, Product Promos and Events. Plus funny videos from our readers and customers.


Stephen Withers

Stephen Withers is one of Australia¹s most experienced IT journalists, having begun his career in the days of 8-bit 'microcomputers'. He covers the gamut from gadgets to enterprise systems. In previous lives he has been an academic, a systems programmer, an IT support manager, and an online services manager. Stephen holds an honours degree in Management Sciences and a PhD in Industrial and Business Studies.

Share News tips for the iTWire Journalists? Your tip will be anonymous




Guest Opinion

Guest Reviews

Guest Research

Guest Research & Case Studies

Channel News