DataDirect Networks, IBM, San Diego Supercomputer Center and Brocade Process a Billion Files in Hours

IBM | charts | news | PowerRating -- DataDirect Networks, a provider of scalable storage systems for performance and capacity-driven applications, announced that in partnership with IBM, San Diego Supercomputer Center (SDSC) and Brocade, the company has processed one billion files in lightning speed using a single instance of IBM's General Parallel File System (GPFS) and DataDirect Networks' S2A9550 Storage System.

DataDirect said the Billion File Demonstration demonstrates that: GPFS efficiently processes metadata, allowing over a billion files to be scanned, and candidates for migration can be identified and moved to HPSS tape, multiple times a day.

To prepare for the test, IBM assembled a GPFS cluster at San Diego Supercomputer Center (SDSC) using seventeen, eight-way cluster members. DataDirect Networks' provided a high performance S2A9550 storage appliance that enables GPFS to rapidly scan over a billion files. ILM policies then determine which to keep on the high-performance DataDirect Networks S2A9550 Tier 1 storage array and which to migrate to tape. The ability of the S2A9550 to consistently deliver over 2.2GB/s of sustained throughput to GPFS is a key enabler for the demonstration.

This demonstration brings together IBM's best-in-class GPFS and HPSS offerings, now working as a single hierarchical storage system of disk and tape, said Bob Coyne, co-founder and lead industry architect of HPSS and industry chair of the HPSS Collaboration. The equipment, consultation and support provided by DataDirect Networks have been central to making this proof of concept demonstration possible, and we look forward to working with them as we pursue the next order of magnitude in file hierarchical storage."

GPFS provides concurrent access at lightning speed to multiple disk drives and storage devices, fulfilling a key requirement of powerful business intelligence and scientific computing applications that analyze vast quantities of often unstructured information, which may include video, audio, books, transactions, reports and presentations.

The HPSS is a flexible, performance-oriented mass storage system that is developed to address the high performance computing (HPC) hierarchical storage needs of multiple U. S. Department of Energy programs and to make this technology available to the HPC community. HPSS, which is funded by IBM and the HPC community, is the result of a fifteen-year collaboration between IBM, Lawrence Livermore National Labs, Los Alamos National Laboratory, Lawrence Berkeley National Laboratory, Sandia National Laboratories and Oak Ridge National Laboratory. HPSS is licensed to other users and supported by IBM under an agreement between IBM and the United States Department of Energy.

DataDirect Networks has also unveiled the S2A9900 StorageScaler, the company's eighth-generation S2A appliance and storage system that scales performance and capacity to new heights by delivering sustained bandwidth of up to 6GB/s per appliance and enabling storage systems to scale beyond 250GB/s in total throughput between host computers and the disk drives.

((Comments on this story may be sent to newsdesk@closeupmedia.com))

((Distributed via M2 Communications Ltd - http://www.m2.com))

http://www.10meters.com

Comments on this story may be sent to newsdesk@closeupmedia.com

More News:   Market Updates | Stock Alerts | All Trading News | Stock Index