Sun Open Storage


Published on

1 Like
  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Sun Open Storage

  1. 1. SUN OPEN STORAGE: A LOWER-COST, HIGHER- PERFORMANCE ALTERNATIVE FOR THE ENTERPRISE Open Storage White Paper May 2009 Abstract Demands for data storage continue to increase, and enterprises are looking for ways to address this challenge while keeping costs down. Instead of buying and then maintaining more and more storage devices, enterprises now have another option: open storage. With open storage, businesses can leverage industry-standard components and open-source software to build highly scalable, reliable, and flexible storage systems. And now, Sun Open Storage provides a flexible option that can significantly lower costs, provide high performance, simplify storage management, and provide access to the latest innovative capabilities.
  2. 2. Sun Microsystems, Inc. Table of Contents Executive Summary ........................................................................................ 1 Storage Challenges in a Data-Intensive World ................................................... 1 Open Storage in the Enterprise ....................................................................... 2 Open Source Delivers Software Building Blocks for Open Storage ........................ 3 Solaris ZFS™ Software .......................................................................................... 3 OpenSolaris COMSTAR ......................................................................................... 4 Solaris DTrace ..................................................................................................... 4 Solaris Fault Management Architecture ................................................................ 4 Extending the Value of Open Storage to Hardware Components.......................... 5 Complete, Enterprise-Ready Storage Solutions: Hardware Innovation That Fully Leverages Open Source .................................................................................. 6 Sun Fire™ X4540 Storage Server: Tapping the Power of ZFS ................................. 8 How to Get Started with Sun Open Storage ...................................................... 9 Sun Open Storage Customer Success Story ........................................................ 9 Wikimedia Foundation Ensures Data Integrity for Ever-Expanding Online Resources 9
  3. 3. 1 Sun Open Storage Sun Microsystems, Inc. Executive Summary The amount of data that enterprises need to store, manage, and protect is increasing exponentially. Enterprises traditionally address increasing storage needs by purchasing more storage devices from proprietary vendors. However, these closed systems have a number of disadvantages, including: • High cost. In a proprietary environment, all disk drives, controllers, and software typically have to come from the same vendor and are sold at premium prices. The hardware often severely lags in capability behind industry-standard systems components at similar price levels. And while the hardware may not seem expensive, the cumulative cost associated with required and proprietary software makes such a storage system much more costly. • Lack of flexibility. Enterprises cannot add or modify software to suit their specific needs or adapt and expand a storage system to meet growing data demands. Today, enterprises have another option: open storage, which some industry analysts estimate will make up almost 12% of the storage market by 2011. Using industry- standard components and open-source software, open storage enables enterprises to build highly scalable, reliable, and flexible storage systems to fit their growing demands—all at a fraction of the cost of traditional, proprietary storage. Responding to this market need, Sun Open Storage brings together leading open- source software and industry-standard, proven servers to provide enterprises with a real alternative. Enterprises that leverage Sun Open Storage can enjoy: . • Lower costs. With open-source software and industry-standard systems, Sun Open Storage delivers enterprise reliability and scalability at one-tenth the cost of closed, proprietary storage systems. • A high degree of flexibility. With Sun Open Storage, enterprises are not locked in to a single vendor; they can use the components that fit their needs and add new capabilities—from Sun or third parties—without paying a premium or annuity for proprietary products. • High performance, simplified management. Sun Open Storage leverages sophisticated tools for optimizing performance and dramatically reducing the complexity of storage management. • Innovation. With a large community of developers focused on creating new capabilities that meet enterprises’ storage needs, Sun Open Storage can quickly bring the best features to market. Storage Challenges in a Data-Intensive World With more and more users sharing content and collaborating, communicating, and conducting business across the globe, enterprises today must ensure that their storage infrastructure is flexible and scalable enough to handle these rapidly growing demands. In 2008, IDC1 reported that the amount of new digital information 1 Source: IDC White Paper sponsored by EMC, The Diverse and Exploding Digital Universe, March 2008
  4. 4. 2 Sun Open Storage Sun Microsystems, Inc. created, captured, or replicated in 2007 was 281 exabytes and is expected to grow to 1773 exabytes by 2011. (An exabyte is equal to 1 quintillion bytes.) Approximately 70% of this data will be created by individuals or non-enterprises, but enterprises and organizations will be responsible for storing, securing, and protecting 85% of this new digital data. When faced with increasing storage needs, the default strategy for many years has been for enterprises to simply buy more storage devices. However, almost all modern disk arrays and storage systems available from traditional storage vendors are closed, proprietary systems; their customers are locked into buying disk drives, controllers, and proprietary software features from only them—typically at premium prices. Additionally, their customers cannot add their own drives or add or modify software beyond what management configuration tools allow. The rapid growth of new digital data, the management challenges that accompany this growth, and the increasing costs of storage management point to the need for a radically different storage pricing structure, as well as for new storage architectures that offer more flexibility. With the continuing growth of open-source software, community development, and industry-standard hardware, open-storage architectures have become a viable alternative for enterprises. Open Storage in the Enterprise Open storage uses open-source software and industry-standard system components to build highly scalable, reliable, and affordable enterprise storage systems, leverag- ing the rapid innovation and flexibility of open communities and architectures. Enterprises using open storage solutions can quickly benefit from the new capabilities developed in a growing community of open-source software developers rather than depend upon a proprietary vendor’s business goals or R&D budget. They gain more freedom to expand their storage solutions in cost-effective ways. For example, enterprises undertaking Web 2.0 initiatives need a high degree of flexibility. Web 2.0 applications are dynamic, and they depend on open stan- dards and open-source software to reduce costs and give developers the ability to differentiate by adding their own custom software. Open storage meets these requirements better than any other storage infrastructure or architecture avail- able. Google and Amazon could not exist in their current forms if they hadn’t built their own storage infrastructures based on open storage principles, rather than traditional, proprietary storage architectures. On the hardware side, there are a number of technical advantages to building storage devices out of industry-standard system components and servers. One of
  5. 5. 3 Sun Open Storage Sun Microsystems, Inc. the performance bottlenecks in a data center has been the network; by using open storage, applications can be brought closer to the data by running them on the same system dedicated to storage functions. Industry-standard servers also provide more processing capability and more cache memory than is available in a traditional modular storage array. And finally, an open-storage architecture allows enterprises to easily add CPUs, cache, and I/O connectivity, providing multi-dimensional scalability. By heavily investing in the development of the most comprehensive set of open- storage products, solutions, and services, Sun offers enterprises proven, scalable technology with a level of flexibility and cost-effectiveness not found in proprietary systems. Open Source Delivers Software Building Blocks for Open Storage Sun Open Storage offers enterprises the ability to build the storage infrastructure that suits their needs using Sun’s proven, open-source software and industry- standard hardware components (either from Sun or certified hardware from third parties). The foundation of Sun Open Storage is the OpenSolaris™ Operating System, one of the most robust, reliable, and innovative OS’s available. The OpenSolaris storage community, launched in 2007 when Sun donated a vast amount of storage technol- ogy to the OpenSolaris project, is now the world’s leading centralized open-source storage community. Sun plays an active role in the OpenSolaris storage community by contributing code and working with open-source developers around the world to design or enhance storage capabilities. Storage industry leaders such as Hitachi Data Systems, QLogic, Emulex, and Brocade have also contributed their software to the OpenSolaris community, and companies across the IT landscape are using OpenSolaris technology in their storage product offerings. Sun remains active in the community, providing expert support and service to Sun Open Storage users, and Sun engineers continue to build upon the work of the open-source community to deliver additional features and capabilities that businesses need. OpenSolaris features that are central to the Sun Open Storage solution are: Solaris ZFS™ Software Solaris ZFS™ technology offers a dramatic advancement in data management with a virtual storage pool design, integrated volume manager, and data services that provide an innovative approach to data integrity.
  6. 6. 4 Sun Open Storage Sun Microsystems, Inc. Sun Open Storage: ZFS software allows for more efficient use of storage devices and enables accelerated Cost-Saving Opportunities performance of Web applications without changes to the application. Physical for the Enterprise storage can be added to or removed from storage pools dynamically without inter- Sun Open Storage delivers breakthrough economics, saving enterprises up to 90% rupting services, providing new levels of flexibility, availability, and performance. over closed, proprietary storage. • Licensing fees. OpenSolaris and related In terms of scalability, ZFS software is a 128-bit file system that provides 16 billion, data services software, such as snapshot billion times the capacity of 32- or even 64-bit file systems. It supports more file and remote replication, are free to use systems, snapshots, and files in a file system than can possibly be created in the without licensing fees. On the other foreseeable future. hand, technologies from competitors like EMC or NetApp carry expensive license ZFS software also provides the data services needed to protect data far beyond what fees, often carrying list prices in the tens of thousands of dollars, significantly exists today in traditional storage systems. It saves enterprises money by maintain- increasing the initial cost of their ing data redundancy on commodity hardware through the delivery of basic mirror- solutions. ing, compression, and integrated volume management. It supports new hybrid disk- • Acquisition cost. Proprietary disks such storage devices that include Flash technology for greater performance. And it also as the EMC CLARiiON are marked up 5x compared to market-priced disks. Enter- combines proven, cutting-edge technologies to ensure data integrity; while most file prises can save up to 90% with a Sun Fire systems do nothing to check the integrity of data on the disks, ZFS software checks x4500 ($1.29/GB) vs. comparable disks in the data continuously to guard against silent corruption. EMC Symmetrix with SATA ($11.78/GB) or EMC CLARiiON tier 3 SATA ($3.44/GB) for Vendors of closed, proprietary storage appliances typically charge customers extra a 62% savings. (Note: this is only software licensing fees for data management services like administration, replica- acquisition cost.) • Investment protection. With open tion, and volume management. Because ZFS software is part of the OpenSolaris OS, source, there is no cost to acquire and those additional costs, complexities, and unnecessary layers are eliminated. no vendor lock-in. Because enterprises pay at the point of value (hardware, war- OpenSolaris COMSTAR ranty, and services), this model protects investments and turns software into With OpenSolaris COMSTAR (Common Multiprotocol SCSI TARget), an enterprise IT operational costs. department can turn any standard server into a storage device, delivering significant • Virtualization. With Sun Open Storage, cost savings. COMSTAR is a software framework that offers the functionality of a enterprises can apply server virtualiza- SCSI target device that can be accessed over the network, essentially allowing an tion techniques to storage infrastructure, allowing flexibility and choice for where enterprise to create a storage array from standard computing server and storage they run data services and saving energy, components. space, and expense while increasing utilization rates. Sun’s virtualization Solaris DTrace solutions combine energy-efficient Sun servers, storage, software, and profes- Solaris DTrace is a comprehensive, advanced tracing tool for troubleshooting sional services which have been proven systemic problems in real time. With DTrace, administrators, integrators, and to reduce IT costs by as much as $2M/ developers can tune applications for performance and troubleshoot production year1, achieve 99.99% availability, and systems—all without requiring the production system to be taken offline and improve system utilization to as high as 85%. without impacting performance. (Continued on Page 5) Solaris Fault Management Architecture As storage data grows, there is an increasing chance of media and subsequent hardware failures. The OpenSolaris community is continuing the development and refinement of the Solaris 10 Fault Management Architecture (FMA) by adding disk 1 The $2 million claim is based upon Sun consolidation customers’ average savings over an 18-24 month period. Cus- tomers calculated savings based on energy, space, licensing, services contract costs, increased utilization and reduction of management of systems.
  7. 7. 5 Sun Open Storage Sun Microsystems, Inc. (Continued from Page 4) failure diagnosis, which includes quick identification of faulty drives and preventative measures. • Eco Efficiency. Sun offers systems, storage, software, and services that FMA provides automatic monitoring and diagnosis of I/O subsystems and hardware yield tremendous savings in terms of energy, materials, space, and labor. For faults and facilitates a simpler and more effective end-to-end experience for system example, an OpenSolaris hybrid stor- administrators. This is achieved by isolating and disabling faulty components and age pool (HSP) running on a four-way then continuing the provision of service through a reconfiguration of redundant quad-core Intel® Xeon® platform with paths to data—even before an administrator knows there is a problem. five 400GB 5400 RPM drives, one 80GB read-optimized flash drive, and one 32GB write-optimized flash drive, used 4.9x Extending the Value of Open Storage less power than an equivalent server to Hardware Components platform running seven 146GB 10,000 Sun Open Storage solutions leverage the influence of a community of passionate RPM SAS drives. The HSP also delivered a 3.2x improvement in read IOPS and an open-source software developers as well as more than 25 years of Sun’s on-going 11% improvement in write IOPS. (Perfor- innovation in server, storage, and software technologies. With Sun Open Storage, mance numbers will vary depending on enterprises can freely mix, match, and maximize software and datacenter compo- the specific workload.) nents and even repurpose and reuse hardware simply by adding new software. • Assessment Services. Sun’s storage experts can help architect cost-effective Because it’s not always economically feasible to swap out old systems in order to storage infrastructures tailored to each organizations’ specific needs. For exam- upgrade performance or add capacity, Sun Open Storage solutions offer enterprises ple, by utilizing Sun Storage Assessment virtually unlimited file system capacity (through the open-source ZFS software) services, KnowledgeBase Marketing and can scale throughput well beyond that of traditional, proprietary storage reduced storage TCO by 40%, administra- solutions—at a fraction of the cost. tion time by 50%, and transaction costs by 86%.2 By combining proven open-source software with industry-standard hardware, Sun Open Storage enables enterprises to: • Select the software and hardware components that meet their needs • Reduce their reliance on high-priced systems and save up to 90% on storage cost • Gain massive scalability to enable fast response to unpredictable Web data growth • Simplify deployment and management • Improve service levels through tuning and real-time diagnostics and workload analysis • Quickly reconfigure systems to independently increase compute power, storage capacity, or performance 2 To find out more, see
  8. 8. 6 Sun Open Storage Sun Microsystems, Inc. Sun Open Storage solutions allow enterprises flexibility in designing their storage infrastructures as well as cost savings compared to proprietary storage solutions. Businesses can leverage the innovation available in Sun’s open-source software, including advanced tools for optimizing performance and simplifying storage management, use only the components that fit their needs, and add new capabili- ties easily and without the high prices charged by proprietary vendors. And because industry-standard hardware can adopt next-generation technologies faster—with the additional benefit of fair market pricing through competition—enterprises can realize consistently higher performance at a lower cost with open-storage systems than with closed systems. To accommodate different business and technical needs, Sun offers both industry- standard open-storage components and, for enterprises that want a complete solution out of the box, fully integrated and optimized storage appliances such as the Sun™ Storage 7000 Unified Storage Systems, which include one of the industry’s most powerful, easy-to-use management software solutions. Complete, Enterprise-Ready Storage Solutions: Hardware Innovation That Fully Leverages Open Source While some enterprises may want to build their own storage infrastructure using Sun’s open-source software and industry-standard hardware, others want the cost- effectiveness and flexibility of open-source technologies in a complete, enterprise- ready storage offering. The Sun Storage 7000 Unified Storage System offers a turnkey storage solution specifically designed to leverage the powerful features of the Open- Solaris OS, bringing the promise and benefits of open storage to the enterprise. Sun Storage 7000 unified storage systems are powerful storage appliances that utilize low-cost commodity disks, enabling enterprises to scale performance along with capacity without expensive, high-speed disk drives. These appliances are the only storage systems that also fully exploit Flash storage technology by taking advantage of hybrid storage pools in Solaris ZFS software as well as a range of other unique technologies in the OpenSolaris OS. Unlike other storage solutions that charge for each additional storage feature, all Sun Storage 7000 unified storage systems include comprehensive data services at no extra cost, including snap/clone, restore, mirroring, RAID-5, RAID-6, replication, active-active clustering, compression, thin provisioning, CIFS, NFS, iSCSI, HTTP/FTP, and WebDAV. The unique design of these systems also enables enterprises to benefit from continuous innovation when new data services and features are available from Sun through included automated updates.
  9. 9. 7 Sun Open Storage Sun Microsystems, Inc. Sun Storage 7000 unified storage systems provide: • Simplified management. Sun Storage 7000 series products are fully integrated appliances that can be installed and configured in less than five minutes in some cases. The graphical user interface is extremely intuitive and simple to use and administer. • Breakthrough economics. By leveraging open-source software and open-standards hardware components, the Sun Storage 7000 series achieves breakthrough economics for enterprise customers in today’s turbulent economy with: • Lower cost • Lower power consumption • No software licensing fees • Faster innovation compared to proprietary systems • DTrace Analytics. The industry’s only comprehensive and intuitive analytics environment, DTrace Analytics provides all the tools administrators need to quickly identify and diagnose system performance issues, perform capacity planning, and debug live storage and networking problems before they become challenging for the entire network. Available only with Sun Storage 7000 unified storage systems, DTrace Analytics gives administrators the ability to easily drill down for in-depth analysis of Web infrastructure storage subsystems. Built-in instrumentation provides real-time visibility throughout the data path, making it much faster and easier to pinpoint performance bottlenecks—even those that may not be related to the storage system. • Hybrid storage pools. Sun Storage 7000 series products are the only storage systems with hybrid storage pools that combine DRAM, write-optimized solid-state drives (SSDs), and read-optimized SSD with high-capacity, low-cost, enterprise- class SATA drives. Hybrid storage pools use Solaris ZFS software to optimize and manage them transparently as a single hierarchy. This new storage design uses the low latency of SSDs to increase performance for both write- and read-oriented applications, delivering superior performance and high capacity with lower cost and energy consumption. • Self-healing storage. The Sun Storage 7000 series includes Failure Management Architecture (FMA), which provides the capability to detect and take faulty hard- ware components offline in order to prevent system disruption. FMA combined with ZFS data integrity facilities makes the Sun Storage 7000 the most comprehensive self-healing unified storage system available.
  10. 10. 8 Sun Open Storage Sun Microsystems, Inc. SuN STORAGE 7000 EMC CELERRA NETAPP FAS OPERATING SySTEM Open-source, Proprietary DART Proprietary Data enterprise-class ONTAP OpenSolaris DATA SERVICES No separate Additional license Additional license SOFTWARE licensing fees fee for most fee for most options options FLASH/SSD Yes, through ZFS Yes: Flash as Tier 0 Not available OPTIMIzED and hybrid storage (no hybrid pools storage pool) ANALyTICS Robust, real-time Limited reporting Limited reporting analytics through through Celerra available DTrace Manager Sun Storage 7000 vs. Proprietary Systems Sun Fire™ X4540 Storage Server: Tapping the Power of ZFS The Sun Fire™ X4540 Storage Server is the first open-storage server that integrates industry-standard server hardware and storage components in an open architecture and leverages the open source-based Solaris ZFS software RAID, which maintains data redundancy without the expense of a hardware RAID controller or NVRAM. The Sun Fire X4540 server delivers the highest storage density and data throughput with a built-in, high-performance compute engine at half the cost and up to 50% power savings compared to traditional servers and storage arrays. When compared to a typical storage controller, the Sun Fire X4540 server offers significant cost savings and more power: PROPRIETARy 2u STORAGE CONTROLLER 2u x64 SuN FIRE x4540 SERVER 1-2 CPU sockets 4 CPU sockets 2-4 CPU cores 16 CPU cores 4 GB DRAM 64-128 GB DRAM 1 GB NVRAM 4x1GB Ethernet 4x1GB Ethernet 4-6x PCI-X or PCIe 4-6x PCIe Cost: $40,000 to $50,000 Cost: $12,000 to $24,000
  11. 11. 9 Sun Open Storage Sun Microsystems, Inc. The Sun Fire X4540 storage server is a great fit for applications that take advantage of the close proximity of data to compute resources, such as HPC storage clusters utilizing Lustre (an open-source file system available from Sun designed for high- performance Linux compute clusters), high-performance data warehousing, video streaming and video surveillance, and data backup on disk. A very versatile storage system, the Sun Fire X4540 storage server fits seamlessly in file-based storage architectures with NFS and CIFS, iSCSI storage systems, and FC-based SAN storage environments. How to Get Started with Sun Open Storage 1. If they haven’t already, ask your developers to download and experiment with OpenSolaris through the storage community at storage/. They can also join the community and help create new innovations in storage software. 2. Try out Sun storage solutions free of charge through the Sun Try and Buy program at For more information on Sun Open Storage, see Sun Open Storage Customer Success Story Wikimedia Foundation Ensures Data Integrity for Ever-Expanding Online Resources Founded in 2001, the Wikimedia Foundation hosts a variety of wikis, including Wiktionary, Wikiquote, and Wikimedia Commons—but by far it is best known for Wikipedia, the free online encyclopedia. Among the 10 most visited Web sites in the world, Wikipedia had nearly 250 million unique visitors in October 2008. Articles are written and edited by more than 100,000 volunteer editors worldwide and in total, the site hosts 11 million articles in 265 languages. The Web site receives between 25,000 and 60,000 page requests per second, depending on the time of day. Wikimedia needed to update its infrastructure to handle this huge volume of traffic and ensure that its systems were reliable, highly available, and easily scalable. It also wanted to expand its upload file limit from 20 MB to 100 MB to accommodate rich media (audio and video) content—but before it could do that, Wikimedia needed to expand its storage capacity. The foundation acquired Sun Fire X4150, Sun Fire X4240, and Sun Fire X4540 servers running the Solaris 10 Operating System and MySQL™ open-source database soft- ware. The Sun Fire 4540 storage server provides low-cost, high-density storage and eight-way processing in a single enclosure. “We looked at other vendors, but they couldn’t get up to the scale we wanted,” says Brion Vibber, chief technology officer
  12. 12. 10 Sun Open Storage Sun Microsystems, Inc. at the Wikimedia Foundation. “They didn’t offer support like ZFS backups, snapshot- ting and self-healing; or they were just incredibly expensive SAN systems that were totally proprietary.” Data integrity was one of the Wikimedia Foundation’s primary concerns. On their Linux servers, data was backed up to direct-attached RAID arrays. “If a disk failed, we could replace it, but if a whole machine died, we were out of luck. We needed a way to keep a standby disk active,” says Vibber. On the Sun Fire X4540 servers, which are configured in pairs, Wikimedia uses Solaris ZFS replication to ensure data integrity. “With ZFS, we’re able to replicate in real time and store multiple backup snapshots on each server,” Vibber says. “It’s a big improvement because we no longer worry about losing all of our work if a system fails.” It was also very difficult for Wikimedia to expand storage with the configuration it had—but Sun’s Open Storage approach changed that, too. “When we needed more storage, we would add another Linux box with a big RAID array, and then copy directories around and split up everything manually,” says Vibber. “Now with ZFS, we can add disks and extend the ZFS pool, and we’re done—the space is instantly available. It doesn’t require us to replace everything if we need to expand, and we’re very happy about that.”
  13. 13. Sun Open Storage Sun Microsystems, Inc. Sun Microsystems, Inc. 4150 Network Circle, Santa Clara, CA 95054 USA Phone 1-650-960-1300 or 1-800-555-9SUN (9786) Web © 2009 Sun Microsystems, Inc. All rights reserved. Sun, Sun Microsystems, the Sun logo, OpenSolaris, Solaris, ZFS, Sun Fire, and MySQL are trademarks or registered trademarks of Sun Microsystems, Inc. or its subsidiaries in the United States and other countries. Printed in USA 05/09 #XXXXX