0
HIGH PERFORMANCE TECHNICAL COMPUTING HARDWARE. SOFTWARE. SERVICES. DESIGNED TO WORK TOGETHER Optimized Hadoop™ Solutions L...
SGI – Brief History <ul><li>Experts in Scale-Out datacenters - since 1998 </li></ul><ul><li>Better “Internet” servers, 40-...
SGI Technology @ Work DIGITAL MEDIA CLOUD ENERGY FINANCIAL SERVICES DEFENSE & INTELLIGENCE MANUFACTURING RESEARCH & EDUCAT...
Past and Current Customers
SGI Compute Leading solutions from scalable entry to hyper-scale and cloud Shared Memory High Performance InfiniBand Scale...
SGI “Rackable” servers at one of our customers … a well known Internet company
SGI Storage Leading solutions from cost to scalability and performance RAID Systems Persistent Data Cloud Systems Integrat...
Factory Integrated
Modular Data Centers: ICE Cube™ 1 Self-contained datacenter Power distribution, cooling, safety Eco-logical :  PUEs up to ...
Hadoop “Big Data” Solutions <ul><li>Hadoop = BI and Data Analysis on Large Clusters </li></ul><ul><li>Method: </li></ul><u...
Building Hadoop Solution with SGI <ul><li>Based on Servers with internal balanced CPU / memory / local storage; and balanc...
SGI Hadoop Servers Sample hardware config -  Component Qty Details Chassis 1 Rackable C2005 Motherboard 1 Intel Hanlen Cre...
Resources <ul><li>Hadoop Solutions Brief on  http://www.sgi.com/go/hadoop/ </li></ul><ul><li>White Paper:  Increased Hadoo...
Summary  <ul><li>SGI servers are used in many large Hadoop clusters </li></ul><ul><li>SGI offers Turn-key Hardware and Sof...
Sgi hadoop
Upcoming SlideShare
Loading in...5
×

Sgi hadoop

1,238

Published on

Overview from our sponsor, SGI on some of the solutions they have, and how they can be used to power datacenter and cluster scenarios

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,238
On Slideshare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
27
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide
  • SGI customers are not only household names – they are among the world’s most demanding, innovative and forward thinking organizations. In our Fiscal Year 2010, our notable successes with many of these customers enabled us to demonstrate SGI’s clear strengths across our major industries: Our Government business is comprehensive and well established across the intelligence communities, defense organizations, civilian agencies, national laboratories, and leading national universities. We won business at NASA, the National Institute of Health, the Defense Intelligence Agency, Los Alamos, and leading US Intelligence Agencies. We also continued to build upon our strong relationships within federal system integrators including Raytheon, CSC, Northrop Grumman, Lockheed Martin and others. Our Cloud and Internet business remained strong, and we are participating in the industry’s current tech refresh cycle and cloud infrastructure build-out trends. Our larger deployments in FY10 included Amazon, Microsoft, eBay and Motorola. SGI is also winning within process and discrete Manufacturers as they increase their spending to introduce new products or improve existing ones. Notable wins included Skoda, Audi, Sikorsky and Boeing. Our business within Higher Education and Research delivered incredible wins, such as with Professor Stephen Hawking at Cambridge University, the Institute of Cancer Research, A*STAR, the University of Minnesota, and the Pittsburgh Supercomputing Center. We have also seen growing customer adoption within Financial Services, Telecommunications, Media and Entertainment, and Earth and Life Sciences - with highlights including Unicom, British Telecom, National Geographic, the NBA, Novo Nordisk and Merck.
  • Looking specifically at SGI’s compute platforms, these include leading solutions for requirements ranging from scalable entry-level to hyper-scale and cloud environments. Large-scale data center: Solutions for large-scale data center deployments include CloudRack, Foundation and XE solutions combining extreme density with breakthrough Eco-Logical energy efficiency for cluster computing. SGI Built to Order processes also ensure the solutions are tailored to the customer’s computing environment, optimized to support their specific applications, and ready for immediate integration. Shared memory: Altix UV, the world’s fastest, most scalable shared memory supercomputer family, scales from 32 to 2,048 cores (with architectural provisioning for up to 262,144 cores) and supports up to 16TB of global shared memory in a single system image. It enables users to optimally size their systems to achieve the correct balance of compute, memory, I/O and storage capabilities, and scale up as performance requirements grow, while preserving initial investments. Scalable entry: SGI’s scalable entry-level solutions include: Octane III - SGI’s first personal supercomputer, which combines the power of a high performance deskside cluster with the portability and usability of a deskside workstation. CloudRack X2 – a unified enclosure combining extreme densities with breakthrough energy efficiency for cluster computing, making it an ideal workgroup cluster. Origin 400 – a fully integrated compute/storage solution for workgroups, remote offices and SMEs, which functions seamlessly as a web server, applications server, email server and backend database server. High performance InfiniBand: High performance InfiniBand solutions include XE clusters; Altix ICE - which features optional blade enclosure models supporting hypercube, enhanced hypercube, all-to-all and fat-tree topologies; Intel and AMD processor options; and multiple QDR networking options enabling each Altix ICE deployment to be as efficient as possible; and the SGI Prism™ XL platform which is an optimized, accelerator scale-out architecture combining optimal density and bandwidth (both node and IB networking).
  • Turning to SGI’s storage solutions, these include a comprehensive range of platforms optimized for requirements including cost, scalability and performance – together with file systems and software meeting diverse customer needs. Cloud systems: For cloud applications, SGI’s half-depth InfiniteStorage 1000 series and standard-depth 2000 series EBOD solutions provide flexible, reliable and cost-effective external storage expansion for a wide range of performance and capacity-oriented storage environments. RAID systems: SGI’s RAID platforms scale from entry-level solutions optimized for price/performance, through enterprise-class solutions to high-end solutions delivering the ultimate in performance and throughput for demanding HPC applications. InfiniteStorage 5000 combines leading edge hardware with a choice of host interfaces and drive technologies in an affordable external storage platform. InfiniteStorage 4100 extends 8Gb Fibre Channel to SGI&apos;s mid-range storage offering, with connectivity and extensive interoperability enabling it to integrate seamlessly into existing or new infrastructures. InfiniteStorage 4600 can be seamlessly integrated into any HPC enterprise environment to meet the exacting requirements of data intensive applications, high I/O workloads and large scale consolidation and virtualization. InfiniteStorage 6120 is an ultra-dense, high performance storage system appropriate for a wide variety of data storage requirements. InfiniteStorage 15000 combines industry leading performance for bandwidth intensive applications with the next step in storage density, offering high bandwidth and archival storage needs in a single system. Integrated storage servers: SGI’s shared storage platforms efficiently scale storage capacity, file directory size and performance. They include NAS gateways designed to consolidate existing NAS, SAN or RAID storage in a single heterogeneous framework for applications ranging from entry-level file sharing to high performance, enterprise class environments; and InfiniteStorage Server 3500, an integrated storage server designed to provide a flexible, cost effective storage platform for a wide variety of customer needs. Persistent data: SGI’s persistent data storage solutions include the energy-efficient COPAN line, and Spectra Logic tape libraries. Available in MAID (Massive Array of Idle Disks) and VTL (Virtual Tape Library) configurations, the COPAN platform marks a dramatic improvement in performance, density, and the ability to manage extremely large volumes of persistent data at significant savings in power utilization, compared to conventional arrays. Software: SGI offers support for: The Lustre high performance shared file system for scale out applications. The CXFS high performance shared file system for scale up applications. The XFS file system for SGI systems ranging from desktop workstations to supercomputers. DMF, which creates and automatically manages a tiered virtual storage environment that can significantly reduce equipment and operating costs, improve service levels and lower risks. The LiveArc digital asset and knowledge management platform.
  • ICE Cube is a self-contained and fully portable data center that revolutionizes fundamental data center design principles through its modularity and deployment flexibility. Yields substantial business and technological advantages compared to traditional brick-and-mortar data centers. Meets capacity demands with a just-in-time solution. Minimizes up-front capital costs and cuts operational expenditure through industry-leading power efficiencies and up to 80% reduction in cooling costs. Multiple container models provide the configurability to address varying IT and site requirements, while delivering extraordinary density levels of up to 46,080 computational cores or 29.8 petabytes of storage per container. Ideal for a wide range of deployment scenarios including augmenting or replacing traditional data centers of any size, as disaster recovery sites, field deployed compute or storage assets, or to address spikes in IT demand. In Dec, 2010, SGI introduced ICE Cube® Air which is a ‘from the ground up’ designed as an MDC, departing from some of the limitations of ISO containers. ICE Cube Air also using air-cooling (with supplemental evaporative cooling) as the main cooling mechanism vs. chilled water in the main ICE Cube line. 82% of locations around the world can use air-cooling with evaporative. DX or water-chilling as options can fill out the other locations. ICE Cube Air also offers a unique expansion capability, allowing you to start with only 4 racks under cover for $99K, progressing out to 80 racks in off the shelf (OTS) designs and potentially 100’s of racks through our Design to Order (DTO) process. As with our ICE Cube line, ICE Cube Air can be deployed worldwide with many support and services offerings.
  • And in March 2011 SGI introduced ArcFiniti™, a revolutionary new archive solution to address the exploding problem of unstructured, file-based archiving. With this fully-integrated platform, SGI can now offer to the general IT market an easy-to-deploy solution that leverages the company’s powerful tools for managing and protecting some of the world’s largest data repositories.
  • And in March 2011 SGI introduced ArcFiniti™, a revolutionary new archive solution to address the exploding problem of unstructured, file-based archiving. With this fully-integrated platform, SGI can now offer to the general IT market an easy-to-deploy solution that leverages the company’s powerful tools for managing and protecting some of the world’s largest data repositories.
  • And in March 2011 SGI introduced ArcFiniti™, a revolutionary new archive solution to address the exploding problem of unstructured, file-based archiving. With this fully-integrated platform, SGI can now offer to the general IT market an easy-to-deploy solution that leverages the company’s powerful tools for managing and protecting some of the world’s largest data repositories.
  • Transcript of "Sgi hadoop"

    1. 1. HIGH PERFORMANCE TECHNICAL COMPUTING HARDWARE. SOFTWARE. SERVICES. DESIGNED TO WORK TOGETHER Optimized Hadoop™ Solutions Lior Paster, Technical Sales Executive, [email_address] NASDAQ-OMX: SGI
    2. 2. SGI – Brief History <ul><li>Experts in Scale-Out datacenters - since 1998 </li></ul><ul><li>Better “Internet” servers, 40-50% lower power draw </li></ul><ul><li>Invented “half-depth” servers </li></ul><ul><li>Pioneered “back to back” rack mount for double density with optimized air flow </li></ul><ul><li>Invented “front facing I/O” to eliminate user errors </li></ul><ul><li>Invented “rack-and-roll” for faster time to results </li></ul><ul><li>Invented high efficiency “datacenter containers” </li></ul><ul><li>Largest Hadoop clusters </li></ul><ul><li>~ $750M Annual Sales, and growing </li></ul><ul><li>US-Based: HQ Fremont CA, Manufac. Chippewa Falls WI </li></ul>
    3. 3. SGI Technology @ Work DIGITAL MEDIA CLOUD ENERGY FINANCIAL SERVICES DEFENSE & INTELLIGENCE MANUFACTURING RESEARCH & EDUCATION … AND MORE
    4. 4. Past and Current Customers
    5. 5. SGI Compute Leading solutions from scalable entry to hyper-scale and cloud Shared Memory High Performance InfiniBand Scale-Out Datacenter Scalable Entry CR Rackable™ UV 10 UV 100 UV 1000 Cloud, Big data, Scale Eco-Logical Density BTO Large Memory Big Data Fast I/O Rackable ICE Capability Capacity Cost-Optimized Multi-Topology Choice Office friendly Self-contained Scalable Low IT needs CR X2 Origin® 400 Prism XL
    6. 6. SGI “Rackable” servers at one of our customers … a well known Internet company
    7. 7. SGI Storage Leading solutions from cost to scalability and performance RAID Systems Persistent Data Cloud Systems Integrated Storage Servers IS1000 Short-lived data Cost optimized Redundancy Software RAID COPAN™ <ul><li>Long life data </li></ul><ul><li>Integrated, file accessible </li></ul><ul><li>Large Capacity </li></ul><ul><li>Eco-logical </li></ul><ul><li>High Density </li></ul><ul><li>Half & Standard Depth </li></ul><ul><li>File serving </li></ul><ul><li>App Appliance </li></ul><ul><li>Cost or Performance optimized </li></ul>ISS3500 Software: File systems (Lustre, CXFS™, XFS®), DMF, LiveArc™ IS2000 Entry Level (IS5000) Price/Performance Leader Enterprise RAID (IS4600) Balanced Price/Performance HPC RAID (IS6120/15k/16k) Ultimate Performance/Throughput ArcFiniti™ ISS3012
    8. 8. Factory Integrated
    9. 9. Modular Data Centers: ICE Cube™ 1 Self-contained datacenter Power distribution, cooling, safety Eco-logical : PUEs up to 1.02 Air, Evaporative, DX and Water-Chilled Cooling Options Economical 1/5 the cost of a traditional datacenter 2 3 4 5 Simple and easy to deploy Go-Live in 5 days Universal Support for SGI and all Tier-1 Hardware
    10. 10. Hadoop “Big Data” Solutions <ul><li>Hadoop = BI and Data Analysis on Large Clusters </li></ul><ul><li>Method: </li></ul><ul><ul><li>Data and Compute are distributed over many nodes </li></ul></ul><ul><ul><li>Data and Compute sit on each cluster node </li></ul></ul><ul><ul><li>(as opposed to traditional method of separate data and compute, monolithic SAN, large compute…) </li></ul></ul><ul><li>SGI has deployed thousands of Hadoop servers </li></ul><ul><li>SGI uses CloudRack, Rackable, ICE OPTIMIZED architectures - </li></ul><ul><ul><li>performance, utilization, lower power, and lower cost </li></ul></ul><ul><li>+ = complete turn-key solutions to help customers architect and deploy Hadoop ASAP </li></ul>
    11. 11. Building Hadoop Solution with SGI <ul><li>Based on Servers with internal balanced CPU / memory / local storage; and balanced networking infrastructure. </li></ul><ul><li>We installed both INTEL and AMD solutions. </li></ul><ul><li>We have recommended configurations </li></ul><ul><li>Popular solution: Rackable C2005 half-depth chassis </li></ul><ul><ul><li>2U design, optimizes airflow </li></ul></ul><ul><ul><li>High density </li></ul></ul><ul><ul><li>Great flexibility: up to 15TB storage, 144GB RAM, 24 cores... </li></ul></ul><ul><li>A great feature when the datacenter is power-constrained - SGI is capable of power-capping individual servers AND complete racks with SGI Management Center and Intel Power Node Manager. </li></ul>
    12. 12. SGI Hadoop Servers Sample hardware config - Component Qty Details Chassis 1 Rackable C2005 Motherboard 1 Intel Hanlen Creek CPU 2 Intel Xeon L5640 6-core Memory 12 8GB DDR3 1333 Disk 5 2TB SATA 3.5” 7.2KRPM
    13. 13. Resources <ul><li>Hadoop Solutions Brief on http://www.sgi.com/go/hadoop/ </li></ul><ul><li>White Paper:  Increased Hadoop™ Optimization Using Intel®-based SGI® Rackable™ Solutions </li></ul><ul><li>Press Release:  SGI Establishes New World Record Apache Hadoop Benchmark </li></ul><ul><li>Press Release:  Cloudera and SGI Partner to Take High Performance Computing on Apache Hadoop to the Next Level </li></ul><ul><li>Technical Sales Assistance – </li></ul><ul><ul><li>[email_address] </li></ul></ul><ul><ul><li>http://www.linkedin.com/in/liorpaster </li></ul></ul><ul><ul><li>www.twitter.com/x86world </li></ul></ul>
    14. 14. Summary <ul><li>SGI servers are used in many large Hadoop clusters </li></ul><ul><li>SGI offers Turn-key Hardware and Software for Hadoop, with Cloudera </li></ul><ul><li>Most optimized solution </li></ul><ul><li>Local sales team and support </li></ul>
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×