Your SlideShare is downloading. ×
Sun fire x2100 m2 and x2200 m2 technical presentation
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Introducing the official SlideShare app

Stunning, full-screen experience for iPhone and Android

Text the download link to your phone

Standard text messaging rates apply

Sun fire x2100 m2 and x2200 m2 technical presentation

780
views

Published on

Published in: Technology

0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
780
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
14
Comments
0
Likes
1
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Sun Fire X2100/X2200 M2 TechnicalProduct Training PresentationSunWin Token # 478550 Ronald Graham Systems Group Technical Marketing Sun Microsystems
  • 2. Agenda • Introduction and Positioning • Server Architecture > Sun Fire X2200 > Sun Fire X2100 > Enabling Technologies • Embedded Light Out Management • Operating Systems • System and Upgrade Options2 Sun Confidential : Sun/Partners Use Only
  • 3. Sun’s x64 System Portfolio Systems Refresh Throughout 2008 Sun Grid Sun Blade 6048 Rack System Sun Blade 8000 Sun Blade 6000 Voted “Best High Perf First & Only Server” Sun Fire New 8-socket/16-way InfoWorld Sun Fire X4500 Hybrid Data AMD Server X4600 X4540 Server Sun Fire X4250 Sun Fire X4450 Sun Fire X4150 Sun Fire X4140 Sun Fire X4440 Sun Fire X4200 Voted X4240 X4100 “Best Enterprise Server” InfoWorld Sun Fire X2100 Sun Fire X2250 Sun Fire X2200 Ultra 40 Ultra 203 Sun Confidential : Sun/Partners Use Only
  • 4. Sun Fire Features Summary Features Sun Fire X2100 M2 Sun Fire X2200 M2 Form Factor 1U 1U Processor 1x Dual-Core AMD Opteron processor Model 1200 CPU Up to 2 Dual-Core or Quad-Core AMD Opteron 2000 series processors w/ 1MB L2 Cache per Core w/ 4x 128 KB L1, 4x 512 KB L2, and 2MB or 6MB of shared L3 Cache BIOS AMI BIOS AMI BIOS Memory DIMM slots 4 DIMM slots 8 DIMM slots per CPU Memory Types DDR-2 667MHz Un-bufferred DIMMs with ECC DDR-2 667MHz Registered DIMMs with ECC Memory Module Sizes 512MB, 1GB, 2GB DIMMs 1GB,2GB, 4GB DIMMs Max Memory 8 GB 64 GB HDD Controller Integrated Nvidia MCP55 Integrated Nvidia MCP55 Serial ATA II Serial ATA II HDD Type 3.5-inch drives 3.5-inch drives HDD Number 2 HDDs 2 HDDs Optical Drive DVD-ROM DVD-ROM NIC Controller Dual Integrated nVidia MCP55 Dual Integrated nVidia MCP55 Broadcom BCM5715C Broadcom BCM5715C NICs Four Gigabit Ethernet NICs Four Gigabit Ethernet NICs Graphics Controller AST2000 AST2000 Expansion Slots Two PCI-E x8 Slots Two PCI-E x8 Slots (or One PCI-E x16 Slot by optional Riser Q4CY06) (or One PCI-E x16 Slot by optional Riser Q4CY06) Front I/O Six USB 2.0 ports Six USB 2.0 ports Four Gigabit Ethernet ports (RJ45) Four Gigabit Ethernet ports (RJ45) One RS-232 Serial (DB9) One RS-232 Serial (DB9) Rear I/O Four USB 2.0 ports (Type A) Four USB 2.0 ports (Type A) VGA Video port (HD15) VGA Video port (HD15) Power supply Single 345Watt Single 450Watt Service Processor supporting Graphics redirection, Remote Service Processor supporting Graphics redirection, Remote Systems Management Floppy/CD/DVD, IPMI 2.0, SNMP, CLI and Web interface Floppy/CD/DVD, IPMI 2.0, SNMP, CLI and Web interface OS Support Solaris, Linux and Windows Solaris, Linux, Windows, and VMware4 Sun Confidential : Sun/Partners Use Only
  • 5. Agenda • Introduction and Positioning • Server Architecture > Sun Fire X2200 > Sun Fire X2100 > Enabling Technologies • Embedded Light Out Management • Operating Systems • System Options5 Sun Confidential : Sun/Partners Use Only
  • 6. Sun Fire X2200 M2 The 1U Server Workhorse Compute ● Dual- or Quad-Core ● 1 or 2 AMD Opteron™ 2000 series processors ● 1U-rackmount ● Up to 64GB with 16 DIMM Slots (4 GB DIMMs) I/O ● 2 x 8-lane PCI Express slots (Optional 1 x 16-Lane) ● 4 x GigE standard, USB 2.0, Video, Serial ports ● DVD ● Up to 2 TB of storage with 2 x SATA 3.5” disk drives Availability Hot-pluggable disk One of the Industrys Fastest 2-socket Server for ● ● RAID 0 or 1 (Optional) processing memory-intensive applications Management ● Embedded LOM Service Processor Ideal for Web Infrastructure, HPC, ● Remote power on/off/status, GUI+CLI, IPMI 2.0, SNMP Simulations, Financial Modeling ● Remote KVM, Floppy/CDROM Excellent for EDA Operating Environment ● Solaris, Linux, Windows, Vmware6 Sun Confidential : Sun/Partners Use Only
  • 7. Sun Fire X2200 M2 System Layout7 Sun Confidential : Sun/Partners Use Only
  • 8. X2200 Architectural Block Diagram 8 SATA II only 8 DDR-2 AMD Opteron 2000 DDR-2 Rear DIMMS AMD Opteron 2000 Series CPU Series CPU DIMMS Panel Slots Slots Marvell nVidia DDR-2 DDR-2 nVidia NIC 1 88E1121 NIC 0 5.3GB/s 5.3GB/s PHY HT bus Marvell 88E1121 nVidia DDR-2 (8GB/s) DDR-2 NIC 1 5.3GB/s 5.3GB/s nVidia NIC 0 PHY HT bus (8GB/s) Rear 4 x USB 2.0 USB Ports x16 PCI-E bus (4GB/s) Dual x8 PCI-E Riser USB 2.0 or Serial USB 2.0 Port Single x16 PCI-E Riser Serial MCP55 DB9 PCI 32bit/33MHz Rear SATA II 3.0Gb/s VGA VGA LPC bus Video HD15 SATA II 3.0Gb/s UMP Port BIOS SuperIO 2 x USB 2.0 Ultra FLASH Legacy BCM ATA 133 PROM Device NIC 0 x4 PCI-E bus (1GB/s) BCM Front NIC 1 Panel 3.5”SATA 3.5”SATA Shared Disk Drive Disk Drive Front Panel Tray Load ELOM NIC DVD ROM USB Ports Confidential : Sun/Partners Use Only8 Sun Port
  • 9. X2200 Architectural Block Diagram HBA – SATA II or SAS 8 8 DDR-2 AMD Opteron 2000 DDR-2 Rear DIMMS AMD Opteron 2000 Series CPU Series CPU DIMMS Panel Slots Slots Marvell nVidia DDR-2 DDR-2 nVidia NIC 1 88E1121 NIC 0 5.3GB/s 5.3GB/s PHY HT bus Marvell 88E1121 nVidia DDR-2 (8GB/s) DDR-2 NIC 1 5.3GB/s 5.3GB/s nVidia NIC 0 PHY HT bus (8GB/s) Rear Single x16 PCIe Riser 4 x USB 2.0 USB or Ports Dual x8 PCIe Riser x16 PCI-E bus (4GB/s) USB 2.0 Serial USB 2.0 Port Serial HBA MCP55 DB9 PCI 32bit/33MHz Rear SATA II or SAS VGA VGA LPC bus Video HD15 UMP Port SATA II or SAS BIOS SuperIO Ultra FLASH Legacy BCM 2 x USB 2.0 ATA 133 PROM Device NIC 0 x4 PCIe bus (1GB/s) BCM NIC 1 Front 3.5”SATA or 3.5”SATA or Panel Shared Front Panel Tray Load ELOM NIC SAS Disk Drive SAS Disk Drive DVD ROM USB Ports Confidential : Sun/Partners Use Only9 Sun Port
  • 10. Sun Fire X2200 M2 Internals Tour CPU0 & 8x CPU1 & 8x Memory Slots PCI-Express Memory/PCI Fans Memory Slots Riser Area Disk 0 Front Panel PCB Serial & Video ports CD/DVD Drive Nvidia NICs & USB portsDisk 1 Broadcom NICs Dual CPU/memory Embedded SP nVidia MCP55 Power Supply10 Blowers Sun Confidential : Sun/Partners Use Only
  • 11. Sun Fire X2200 M2 Motherboard CPU 0, x16 PCI-Express 8 x Memory Riser Slot DIMM Sockets CPU 1, 8 x Memory DIMM Sockets CPU 0 Serial & Embedded Video ports Lights Out Manager (SP) Nvidia NICs & USB ports Broadcom BCM5715 NIC11 nVidia MCP55 Sun Confidential : Sun/Partners Use Only CPU 1
  • 12. Sun Fire X2200 Processors Second Generation Third Generation Santa Rosa Socket F Barcelona/Shanghai Dual-Core Quad-Core Special Edition TDP ACP TDP ACP SE 120W 105W 137W 105W TDP ACP TDP ACP Standard Parts 95W 75W 115W 75W High Efficient TDP ACP TDP ACP HE 68W 55W 79W 55W TDP – Thermal Design Power ACP – Average CPU Power12 Sun Confidential : Sun/Partners Use Only
  • 13. AMD Model Number Overview 4 digit AMD Opteron Processor Model - 1234 Model Number communicates scalability, generation and relative performance ● 1st digit communicates scalability -- represents maximum number of processors supported ● 1-socket AMD Opteron processor = 1000 Series, Model 1xxx ● 2-socket AMD Opteron processor = 2000 Series, Model 2xxx ● 8-socket AMD Opteron processor = 8000 Series, Model 8xxx ● 2nd digit represents the generation of AMD Opteron processor ● Model 2216 is 2nd generation [DDR2, Dual-Core, Socket F (1207)] & 2-Socket capable ● Model 2356 is 3rd generation [DDR2, Quad-Core, Socket F (1207)] & 2-Socket capable ● Third generation includes Barcelona and Shanghai ● 3rd and 4th digits communicate relative performance within product line ● For example, Model 8216 would offer ● Better performance than a Model 8212 ● Lower performance than a Model 8220 • Continued Drop-in Upgradeability Investment protection • Shanghai Model numbers • 8/2376 (2.3GHz) 8/2378 (2.4GHz), • 8/2380 (2.5GHz) 8/2382 (2.6GHz) • 8/2384 (2.7GHz)13 Sun Confidential : Sun/Partners Use Only
  • 14. Enhancements in Shanghai Quad-Core AMD Opteron Features New in Shanghai “Barcelona” 45nm Technology 65nm Technology Immersion Lithography Better clock speed scaling 6MB of L3 cache 2MB of L3 cache Better performance HyperTransport 1.0 @ HyperTransport 3.0 @ 2GT/s (8GB/s) 4.4GT/s (17.6GB/s) Available Spring 09 (not all platforms) AMD Smart Fetch AMD Balanced Smart Cache Allows cores to sleep while still providing full cache access AMD-V with Designed for 25% fast “world switch” time Rapid Virtualization Indexing Enhanced Rapid Virtualizaton Indexing (More Virt-Phys translation held in cache) Extends power savings to L3 cache AMD CoolCore Technology (L3 powered down when not in use)14 Sun Confidential : Sun/Partners Use Only
  • 15. AMD Balanced and Smart Cache • Dedicated L1  AMD’s 64KB/64KB vs. Intel’s 32KB/32KB  Allows 2 loads per cycle versus their one  Latency 3 cycles to L1 Core 1 Core 2 Core 3 Core 4 Cache Cache Cache Cache Control Control Control Control • Dedicated L2  Dedicated cache to eliminate conflicts common in shared caches  Sized to accommodate the majority of 128KB 128KB 128KB 128KB working sets today  Latency 12 cycles to L2 512KB 512KB 512KB 512KB • Shared L3 - New  Optimized memory use and allocation for multi-core  Non-inclusive victim cache architecture New 6MB  Latency <38 cycles to L3 • Low latency access to external DRAM Integrated Memory Controller (<60ns) • Upon a full cache miss (L1, L2 & L3) data is sub 60ns away • All memory ranks are the same latency from the CPU15 Sun Confidential : Sun/Partners Use Only
  • 16. AMD Virtualization™ (AMD-V™) • Faster World Switch - A “world switch” is when CPU control passes from one Guest OS, to the hypervisor, to another Guest OS (or back to the original one). Faster switching means the CPU can get back to work on running the virtualized application. • Rapid Virtualization Index works by caching the address translations from Guest Virtual memory to Guest Physical memory to Host Physical memory. To translate between each of these states can require dozens of incremental translations. Shanghai improves Rapid Virtualization Indexing over Barcelona by caching more of these incremental address translation steps. ● Benefits V V V V V V  Virtualization at hardware level M Home M M M Home M M supports more users while offering Local Local best performance  Vmware support in 3.5 Update 1 Node Node Remote Remote  Xen support today Home Home Local 0 1 2 Local Node V Remote V V V Node V V M M M M M M16 Sun Confidential : Sun/Partners Use Only
  • 17. Dual Dynamic Power Management Compatibility Mode Dual Dynamic Power Management ● Today’s AMD Opteron™ processor use a ● The power for the CPU and Memory unified voltage plane for the Memory Controller from independent voltage Controller and Core supplies, offering greater performance and better power management ● Quad-Core processors can work in unified plane motherboards but they will ● Second-Generation AMD (Rev F) Opteron not offer the benefits of Dual Dynamic processors are compatible with Power Management (DDPM) described motherboards designed to support DDPM below but they will deliver the same voltage to 2.0 GHz the CPU and Memory Controller power 2.0 GHz CPU Power Unified Power System Request Queue Supply Crossbar System Request Queue Memory Hypertrans Crossbar Controller port Memory Controller Memory Hypertrans Power Controller port 1.6 GHz 1.8 GHz17 Sun Confidential : Sun/Partners Use Only
  • 18. AMD-V Extended Migration• Vmware Enhanced Vmotion (EVC) support – Version 3.5 update 2• Better Vmotion and CPU compatibility Cache• Vmotion technology allows users to migrate running virtual machines Control between compatible physical servers with zero downtime – Automatically mask to disable features (SSE4.1) 2005 2006 2007 2008 2009 >2010 Rev E Future Single-Core Rev F “Barcelona “Shanghai” Processors Dual-Core ” EVC support for AMD Opteron processors starts with Rev E for 2 Socket, 4 socket, and 8 socket Servers
  • 19. AMD Smart Fetch Technology Barcelona Quad-Core 75 35 % % • Reducing power and E MH E MH IDL z IDL z CORE 0 CORE 1 Clock can be significantly reduced increase performance 10 1 but has to be ready to I DL E % MH z I DL E % MH z increase frequency in > Reduces cache probes the event of a cache which can increase CORE 2 CORE 3 request Shanghai Quad-Core performance for non- halted cores 75 % 35 % > Flushes its L1 & L2 I DL E CORE 0 MH z I DL E CORE 1 MH z caches (to L3) and Other cores are informed that it doesn’t sets a flag so other 10 % 0 have any data. cores know it doesn’t have any data that MH MH IDL E z IDL E z Clock can be CORE 2 CORE 3 completely turned off they need19 Sun Confidential : Sun/Partners Use Only
  • 20. Agenda • Introduction and Positioning • Server Architecture > Sun Fire X2200 > Sun Fire X2100 > Enabling Technologies • Embedded Light Out Management • Operating Systems • System Options20 Sun Confidential : Sun/Partners Use Only
  • 21. Sun Fire X2100 M2 The 1U Server Compute ● 1-socket 2-way server (Dual Core only) ● AMD Opteron™ processor Model 1200 ● 1U-rackmount ● Up to 8 GB of memory with 4 DIMM Slots I/O ● 2 x 8-lane PCI-Express slots (1 x 16-Lane) ● 4 x GigE standard, USB 2.0, Video, Serial ports ● DVD ● SAS or SATA II Drives ● Up to 2 TB of storage with 2 x SATA 3.5” disk drives One of the Most Energy-Efficient Availability and Highest Performing ● Hot-pluggable disk RAID 0 or 1 (Optional) 2-way Server at a Great Price ● Management Embedded ILOM Service Processor Ideal for Web Infrastructure, HPC, ● ● Remote power on/off/status, GUI+CLI, IPMI 2.0, SNMP Simulations, Financial Modeling ● Remote KVM, Floppy/CDROM Excellent for Life Sciences Operating Environment ● Solaris, Linux, Windows21 Sun Confidential : Sun/Partners Use Only
  • 22. Sun Fire X2100 M2 System Layout22 Sun Confidential : Sun/Partners Use Only
  • 23. X2100 Architectural Block Diagram SATA II AMD Opteron 1200 Rear Series CPU Panel Marvell nVidia 4 DDR-2 88E1121 DDR-2 nVidia NIC 1 NIC 0 5.3GB/s PHY DIMMS Slots Marvell 88E1121 nVidia DDR-2 NIC 1 5.3GB/s nVidia NIC 0 PHY HT bus (8GB/s) Rear 4 x USB 2.0 USB Ports x16 PCIe bus (4GB/s) Dual x8 PCIe Riser USB 2.0 or Serial USB 2.0 Port Single x16 PCIe Riser Serial MCP55 DB9 PCI 32bit/33MHz Rear SATA II 3.0Gb/s VGA VGA LPC bus Video HD15 SATA II 3.0Gb/s UMP Port BIOS SuperIO 2 x USB 2.0 Ultra FLASH Legacy BCM ATA 133 PROM Device NIC 0 x4 PCIe bus (1GB/s) BCM Front NIC 1 Panel 3.5”SATA 3.5”SATA Shared Disk Drive Disk Drive Front Panel Tray Load ELOM NIC DVD ROM USB Ports Confidential : Sun/Partners Use Only23 Sun Port
  • 24. X2100 Architectural Block Diagram HBA – SATA II or SAS AMD Opteron 1200 Rear Series CPU Panel Marvell nVidia 4 DDR-2 88E1121 DDR-2 nVidia NIC 1 NIC 0 5.3GB/s PHY DIMMS Slots Marvell 88E1121 nVidia DDR-2 NIC 1 5.3GB/s nVidia NIC 0 PHY Single x16 PCIe Riser Rear or HT bus (8GB/s) 4 x USB 2.0 USB Dual x8 PCIe Riser Ports x16 PCIe bus (4GB/s) USB 2.0 Serial USB 2.0 Port Serial HBA MCP55 DB9 PCI 32bit/33MHz Rear SATA II or SAS VGA VGA LPC bus Video HD15 UMP Port SATA II or SAS BIOS SuperIO 2 x USB 2.0 Ultra FLASH Legacy BCM ATA 133 PROM Device NIC 0 x4 PCIe bus (1GB/s) BCM NIC 1 Front 3.5”SATA or 3.5”SATA or Panel Shared SAS Disk Drive SAS Disk Drive Front Panel Tray Load ELOM NIC DVD ROM USB Ports Confidential : Sun/Partners Use Only24 Sun Port
  • 25. Sun Fire X2100 M2 Internals Tour CPU & 4 x PCI Fan* Memory Slots PCI Express *Only 1x Fan for PCI Cooling in Final Design Riser Area Disk 1 nVidia MCP55 Front Panel PCB Serial & Video ports CD/DVD Drive Nvidia NICs & USB portsDisk 0 Broadcom CPU/memory Embedded Lights Out Manager (SP) NICs25 Blowers Sun Confidential : Sun/Partners Use Only Power Supply
  • 26. Sun Fire X2100 M2 Motherboard Tour x16 PCI-Express Riser Slot Serial & Video ports CPU Nvidia NICs & USB ports 4 x DIMM Sockets Broadcom BCM5715 NIC Embedded nVidia MCP55 Lights Out Manager (SP)26 Sun Confidential : Sun/Partners Use Only
  • 27. Agenda • Introduction and Positioning • Server Architecture > Sun Fire X2200 > Sun Fire X2100 > Enabling Technologies • Embedded Light Out Management • Operating Systems • System Options27 Sun Confidential : Sun/Partners Use Only
  • 28. Sun Fire X2100 & X2200 M2 Product Tour Front Panel System LED Hot Swappable Service/Fault Power Button Disks LED Locate Button/LED Dual USB 2.0 Optional CD/DVD Ports Drive28 Sun Confidential : Sun/Partners Use Only
  • 29. Sun Fire X2100 & X2200 M2 Product Tour Service/Fault Dual nVidia Dual x8 PCI-Express Rear Panel LED GbE ports System Slots Locate LED LED orPower Supply One x16 PCI-Express(X2100 has no Slot visible Fan) Serial DB9 port Dual Broadcom GbE ports Quad USB 2.0 VGA Video Ports HD15 port29 Sun Confidential : Sun/Partners Use Only
  • 30. Sun Fire X2100 & X2200 M2 Product Serial DB9 port Tour Rear Ports and Ethernet Port naming VGA Video HD15 port Dual Quad USB 2.0 Dual nVidiaBroadcom Ports GbE portsGbE ports 0 0 1 Lower left Broadcom port is shared with the SP via the 1 (SP Net) OS Nvidia Port 0 Nvidia Port 1 BCM5715 UMP port. OS Solaris RHEL3u8 RHEL4u4 Windows Solaris Nge0 Nge1 Allows the SP to have a Port 0 BGE0 Eth0 Eth2 NET RHEL3 u8 Eth2 Eth3 separate MAC and IP address Port 1 BGE1 Eth1 Eth3 NET RHEL4 u4 Eth0 Eth1 and does not affect the main Windows 2K3 Net Net1 systems use of the port.30 Sun Confidential : Sun/Partners Use Only
  • 31. Sun Fire X2100/X2200 M2 Components Tour PCI Express Riser Card PCI-Express riser card is tooless Riser is removed from the chassis to insert PCI cards. A dual x8 PCIe riser is standard with optional single x16 PCIe Riser accommodates Low Profile, Half Length cards Sun Fire X2200 takes 6.5” (160mm) long cards Cards restricted to 25Watts TOTAL power consumption31 Sun Confidential : Sun/Partners Use Only
  • 32. Sun Fire X2100 & X2200 M2 Components Tour Power Supplies Sun Fire X2200 Power Supply Sun Fire X2100 Power Supply Rated at 450 Watts Rated at 340 Watts 110/220VAC Single Input Auto Ranging/Sensing 110/220VAC Single Input Auto Ranging/Sensing 50/60Hz 50/60Hz Two Fans Single Fan No Redundancy No Redundancy CRU, (Requires a Philips Screwdriver) CRU, Requires a Philips Screwdriver Uses an adapter bracket to fit System Chassis32 Sun Confidential : Sun/Partners Use Only
  • 33. Sun Fire X2100 & X2200 M2 Components Tour Disk and Optical Drives Sun Fire X2100 & X2200 M2 hard Disk Drives Sun Fire X2100 & X2200 M2 3.5” SATA Drives, 250GB, 500GB, 750GB, and 1 TB 7200 rpm DVD Drives 3.5” SAS Drives, 146GB, 300 GB 15,000 rpm DVD ROM (Option X8082A) 3.0Gbps for SATA-II and SAS drives Conventional ATA-133 interface Hot Plug, Easily installed from the front of the system System requires Blanks if no drive installed in a slot No Drive in Standard Config No Disks in Standard Config33 Sun Confidential : Sun/Partners Use Only
  • 34. Buffered vs. Unbuffered DIMMs aka. Registered vs. Un-registered – Registered DIMMs have additional registers placed between the CPUs and DIMMs • Improves signal integrity, allowing longer traces and larger, more reliable memory subsystems • Up to 4GB per DIMM slot • 8 DIMM slots per CPU • Sun Fire X2200 M2 w/AMD Opteron 2000 Series CPU – Unbuffered DIMMs do not have these registers • Lower cost and slightly higher performance • Up to 2GB per DIMM slot, 4 DIMM slots • Sun Fire X2100 M2 w/AMD Opteron 1200 Series CPU34 Sun Confidential : Sun/Partners Use Only
  • 35. Single/Dual/Quad Ranked DIMM Limits X2200 Limitations • All DIMMS are Ranked, a Rank is a data area created using some or all of the chips on the DIMM – All ranks are 64 bits wide(+8 bits of ECC) – DIMMS can contain one, two or four Ranks – Each Rank requires a set of control lines – Column Address Strobe (CAS) particularly • 8 DIMM/Socket systems dont have sufficient CAS lines to satisfy QUAD ranked DIMMS in all slots – Limits us to 4 Quad Ranked DIMMS – Currently available 4GB DIMMS are all quad ranked – 4GB DIMMS are dual ranked • If more than 4 Dual/Quad Ranked DIMMS are populated per CPU, require clocking of the DDR2 busses are clocked down from 667 MHz to 533 MHz35 Sun Confidential : Sun/Partners Use Only
  • 36. Sun Fire X2100/X2200 M2 Components nVidia MCP55Pro Chipset Features Used • Highly integrated Single Chip Core Logic • 1GHz HyperTransport Link x16 up/down MCP55Pro > 8GB/s full speed transfer rates • 6 independent PCI Express Controllers > Providing 28 PCI-Express Lanes, 20 Used. • 2 separate SATA-II controllers (1.5/3.0 Gbps) • ATA-133 controller for CD/DVD devices • Dual IEEE 802.3 MACs for 10/100/1000BASE-T • 8 USB 2.0 Ports (2 front/4 rear/2 internal SP) • PCI 33MHz/32bit bus for embedded Video device36 Sun Confidential : Sun/Partners Use Only
  • 37. nVidia Chipset Details PCI Express and PCI legacy • 16 PCI Express Lanes > Depending on the Riser configuration used MCP55Pro > Two x8 PCIe slots (Low profile/Half length) > One x16 PCIe slot (Low profile/Half length) • 4 PCI Express Lanes used internally for the additional Broadcom Dual Port Ethernet Controller • One PCI 33MHz/32Bit bus dedicated to AST2000 embedded Graphics and Management device37 Sun Confidential : Sun/Partners Use Only
  • 38. nVidia Chipset Details nVidia SATA Controllers • Two independent SATA-II controllers > One controller is dedicated to each drive MCP55Pro > Each controller is capable of 1.5 or 3.0Gbps per direction per channel > Supports Native Command Queueing > Supports Tagged Command Queueing > Supports hot plug (with OS dependencies) > Support RAID 0 or 1 and JBOD (with OS dependencies)38 Sun Confidential : Sun/Partners Use Only
  • 39. nVidia SATA Drivers • Solaris > Included in Solaris 10 update 3 > Available as a patch for Solaris 10 06/06 MCP55Pro • Linux > RHEL3U7 and RHEL4U3 already have nv_sata driver > More optimized driver provided on the Tools and Drivers CD > Also available for download from nVidia.com > SuSE 9 SP3 requires drivers from the Tools and Drivers CD • Windows 2003 Server > Default drivers supported > Drivers provided on the Tools and Drivers CD (also from nVidia) • VMware ESX 3.x39 Sun Confidential : Sun/Partners Use Only
  • 40. nVidia Chipset Details nVidia Network Controllers • Two independent IEEE 802.3 MACs • Auto-Negotiation and Duplex settings MCP55Pro through an external dual port Marvell 88E1121 PHY • Supports JUMBO frames (up to 9018 bytes) • 10/100 Mb/s Full or Half Duplex • 1000 Mb/s Full Duplex only • Supports NIC Teaming and failover (with OS dependencies)40 Sun Confidential : Sun/Partners Use Only
  • 41. nVidia Network Drivers • Solaris > Included in Solaris 10 update 3 > Available as a patch for Update 2(06/06) MCP55Pro • Linux > RHEL3U7 and RHEL4U3, install from Tools and Drivers CD > Also available for download from nVidia.com > SuSE 9 SP3 requires drivers from the Tools and Drivers CD • Windows 2003 Server > Drivers provided on the Tools and Drivers CD > Also available for download from nVidia • VMware ESX 3.X > Support from VMware post GA41 Sun Confidential : Sun/Partners Use Only
  • 42. Agenda • Introduction and Positioning • Server Architecture > Sun Fire X2200 > Sun Fire X2100 > Enabling Technologies • Embedded Light Out Management • Operating Systems • System Options42 Sun Confidential : Sun/Partners Use Only
  • 43. Embedded LOM Service Processor ASPEED AST2000 • Provides all Remote USB 2.0 Serial Administration functionality MCP55 USB 2.0 Serial Port DB9 > WebGUI PCI 32bit/33MHz Rear > Remote RKVMS facility LPC bus UMP VGA Video VGA HD15 > CLI (DMTF SMASH CLP) BIOS FLASH SuperIO Legacy Port > SSH or Serial access to CLI PROM Device > IPMI 2.0 BCM x4 PCI-E bus (1GB/s) > SNMP v1,v2c,v3 NIC 1 Shared SP NIC port • Shares access to the systems Serial port, switch using commands and hot key sequences, > start /SP/AgentInfo/console and the key sequence ESC ) • Shares access to one of the Broadcom NICs using the UMP port feature of the BCM5715 Ethernet Controller. > Has a unique MAC and IP address, different from the OS MAC and IP. • AST2000 also provides the systems VGA video device using either the AST2000 video driver in Xorg (or the VESA driver), Windows Driver supplied on the Tools and43 Drivers CD Sun Confidential : Sun/Partners Use Only
  • 44. Embedded LOM Service Processor UMP Shared NIC BCM5715C 10/100/1000 MAC UMP 10/100 MAC TX Packets UMP Interface Gigabit PHY 10/100 MAC RX TX TX UMP UMP Command Port Internet Processing BMC BCM RX RX TX NIC 1 x4 PCIe RX Packets Shared SP NIC port PCIe x4 Interface • AST2000 shares access to the bottom Broadcom ethernet port • The BCM5715 UMP Port acts like a dedicated 10/100 MAC • Providing a Unique MAC and IP address for the UMP port • BMC connects to this UMP MAC at 100Mbps Full Duplex and can inject BMC ethernet traffic into the main server ethernet stream. • BCM5715 filters and passes on traffic from the main ethernet PHY • Main PHY/MAC can operate at 10/100/1000 and BMC traffic is seamlessly injected > May Cause issues with critical heartbeat or NIC teaming applications, still in testing44 Sun Confidential : Sun/Partners Use Only
  • 45. Embedded LOM Service Processor Initial Setup • The SP by default owns the serial port • At system power will see the SP boot • Once booted, SP presents a CLI login • Login root, default password is changeme • Issue the show /SP/AgentInfo/Network command to determine SP IP address (DHCP or static) > By default SP will attempt to obtain a DHCP lease, if no lease is granted after 5 seconds, SP will default to 192.168.1.2/24 • Change the IP address using either > set /SP/AgentInfo IpAddress=<new_iP> for static IP or > set /SP/AgentInfo DhcpConfigured=enable for DHCP IP45 • IP changes occur immediately, you may need to reconnect Sun Confidential : Sun/Partners Use Only
  • 46. Embedded LOM Service Processor Serial Port Changes • The SP by default owns the serial port • On power application to the server, the SP can be seen booting on the serial line • Serial port can be configured to show either the SP CLI or BIOS redirection over serial • Default is selectable from the SP CLI or through the BIOS setup > SP CLI can be switched to the BIOS/System serial output by > start /SP/AgentInfo/console > Switch back by issuing the key sequence ESC then Shift-9 > Enter the BIOS setup, navigate to the Advanced -> IPMI 2.0 Configuration -> External COM Port screen, change to BMC or System • NOTE: SP CLI times out after 30 seconds, back to the login prompt46 Sun Confidential : Sun/Partners Use Only
  • 47. Embedded LOM Service Processor Web GUI • Access via HTTP via SP IP address • Provides a simple GUI • Expand buttons to access next • Auto Redirects over HTTPS • Mini Snapshot of current desktop level of function • User Authenticates by Local or ADS • Sun Java 1.5+ Browser plugin • Output from function displayed required in lower frame • 8 Users/Roles definable • Simple status screen • Three buttons for • Requires opening of Firewall Ports 80, 443, 22, 69, for Web GUI and SSH, • Expandable stacked buttons for > System Summary TFTP (firmware updates) functions > User Control • RKVMS requires ports 8890, 9000, • Button to Launch RKVMS Java 9001, 9002, 9003 > Setup WebStart Client47 Sun Confidential : Sun/Partners Use Only
  • 48. Embedded LOM Service Processor Web GUI Status Page • Start the RKVMS with the Launch button next to the Snapshot image • Java WebStart Applet Provides all RKVMS functions • Requires Sun Java 1.5+ installed on Client system and Browser Plugin Installed48 Sun Confidential : Sun/Partners Use Only
  • 49. Embedded LOM Service Processor Web GUI RKVMS – System OS booted • Scalable/Re-sizeable Graphics window • Up to 1600x1200 resolution • Live interaction with system Desktop • Mount virtual DVD/CD/Floppy devices or ISO images as USB 2.0 local devices49 Sun Confidential : Sun/Partners Use Only
  • 50. Embedded LOM Service Processor Web GUI RKVMS - System In BIOS setup • Remote Installation • Interact with BIOS screens • Issue Special key sequences (Ctrl-Alt- Del, etc) • Secure (encryption options) • Quality/bandwidth options50 Sun Confidential : Sun/Partners Use Only
  • 51. Embedded LOM Service Processor DMTF SMASH CLI Examples Accessible through Serial line or via SSH Username: root Password: ******** to the SP IP address Sun(TM) Embedded Lights Out Manager Power on the system with the command Copyright 2004-2006 Sun Microsystems, Inc. All rights reserved. Version 0.90 set /SP/SystemInfo/CtrlInfo PowerCtrl=on Hostname: SUNSP00C09F000001 Power the system off with the command IP address: 10.6.160.113 MAC address: 00:C0:9F:00:00:01 set /SP/SystemInfo/CtrlInfo PowerCtrl=off /SP -> /SP -> show Reset the system with the command /SP Targets: AgentInfo SystemInfo set /SP/SystemInfo/CtrlInfo PowerCtrl=reset User TftpUpdate Rexamine and set the SP IP address.. Properties: Target Commands: show /SP/AgentInfo show cd set /SP/AgentInfo/ IpAddress=10.6.160.114 /SP -> set /SP/AgentInfo/ NetMask=255.255.252.0 set /SP/AgentInfo/ Gateway=10.6.163.25451 Sun Confidential : Sun/Partners Use Only
  • 52. Embedded LOM Service Processor IPMI 2.0 and SNMP, and CLI PEF • Accessible one SP has an IP address Username: root Password: ******** • IPMI 2.0 standard reference Sun(TM) Embedded Lights Out Manager Copyright 2004-2006 Sun Microsystems, Inc. All rights reserved. http://www.intel.com/design/servers/ipmi/ Version 0.90 • IPMI management tool available from Hostname: SUNSP00C09F000001 IP address: 10.6.160.113 http://ipmitool.sourceforge.com MAC address: 00:C0:9F:00:00:01 /SP -> show /SP/AgentInfo/SEL /usr/sfw/bin/ipmitool /SP/AgentInfo/SEL Targets: • SNMP v1, v2c and v3 supported Properties: Target Commands: • Sun Fire X2200 Embedded Lights-Out show Manager Administration Guide Information ,2006/06/14 11:17:57 ,Processor 0 presence detected Critical ,2006/06/14 13:52:24 ,CPU1 FAN Tach speed is too low(Value=0.000 http://docs.sun.com Ref. # 819-6588-xx RPM: Threshold=78.400 RPM) Information ,2006/06/14 13:52:26 ,CPU1 FAN Tach back to normal Critical ,2006/06/14 13:59:17 ,PCI FAN0 not present or stop Information ,2006/06/14 13:59:20 ,PCI FAN0 back to normal /SP ->52 Sun Confidential : Sun/Partners Use Only
  • 53. Embedded LOM Service Processor Hints and Tips... Firmware is changing rapidly, make sure SUNSP0016365B982B login: root Password: you have the latest version before logging login[425]: root login on `ttyS1 bugs. Sun(TM) Embedded Lights Out Manager Copyright 2004-2006 Sun Microsystems, To recover a lost Embedded LOM Inc. All rights reserved. Version 1.1 Password. Hostname: SUNSP0016365B982B > Access the system locally with a screen and keyboard IP address: 10.6.160.115 MAC address: 00:16:36:5B:98:2B > BIOS Setup -> Advanced -> IPMI 2.0 Configuration -> Reset BMC Root password System serial number: 0624QC0017 /SP -> show My local mouse is not syncd with the /SP remote mouse on the Remote Console Targets: AgentInfo SystemInfo window User TftpUpdate > Issue the command xset m 1 1 Properties: Target Commands: > In the remote system desktop show cd > Use the Ctrl-Alt-M key press to initialize the remote mouse to the top left reset of the screen. /SP ->53 Sun Confidential : Sun/Partners Use Only
  • 54. Agenda • Introduction and Positioning • Server Architecture > Sun Fire X2200 > Sun Fire X2100 > Enabling Technologies • Embedded Light Out Management • Operating Systems • System Options54 Sun Confidential : Sun/Partners Use Only
  • 55. Operating Systems • SuSE SLES 9 SP3 • Windows 2003 Server > 64bit supported > 32 and 64bit > Default installs from media > Installs from media > Tools and Drivers CD > Tools and Drivers CD updates Video, SATA, Broadcom and nVidia NIC updates Video, SATA drivers and NIC drivers • VMware 3.5 > Taurus Support ONLY55 Sun Confidential : Sun/Partners Use Only
  • 56. Sun Fire Operating Systems Operating System Dates/Comments Solaris x64 10u2 and up 64-bit Red Hat Enterprise Linux 3, U8 32-bit, 64-bit Red Hat Enterprise Linux 4, U4 32-bit, 64-bit Red Hat Enterprise Linux 5 32-bit, 64-bit SUSE Linux Enterprise Server 9, SP3 (SLES 9) 64-bit SUSE Linux Enterprise Server 10 (SLES 10) 64-bit Windows Server 2003, Enterprise and Standard Editions, SP1 32-bit, 64-bit Windows Server 2008, Datacenter, Enterprise and Standard Editions 32-bit, 64-bit VMware ESX 3.0.2 (Sun Fire X2200 M2 Dual Core only) 64-bit56 Sun Confidential : Sun/Partners Use Only
  • 57. Sun Fire Operating Systems Quad-Core Operating System Dates/Comments Solaris x64 10u5 64-bit Red Hat Enterprise Linux 4 U5 32-bit, 64-bit Red Hat Enterprise Linux 5 U1 32-bit, 64-bit SUSE Linux Enterprise Server 9, SP4 (SLES 9) 64-bit SUSE Linux Enterprise Server 10, SP1 (SLES 10) 64-bit Windows Server 2003, Enterprise and Standard Editions, SP1 32-bit, 64-bit Windows Server 2008, Datacenter, Enterprise and Standard Editions 32-bit, 64-bit VMware ESX 3.0.2 or ESX 3.5 U1 (Sun Fire X2200 M2 Quad Core only) 64-bit57 Sun Confidential : Sun/Partners Use Only
  • 58. Agenda • Introduction and Positioning • Server Architecture > Sun Fire X2200 > Sun Fire X2100 > Enabling Technologies • Embedded Light Out Management • Operating Systems • System Options58 Sun Confidential : Sun/Partners Use Only
  • 59. Standard Configurations Sun Fire X2200 Base Config A85-A-Z 1RU Chassis No AMD Opteron CPU (2 x 1207-pin L1 Sockets) 4 x 10/100/1000 Base-T Ethernet Ports Integrated 2D Graphics Controller (AST2000/VESA) AST2000 Integrated Service Processor, IPMI2.0, WebGUI, CLI, SNMP No Disk Drive No DVD No PCI Riser Card Entry Config A85-JWZ1-H-2GB-JL8 Base Config A85-A-Z plus.... 1 x AMD Opteron 2210 (1.8GHz, Dual Core ,95 Watts) 2 x 1GB DIMMS (Registered, ECC DDR2-667) I/O Riser Card with 2 x 8-Lane PCI-Express slots Mid Config A85-JFZ2-H-4GB-JL8 Base Config A85-A-Z plus.... 2 x AMD Opteron 2214 (2.2GHz, Dual Core ,95 Watts) 4 x 1GB DIMMS (Registered, ECC DDR2-667) I/O Riser Card with 2 x 8-Lane PCI-Express slots Performance Config A85-JGZ2-H-8GB-JL8 Base Config A85-A-Z plus....59 Sun Confidential : Sun/Partners Use Only
  • 60. Standard Configurations Sun Fire X2100 Part Number Description A84-GQZ1-H-4GB-JL8 Sun Fire X2100 M2 x64 Server: AMD Opteron Model 1222 dual core processor (3.0GHz/1MB), 4x 1GB unregistered ECC DDR2-667 memory, no Serials ATA drives, no DVD, 1x PSU, Service Processor, 2x 10/100/1000 Ethernet ports, 6x USB 2.0 ports, 1x I/O riser card with 2x PCI-Express x8 slots, no power cords, order Geo-specific x-option. RoHS-5. Standard Configuration A84-GPZ1-H-2GB-JL8 Sun Fire X2100 M2 x64 Server: AMD Opteron Model 1220 dual core processor (2.8GHz/1MB), 2x 1GB unregistered ECC DDR2-667 memory, no Serials ATA drives, no DVD, 1x PSU, Service Processor, 2x 10/100/1000 Ethernet ports, 6x USB 2.0 ports, 1x I/O riser card with 2x PCI-Express x8 slots, no power cords, order Geo-specific x-option. RoHS-5. Standard Configuration. A84-GGZ1-H-4GB-JL8 Sun Fire X2100 M2 x64 Server: AMD Opteron Model 1218 dual core processor (2.6GHz/1MB), 4x 1GB unregistered ECC DDR2-667 memory, no Serials ATA drives, no DVD, 1x PSU, Service Processor, 2x 10/100/1000 Ethernet ports, 6x USB 2.0 ports, 1x I/O riser card with 2x PCI-Express x8 slots, no power cords, order Geo-specific x-option. RoHS-5. Standard Configuration.60 Sun Confidential : Sun/Partners Use Only
  • 61. Standard Configurations Sun Fire X2200 - Dual-Core Part Number Description High Performance Dual Core Sun Fire X2200 M2 x64 Server: 2x AMD Opteron Model 2218 dual core processor (2.6GHz/1MB/95W), 4x 2GB registered ECC DDR2- A85-JGZ2-H-8GC-JL8 667 memory, No HDD, No DVD-ROM, 1x PSU, Service Processor, 4x 10/100/1000 Ethernet ports, 6x USB 2.0 ports, 1x I/O riser card with 2x PCI-Express x8 slots, no power cords, order Geo-specific x-option. RoHS-5. Standard Configuration.61 Sun Confidential : Sun/Partners Use Only
  • 62. Standard Configurations Sun Fire X2200 – Quad-Core Barcelona Part Number Description A85-FSZ1-H-4GC-JL8 Sun Fire X2200 M2 x64 Server: 1x AMD Opteron Quad Core Model 2356 quad core processor (2.3 GHz, 2MB L3 cache, 75W ACP), 2x 2GB registered ECC DDR2-667 memory, no drives, 1x PSU, Service Processor, 4x 10/100/1000 Ethernet ports, 6x USB 2.0 ports, 1x I/O riser card with 2x PCI-Express x8 slots, no power cords, order Geo-specific x-option. RoHS-5. Standard Configuration. A85-FFZ1-H-4GC-JL8 Sun Fire X2200 M2 x64 Server: 1x AMD Opteron Quad Core Model 2354 processor (2.2 GHz, 2MB cache, 75 W ACP), 2x 2GB registered ECC DDR2-667 memory, no drives, 1x PSU, Service Processor, 4x 10/100/1000 Ethernet ports, 6x USB 2.0 ports, 1x I/O riser card with 2x PCI-Express x8 slots, no power cords, order Geo-specific x-option. RoHS-5. Standard Quad Core HE Config Sun Fire X2200 M2 x64 Server: 2x AMD Opteron Quad Core Model A85-SUZ2-H-8GC-JL8 2347HE processor (1.9 GHz, 2MB cache, 55 W ACP), 4x 2GB registered ECC DDR2-667 memory, no drives, 1x PSU, Service Processor, 4x 10/100/1000 Ethernet ports, 6x USB 2.0 ports, 1x I/O riser card with 2x PCI-Express x8 slots, no power cords, order Geo-specific x-option. RoHS-5. Standard62 Sun Confidential : Sun/Partners Use Only
  • 63. Sun Fire X2200 Standard Configurations • 800MHz DIMMs being analyzed • EOL – 1GB memory support • More ATO and less standard configurations • Sun Fire X2100 will not support Shangahi CPU Clock Speed DDR2 Memory Memory # of SAS HDD RAID HBA DVD-RW PSUs Part Number Sun Fire X2200 Shanghai Standard Configurations 2x 2376 2.3GHz 4x 2GB -667 SR 8GB No HDD No No 1 A85-ZSZ2-H-8GC-JL8 2x 2384 2.7GHz 4x 2GB -667 SR 8GB No HDD No No 1 A85-ZWZ2-H-8GC-JL863 Sun Confidential : Sun/Partners Use Only
  • 64. Sun Fire X2200 Upgrade to Shanghai • http://docs.sun.com/source/820-3270-12/index.html • Download the Sun Fire X2200 M2 Server Tools and Drivers CD v2.0 (or later) ISO image • Record Current BIOS settings (ELOM) • Upgrade processor to Shanghai • Is BIOS 3D08? > Then Upgrade 512K BIOS PROM to 1M > Remove the Firmware PROM and install new PROM > Special PLCC extraction tool is necessary • Upgrade the SP/BMC Firmware with Tools and Driver CD • Check BIOS and upgrade if necessary • Micron memory being phased out – field notice Upgrade Options CPU X-Option ATO Date AMD Opteron 2376 (2.3GHz/512KB, 75W ACP Quad Core) X5334A 5334A Dec-2008 AMD Opteron 2384 (2.7GHz/512KB, 75W ACP Quad Core) X5335A 5335A Dec-2008 New 4GB Memory X-Option ATO Date 8GB DDR2-667 Registered ECC Memory (2x4GB) X4087A 4087A Dec-200864 Sun Confidential : Sun/Partners Use Only
  • 65. Add-in Card Options X-Option ATO CRS Description SG-XPCIE2FC-QF4 SG-PCIE2FC-QF4 SG-PCIE2FC-QF4 Sun StorEdge 4 GB Dual Port Fibre Channel PCI-Express Card (Qlogic). RoHS-6. SG-XPCIE1FC-QF4 SG-PCIE1FC-QF4 SG-PCIE1FC-QF4 Sun StorEdge 4 GB Single Port Fibre Channel PCI-Express Card (Qlogic). RoHS-6. SG-XPCIE2FC-EM4 SG-PCIE2FC-EM4 SG-PCIE2FC-EM4 Sun StorEdge 4 GB Dual Port Fibre Channel PCI-Express Card (Emulex). RoHS-6. SG-XPCIE1FC-EM4 SG-PCIE1FC-EM4 SG-PCIE1FC-EM4 Sun StorEdge 4 GB Single Port Fibre Channel PCI-Express Card (Emulex). RoHS-6. X7280A-2 7280A-2 7280A-2 Sun PCI-E Low profile Dual GigE (Copper) UTP, low profile bracket on board. Standard bracket included in X-option. ROHS-6. SG-XPCIE2SCSIU320Z SG-PCIE2SCSIU320Z SG-PCIE2SCSIU320Z Sun PCI-E Ultra320 SCSI 2-port HBA. RoHS-6 7281A-2 7281A-2 Sun PCI-E Low-Profile Dual GigE (Fiber) MMF, low profile bracket on board. Standard X7281A-2 bracket included in X-option. RoHS-6. X1106A-Z n/a X1106A-Z Single port Sun 10 Gigabit Ethernet Networking Card with fixed transceiver (Intel) X1107A-Z n/a X1107A-Z Dual port Sun 10 Gigabit Ethernet Networking Card with fixed transceiver (Intel) X1236A-Z 1236A-Z 1236A-Z Infiniband PCI-Express Card. RoHS-6. SG-XPCIE4SAS3-Z SG-PCIE4SAS3-Z SG-PCIE4SAS3-Z LSI Logic SAS3041E-R, PCI Express, 4-port 3Gb/s (SAS) HBA List subject to change and not final65 Sun Confidential : Sun/Partners Use Only
  • 66. Sun Fire X2100/X2200 M2 TechnicalProduct Training Presentation Ronald Graham Systems Group Technical Marketing Sun Microsystems