Summary of the content on the page No. 1
TM
Sun Fire X4600/X4600 M2
Server Architecture
A Technical White Paper
May 2007 SunWIN Token # 470898
Summary of the content on the page No. 2
Sun Microsystems, Inc. © 2006 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, CA 95054 USA All rights reserved. This product or document is protected by copyright and distributed under licenses restricting its use, copying, distribution, and decompilation. No part of this product or document may be reproduced in any form by any means without prior written authorization of Sun and its licensors, if any. Third-party software, including font technology, is copyrighted and licensed from
Summary of the content on the page No. 3
Sun Microsystems, Inc. Table of Contents Introduction............................................................................................................................................5 Sun Fire x4000 Server Family Overview............................................................................................................5 Sun Fire X4600 Overview...................................................................................................................................6 Su
Summary of the content on the page No. 4
Sun Microsystems, Inc. Key Productivity Features............................................................................................................................46 Interoperability.............................................................................................................................................47 Availability...................................................................................................................................................47 Adv
Summary of the content on the page No. 5
Sun Microsystems, Inc. Introduction As the first of its kind, the Sun Fire X4600 server is the fastest, most scalable, and energy-efficient four-way to 16-way x64 (x86 64-bit) server. It scales quickly from two sockets to eight sockets simply by adding processor boards, all in a compact 4RU form factor. The new modular processor board for the Sun Fire X4600 M2 server allows up to ¼ terabyte of memory in a fully configured system. With its multiple operating system support, exten- sive ISV a
Summary of the content on the page No. 6
Sun Microsystems, Inc. Figure Intro-1: Sun Fire X4000 Server Family Customers seeking a business edge can look to Sun to provide smart options for building a simple, secure, and standardized IT infrastructure. The Sun Fire x64 family of servers enables standardization of the datacenter by providing the unity of vertical scaling with the economies of horizontal scaling, while running any major OS and 32-bit/64-bit application. Sun continues its efforts to provide customers with solutions to he
Summary of the content on the page No. 7
Sun Microsystems, Inc. Figure Intro-2: The Sun Fire X4600 Server The highly scalable 4- to 16-way Sun Fire X4600 server allows customers to dramatically improve business agility and growth without any data center disruption and no change to the operating system, software, rack, network infrastructure, or storage connections. The Sun Fire X4600 server can be used to build 5-teraflop (or larger) systems. Table Intro-1 shows how the new Sun Fire X4600 server compares to the Sun Fire X4100 and X4
Summary of the content on the page No. 8
Sun Microsystems, Inc. Features Sun Fire X4100/X4200 Sun Fire X4600 M2 Four HDDs HDD Number CD/DVD-ROM Optical Drive Dual Intel FW82546GB NIC Controller Quad Gigabit Ethernet ports NICs ATI Rage XL Graphics Controller Six PCI-E Low Profile and Expansion Slots Two PCI-X MD2 Two USB 2.0 ports (Type A) Front I/O Four Gigabit Ethernet ports (RJ45) Rear I/O One 100BaseT Management port (RJ45) One RS-232 Serial (RJ45) Two USB 2.0 ports (Type A) VGA Video port (DB15) Redundant Hot Swappable Power Sup
Summary of the content on the page No. 9
Sun Microsystems, Inc. Sun Fire X4600 Target Markets and Applications The Sun Fire X4600 server provides mission-critical enterprise data center solutions across all industries. It is particularly well-suited for the following applications: • Collaboration • Email • Document management • Server consolidation • Data collection and analysis • ERP • CRM • Data warehousing • Databases • Product development and delivery • Simulation • Transaction processing • Billing • Customer service • Applicatio
Summary of the content on the page No. 10
Sun Microsystems, Inc. Chapter 1 Architecture Overview Sun Fire X4600 Server The Sun Fire X4600 server measures 4 rack-units (6.9 inches/176 mm) high, 17.5 inches (445 mm) wide, and 24.75 inches (629 mm) deep. It is a 4- to 16-way rack-optimized, x64-based system with a symmetric multiprocessor. Cooling is accomplished with internal fans that direct airflow from the front to the back of the chassis. I/O ports are located on the rear panel, with additional USB on the front panel. Access to the
Summary of the content on the page No. 11
Sun Microsystems, Inc. Figure 1-2: Rear View of the Sun Fire X4600 Server 11 of 63
Summary of the content on the page No. 12
Sun Microsystems, Inc. Figure 1-3: Internal View of the Sun Fire X4600 Server The Sun Fire X4600/X4600 M2 server also provides the following system architecture features: • Sun Fire X4600: Embedded dual-channel DDR1 memory controllers on each CPU to provide maximum memory capacity and bandwidth scaling and deliver up to 64 GB of capacity and 51.2 GB/sec. of aggregated bandwidth with eight populated CPUs and 2 GB DIMMs. • Sun Fire X4600 M2: Embedded dual-channel DDR2 memory controllers on each
Summary of the content on the page No. 13
Sun Microsystems, Inc. • Embedded management and legacy I/O to offer maximum operational flexibility without compromising PCI slots for optional features Figure 1-4: Sun Fire X4600 Server Architecture Block Diagram with Eight CPUs 13 of 63
Summary of the content on the page No. 14
Sun Microsystems, Inc. Chapter 2 CPU Architecture The Sun Fire X4600 server supports up to eight Single-Core or Dual-Core AMD Opteron Series 800 processors. Each CPU module has an attached PCB containing: • 1 AMD Opteron CPU and heatsink • 4 DDR1 memory DIMM slots • 1 CPU/RAM VRM • Airflow redirection baffles for greatest cooling efficiency The Sun Fire X4600 M2 server supports up to eight AMD Opteron Series 8000 (Dual-Core and Multi-Core in the future) processors. Each CPU module has an att
Summary of the content on the page No. 15
Sun Microsystems, Inc. Figure 2-1: Sun Fire X4600 CPU Module Systems configured with four or six processors require filler modules. The filler modules maintain the HyperTransport connectivity between all CPUs and provide airflow redirection for efficient cooling throughout the system. Figure 2-2 illustrates the placement of CPU and filler modules, physical slot numbering, and the CPU enumeration from the BIOS perspective. Front of Server Slot A Slot B Slot C Slot D Slot E Slot F Slot G Slot
Summary of the content on the page No. 16
Sun Microsystems, Inc. Front of Server Rear of Server Figure 2-2: CPU Module Placement Note: The Sun Fire X4600 server supports four and eight CPU configurations. Two, four, six, and eight CPU configurations are supported in the Sun Fire X4600 M2. In Sun Fire X4600 systems, each processor contains an integrated memory controller that supports a 128-bit- wide path to memory and three 16x16-bit HyperTransport links. Each HyperTransport link runs at speeds up to 1 GHz and is clocked on both edg
Summary of the content on the page No. 17
Sun Microsystems, Inc. In Sun Fire X4600 M2 systems, each processor contains an integrated memory controller that supports a 128- bit-wide path to memory and three 16x16-bit HyperTransport links. Each HyperTransport link runs at speeds up to 1 GHz and is clocked on both edges of the clock pulse, which allows for a maximum of 4 GB/sec. (2 gigatransfers/sec., 2 bytes wide) throughput in each direction (8 GB/sec. aggregate data rate bi-directionally). Memory support is for registered DDR2/667 24
Summary of the content on the page No. 18
Sun Microsystems, Inc. Figure 2-4: Single-Core AMD Opteron Processor Architecture The Sun Fire X4600 server supports both Single-Core and Dual-Core AMD Opteron 800 Series processors. The Sun Fire X4600 M2 server supports Dual-Core AMD Opteron 8000 Series processors. From the start, AMD64 processors were designed to add a second core—the port already existed on the crossbar/SRI. Dual- core AMD Opteron processors have unique instances of L1 cache (I-cache and D-cache) and L2 cache for each CP
Summary of the content on the page No. 19
Sun Microsystems, Inc. Figure 2-5: Dual-Core AMD Opteron Processor Architecture Note: Sun Fire X4600 servers support 95 W and 120 W 90 nm technology package infrastructure AMD Opteron Rev E and Rev F processors only. CPU Packaging AMD Opteron 800 series processor packaging specifications include: • 940-pin lidded organic micro PGA • 1.27 mm pin pitch • 31 x 31 row pin array • 40 mm x 40 mm organic substrate • Organic C4 die attachment • 16.5 mm x 11.3 mm die size AMD Opteron 8000 series proces
Summary of the content on the page No. 20
Sun Microsystems, Inc. Processor VRM Each processor receives core voltage input from an individual voltage regulator module (VRM). The VRMs regulate the system current and voltage according to the VID code output by the CPU package. The VRM is a DC-to-DC point-of-load convertor specified for +12 Volt input and programmable 100 Amp output. The VRM is different on the new 8-DIMM Processor Boards to accommodate the additional memory requirements. Memory Architecture Each CPU includes a low-laten
