Silicon Graphics ICE XA Manuel d'installation

SGI®ICE™XA System 

Hardware User Guide



Document Number 007-6399-002

permission is granted to copy, distribute, or create derivative works from the contents of this electronic documentation in any manner, in whole or in part,

without the prior written permission of SGI.

LIMITED RIGHTS LEGEND

The software described in this document is "commercial computer software" provided with restricted rights (except as to included open/free source) as specified

in the FAR 52.227-19 and/or the DFAR 227.7202, or successive sections. Use beyond license provisions is a violation of worldwide intellectual property laws,

treaties and conventions. This document is provided with limited rights as defined in 52.227-14.

The electronic (software) version of this document was developed at private expense; if acquired under an agreement with the USA government or any

contractor thereto, it is acquired as “commercial computer software” subject to the provisions of its applicable license agreement, as specified in (a) 48 CFR

12.212 of the FAR; or, if acquired for Department of Defense units, (b) 48 CFR 227-7202 of the DoD FAR Supplement; or sections succeeding thereto.

Contractor/manufacturer is SGI, 900 North McCarthy Blvd. Milpitas, CA 95035.

TRADEMARKS AND ATTRIBUTIONS

SGI, and the SGI logo are registered trademarks and Rackable, SGI Lustre and SGI ICE are trademarks of, Silicon Graphics International, in the United States

and/or other countries worldwide.

Intel, Intel QuickPath Interconnect (QPI), Itanium and Xeon are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States

and other countries. 

UNIX is a registered trademark in the United States and other countries, licensed exclusively through X/Open Company, Ltd. 

Infiniband is a trademark of the InfiniBand Trade Association. 

Red Hat and all Red Hat-based trademarks are trademarks or registered trademarks of Red Hat, Inc. in the United States and other countries.

Linux is a registered trademark of Linus Torvalds.

All other trademarks mentioned herein are the property of their respective owners.

007-6399-002 iii

Record of Revision

Version Description

-001 May, 2015

First release

-002 July, 2015

Second release covering updated cpower commands

007-6399-002 v

Contents

List of Figures . . . . . . . . . . . . . . . . . . . . . . . . ix

List of Tables . . . . . . . . . . . . . . . . . . . . . . . . xi

Audience. . . . . . . . . . . . . . . . . . . . . . . . . . xiii

Important Information . . . . . . . . . . . . . . . . . . . . . . xiii

Chapter Descriptions . . . . . . . . . . . . . . . . . . . . . . xiv

Related Publications . . . . . . . . . . . . . . . . . . . . . . . xv

Conventions . . . . . . . . . . . . . . . . . . . . . . . . .xvii

Product Support . . . . . . . . . . . . . . . . . . . . . . . .xvii

Reader Comments . . . . . . . . . . . . . . . . . . . . . . xviii

1. Operation Procedures . . . . . . . . . . . . . . . . . . . . . . 1

Precautions . . . . . . . . . . . . . . . . . . . . . . . . . 1

ESD Precaution . . . . . . . . . . . . . . . . . . . . . . . 1

Safety Precautions . . . . . . . . . . . . . . . . . . . . . . 2

Console Connections . . . . . . . . . . . . . . . . . . . . . . 3

Powering the System On and Off . . . . . . . . . . . . . . . . . . . 4

Preparing to Power On . . . . . . . . . . . . . . . . . . . . . 5

Powering On and Off . . . . . . . . . . . . . . . . . . . . . 8

Console Management Power (cpower) Commands . . . . . . . . . . . . 8

Monitoring Your Server . . . . . . . . . . . . . . . . . . . . . . 12

Chassis Management Monitoring and Control . . . . . . . . . . . . . . . 12

PCIe Subsystem Control . . . . . . . . . . . . . . . . . . . . 13

2. System Management . . . . . . . . . . . . . . . . . . . . . . 15

Using the 1U Console Option . . . . . . . . . . . . . . . . . . . . 17

Levels of System and Chassis Control . . . . . . . . . . . . . . . . . . 17

vi 007-6399-002

Contents

Chassis Controller Interaction . . . . . . . . . . . . . . . . . . . . 17

Chassis Manager Interconnects . . . . . . . . . . . . . . . . . . . 18

Chassis Management Control (CMC) Functions . . . . . . . . . . . . . . 19

System Power Status . . . . . . . . . . . . . . . . . . . . . . . 19

3. System Overview . . . . . . . . . . . . . . . . . . . . . . . 21

System Models . . . . . . . . . . . . . . . . . . . . . . . . 22

SGI ICE XA System and Blade Architectures . . . . . . . . . . . . . . . . 26

IP125 Blade Architecture Overview . . . . . . . . . . . . . . . . . 26

IP139 Blade Architecture Overview . . . . . . . . . . . . . . . . . 27

QuickPath Interconnect Features. . . . . . . . . . . . . . . . . . . . 28

QPI Bandwidth Overview . . . . . . . . . . . . . . . . . . . . 28

Blade Memory Features . . . . . . . . . . . . . . . . . . . . . 29

Blade DIMM Memory Features . . . . . . . . . . . . . . . . . 29

DIMM Bandwidth Factors . . . . . . . . . . . . . . . . . . . 29

Memory Channel Recommendation . . . . . . . . . . . . . . . . 30

System InfiniBand Switch Blades . . . . . . . . . . . . . . . . . . 30

System Features and Major Components . . . . . . . . . . . . . . . . . 31

Modularity and Scalability . . . . . . . . . . . . . . . . . . . . 31

System Administration Server . . . . . . . . . . . . . . . . . . 32

Rack Leader Controller . . . . . . . . . . . . . . . . . . . . 33

Multiple Chassis Manager Connections . . . . . . . . . . . . . . . 33

The RLC as Fabric Manager . . . . . . . . . . . . . . . . . . 34

Service Nodes . . . . . . . . . . . . . . . . . . . . . . . 35

Batch Server Node . . . . . . . . . . . . . . . . . . . . . 36

I/O Gateway Node . . . . . . . . . . . . . . . . . . . . . 36

Optional Lustre Nodes Overview . . . . . . . . . . . . . . . . . . 37

MDS Node . . . . . . . . . . . . . . . . . . . . . . . 37

OSS Node . . . . . . . . . . . . . . . . . . . . . . . 38

Reliability, Availability, and Serviceability (RAS) . . . . . . . . . . . . . . . 38

Contents

007-6399-002 vii

Optional SGI Remote Services (SGI RS) . . . . . . . . . . . . . . . . . 39

SGI Remote Services Primary Capabilities . . . . . . . . . . . . . . . 39

SGI Remote Services Benefits . . . . . . . . . . . . . . . . . . . 40

SGI Remote Service Operations Overview. . . . . . . . . . . . . . . . 40

SGI Knowledgebase . . . . . . . . . . . . . . . . . . . . . 41

SGI Warranty Levels . . . . . . . . . . . . . . . . . . . . . 42

System Components . . . . . . . . . . . . . . . . . . . . . . . 43

E-Cell Rack Numbering . . . . . . . . . . . . . . . . . . . . 43

Optional System Components . . . . . . . . . . . . . . . . . . . 44

4. Rack Information . . . . . . . . . . . . . . . . . . . . . . . 45

Overview . . . . . . . . . . . . . . . . . . . . . . . . . 45

SGI ICE XA Series D-Rack (42U) . . . . . . . . . . . . . . . . . . . 46

ICE XA D-Rack Technical Specifications . . . . . . . . . . . . . . . . . 49

SGI ICE XA E-Cell Rack Assemblies . . . . . . . . . . . . . . . . . . 50

E-Cell Functional Overview . . . . . . . . . . . . . . . . . . . 51

E-Cell Compute Rack Specifications . . . . . . . . . . . . . . . . 51

E-Cell Cooling Rack Specifications . . . . . . . . . . . . . . . . 52

Cooling Distribution Unit (CDU) Rack Specifications . . . . . . . . . . . 53

5. SGI ICE XA Administration/Leader Servers . . . . . . . . . . . . . . . 55

Overview . . . . . . . . . . . . . . . . . . . . . . . . . 56

System Hierarchy . . . . . . . . . . . . . . . . . . . . . . 56

Communication Hierarchy. . . . . . . . . . . . . . . . . . . 57

1U Rack Leader Controller and Administration Server . . . . . . . . . . . . . . 59

1U Service Nodes . . . . . . . . . . . . . . . . . . . . . . . 60

C1104-GP1 1U Service Node . . . . . . . . . . . . . . . . . . . 60

2U Service Nodes . . . . . . . . . . . . . . . . . . . . . . . 62

C2112-GP2 Service Node . . . . . . . . . . . . . . . . . . . . 62

SGI UV 30 2U Service Node . . . . . . . . . . . . . . . . . . . 63

viii 007-6399-002

Contents

A. Technical Specifications and Pinouts . . . . . . . . . . . . . . . . . . 65

System-level Specifications . . . . . . . . . . . . . . . . . . . . . 65

D-Rack Physical and Power Specifications . . . . . . . . . . . . . . . . 66

D-Rack System Environmental Specifications . . . . . . . . . . . . . . . 67

ICE XA E-Rack Technical Specifications . . . . . . . . . . . . . . . . 68

Ethernet Port Specification . . . . . . . . . . . . . . . . . . . . 70

B. Safety Information and Regulatory Specifications . . . . . . . . . . . . . . 71

Safety Information . . . . . . . . . . . . . . . . . . . . . . . 71

Regulatory Specifications . . . . . . . . . . . . . . . . . . . . . 73

CMN Number . . . . . . . . . . . . . . . . . . . . . . . 73

CE Notice and Manufacturer’s Declaration of Conformity . . . . . . . . . . . . 73

Electromagnetic Emissions . . . . . . . . . . . . . . . . . . . . 73

FCC Notice (USA Only) . . . . . . . . . . . . . . . . . . . 74

Industry Canada Notice (Canada Only) . . . . . . . . . . . . . . . 74

VCCI Notice (Japan Only) . . . . . . . . . . . . . . . . . . . 75

Chinese Class A Regulatory Notice . . . . . . . . . . . . . . . . 75

Korean Class A Regulatory Notice . . . . . . . . . . . . . . . . . 75

Shielded Cables . . . . . . . . . . . . . . . . . . . . . . . 76

Electrostatic Discharge and Laser Compliance . . . . . . . . . . . . . . . 76

Lithium Battery Statements . . . . . . . . . . . . . . . . . . . . 77

007-6399-002 ix

List of Figures

Figure 1-1 Flat Panel Rackmount Console Option . . . . . . . . . . 3

Figure 1-2 Administrative Controller Video Console Connection Points . . . . 4

Figure 1-3 Eight-Outlet Single-Phase PDU Example . . . . . . . . . 6

Figure 1-4 Three-Phase PDU Example . . . . . . . . . . . . . 7

Figure 2-1 SGI ICE XA System Admin and Service Node Network Access Example . 16

Figure 2-2 E-rack System Chassis Management Diagram (With CDU). . . . . 18

Figure 3-1 SGI ICE XA Series System E-Cell Assembly Example . . . . . . 23

Figure 3-2 D-rack Standard and Optional Components Example . . . . . . 25

Figure 3-3 SGI ICE XA System and Network Components Overview . . . . . 32

Figure 3-4 Administration and RLC Cabling to Chassis Managers . . . . . . 34

Figure 3-5 Example Rear View of a 1U Service Node . . . . . . . . . 35

Figure 3-6 2U Service Node Front and Rear Panel Example . . . . . . . 36

Figure 3-7 SGI Remote Solutions Process Overview . . . . . . . . . 41

Figure 4-1 D-Rack Front Lock Example. . . . . . . . . . . . . 47

Figure 4-2 Optional Water-Chilled Door Panels on Rear of ICE XA D-Rack . . . 48

Figure 4-3 E-Cell Rack Configuration Example. . . . . . . . . . . 50

Figure 4-4 E-Cell Rack Assembly Example (CDU on Left). . . . . . . . 54

Figure 5-1 SGI ICE XA System Administration Hierarchy Example Diagram . . . 58

Figure 5-2 1U Rack Leader Controller (RLC)/Administration Server Front Panel . . 59

Figure 5-3 1U RLC/Administration Server Rear Components Example . . . . 59

Figure 5-4 SGI Rackable C1104-GP1 1U Service Node Front and Rear Panel Example 61

Figure 5-5 SGI Rackable C1104-GP1 System Control Panel and LEDs . . . . 61

Figure 5-6 SGI Rackable C2112-GP2 Service Node Front and Rear Panel Example . 62

Figure 5-7 SGI UV 30 Service Node Front and Rear Panel Example . . . . . 63

x007-6399-002

List of Figures

Figure A-1 Ethernet Port . . . . . . . . . . . . . . . . . 70

Figure B-1 VCCI Notice (Japan Only) . . . . . . . . . . . . . 75

Figure B-2 Chinese Class A Regulatory Notice . . . . . . . . . . . 75

Figure B-3 Korean Class A Regulatory Notice . . . . . . . . . . . 75

Table des matières

Autres manuels Silicon Graphics Matériel réseau

Silicon Graphics

Silicon Graphics Altix XE1300 Manuel utilisateur

Silicon Graphics

Silicon Graphics COPAN 400T/TX Manuel utilisateur

Manuels Matériel réseau populaires d'autres marques

Matrix Switch Corporation

Matrix Switch Corporation MSC-HD161DEL Manuel utilisateur

B&B Electronics

B&B Electronics ZXT9-IO-222R2 Manuel utilisateur

Yudor

Yudor YDS-16 Manuel utilisateur

D-Link

D-Link ShareCenter DNS-320L Manuel utilisateur

Samsung

Samsung ES1642dc Instructions d'utilisation

Honeywell Home

Honeywell Home LTEM-PV Instructions de montage

evertz

evertz 7700 Series Manuel utilisateur

D-Link

D-Link ShareCenter DNS-343 Manuel utilisateur

Asante

Asante AsanteBridge 1012 Manuel utilisateur

FireBrick

FireBrick FB2700 Manuel utilisateur

Audiovox Electronics

Audiovox Electronics ARWH2T Manuel utilisateur

ADC

ADC DSX-1 Manuel

NetComm

NetComm NF2 Manuel utilisateur

Alcatel-Lucent

Alcatel-Lucent 5620 Manuel utilisateur

Dell EMC

Dell EMC XC6420 Series Manuel utilisateur

Lanner

Lanner NCA-1020A Manuel utilisateur

Allied Telesis

Allied Telesis AT-TN121-A Manuel utilisateur

Arista

Arista CCA-ETM-Q12 Manuel utilisateur