Mellanox Technologies MNPH29C-XSR Manuel utilisateur

www.mellanox.com

ConnectX®-2 EN Dual Port SFP+ Ethernet

Adapter Card User Manual

P/N:

MNPH29C-XSR, MNPH29C-XTR, MNPH29D-XSR, MNPH29D-XTR

Rev 1.6

Mellanox Technologies

350 Oakmead Parkway Suite 100

Sunnyvale, CA 94085

U.S.A.

www.mellanox.com

Tel: (408) 970-3400

Fax: (408) 970-3403

Mellanox Technologies, Ltd.

PO Box 586 Hermon Building

Yokneam 20692

Israel

Tel: +972-4-909-7200

Fax: +972-4-959-3245

Mellanox®, BridgeX®, ConnectX®, InfiniBlast®, InfiniBridge®, InfiniHost®, InfiniRISC®, InfiniScale®, InfiniPCI®, PhyX® and

Virtual Protocol Interconnect® are registered trademarks of Mellanox Technologies, Ltd. CORE-Direct and FabricIT are trademarks of

Mellanox Technologies, Ltd. All other marks and names mentioned herein may be trademarks of their respective companies.

ConnectX-2 Ethernet Card User Manual

Document Number: 3160

Rev 1.6

Mellanox Technologies

NOTE:

THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT (“PRODUCT(S)”) AND ITS RELATED DOCUMENTATION ARE

PROVIDED BY MELLANOX TECHNOLOGIES “AS-IS” WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE

OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS. THE

CUSTOMER'S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX

TECHNOLOGIES TO FULLY QUALIFY THE PRODUCTO(S) AND/OR THE SYSTEM USING IT. THEREFORE, MELLANOX

TECHNOLOGIES CANNOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE

HIGHEST QUALITY. ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED

WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT ARE

DISCLAIMED. IN NO EVENT SHALL MELLANOX BE LIABLE TO CUSTOMER OR ANY THIRD PARTIES FOR ANY DIRECT,

INDIRECT, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES OF ANY KIND (INCLUDING, BUT NOT LIMITED TO,

PAYMENT FOR PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS

INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY,

OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY FROM THE USE OF THE PRODUCT(S) AND

RELATED DOCUMENTATION EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

ConnectX-2 Ethernet Card User Manual Rev 1.6

Mellanox Technologies 3

Table of Contents

Table of Contents 3

List of Figures 5

List of Tables 6

Revision History 7

About this Manual 8

Intended Audience 8

Related Documentation 8

Online Resources 8

Document Conventions 8

Technical Support 8

Firmware and Software Updates 9

Chapter 1 Overview 10

1.1 Adapter Cards Covered in this Manual 11

1.2 Mellanox Part Numbering Legend 13

1.3 Finding the MAC and Serial Number on the Adapter Cards 14

1.4 Safety Warnings 14

Chapter 2 Adapter Card Interfaces 16

2.1 I/O Interfaces 16

2.2 Power 18

2.3 Memory 18

2.4 VPD Layout 19

Chapter 3 Driver Software and Firmware 22

3.1 Driver Software 22

3.2 RDMA over Converged Ethernet (RoCE) 22

3.3 Updating Card Firmware 23

3.4 ConnectX EN PXE 24

Chapter 4 Ethernet Adapter Card Installation 25

4.1 Hardware and Software Requirements 25

4.2 Installation Instructions 25

4.3 Set Up 26

4.4 Cables and Modules 31

Appendix A Specifications 34

A.1 MNPH29D-X[ST]R Specifications 34

A.2 MNPH29C-X[ST]R Specifications 35

A.3 Board Mechanical Drawing and Dimensions 35

A.4 EMC Certification Statements 37

Appendix B Interface Connectors Pinout 40

B.1 I2C-Compatible Connector Pinout 40

B.2 PCI Express x8Connector Pinout 40

B.3 PCI Express Connector Pinout 41

B.4 SFP+ Connector Pinout 41

Appendix C Replacing a Tall Bracket With a Short Bracket 43

C.1 Remove the Existing Bracket from the Adapter Card 43

C.2 Installing the New Bracket 43

Appendix D Avertissements de sécurité d’installation (Warnings in French) 45

Rev 1.6

Mellanox Technologies

Appendix E Sicherheitshinweise (Warnings in German) 46

Appendix F Advertencias de seguridad para la instalación (Warnings in Spanish) 47

ConnectX-2 Ethernet Card User Manual Rev 1.6

Mellanox Technologies 5

List of Figures

Figure 1: SFP+ NIC Component Side and Bracket Views 12

Figure 2: Card Product Label 14

Figure 3: Port Numbering 16

Figure 4: LED - Port Association 17

Figure 5: Physical and Logical Link Indications 17

Figure 6: I2C Connector 18

Figure 7: Flash Jumper 19

Figure 8: Support Download Assistant 24

Figure 9: Hardware Devices 27

Figure 10: PCI Device 28

Figure 11: Module With Locking Mechanism Closed 32

Figure 12: Module With Locking Mechanism Open 32

Figure 13: Schematic of the ConnectX-2 Small Form Factor MNPH29D Adapter Card 36

Figure 14: Schematic of the ConnectX-2 Card MNPH29C Adapter Card 37

Figure 15: Compatible Connector Plug and Pinout 40

Figure 16: Rear View of Module With Pin Placement 41

Figure 17: Remove the Bracket 43

Figure 18: Putting on the Bracket 44

Rev 1.6

Mellanox Technologies

List of Tables

Table 1: Revision History Table 7

Table 2: Documents List 8

Table 3: Network Interface Cards 11

Table 4: Mellanox Cards Part Numbering Key 13

Table 5: LEDs 17

Table 6: Jumper Configuration 19

Table 7: VPD Layout for MNPH29D-X[ST]R 19

Table 8: VPD Layout for MNPH29C-X[ST]R 20

Table 9: Hardware and Software Requirements 25

Table 10: Specifications for MNPH29D-X[ST]R 34

Table 11: Specifications for MNPH29C-X[ST]R 35

Table 12: Adapter Cards Certification Status 37

Table 13: I2C-Compatible Connector Pinout 40

Table 14: SFP+ Connector Pinout 42

ConnectX-2 Ethernet Card User Manual Rev 1.6

Mellanox Technologies 7

Revision History

This document was printed on 2/15/11.

Table 1 - Revision History Table

Date Rev Comments/Changes

Jan. 2011 1.6 Changed Air flow requirement

Added to the Set up section

Dec. 19th,

2010

1.5 Minor formatting changes

Nov. 22nd,

2010

1.4 Added Generation D card Mini Form Factor

Oct. 28th,

2010

1.3 Added Technical Support and Firmware and Software Updates sections to the Pref-

ace section

Added RoCE

Added ConnectX EN PXE

Added Set up section, This is a sanity check after card installation.

Added KCC statement to Appendix A

Added QSFP to SFP+ QSA adapter

Removed Gen 1 cards

Formatted EMC table

Changed EN 60950-1: 2001 to EN 60950-1: 2006

Changed RDMA over Ethernet

Added RDMA over Ethernet

New template

April 2010 1.2 New power numbers

Feb. 2010 1.1 Added Section on PXE boot

Feb. 2010 1.0 Initial Release

Rev 1.6

Mellanox Technologies

About this Manual

This User Manual describes Mellanox Technologies ConnectX®-2 Dual Port 10Gigabit Ethernet

PCI Express x8 adapter cards. It provides details as to the interfaces of the board, specifications,

required software and firmware for operating the board, and relevant documentation.

Intended Audience

This manual is intended for the installer and user of these cards.

The manual assumes basic familiarity with Ethernet networks and architecture specifications.

Related Documentation

Table 2 - Documents List

Online Resources

• Mellanox Technologies Web pages: http://www.mellanox.com

• Mellanox Technologies Firmware download Web page:

http://www.mellanox.com =>

Document Conventions

When discussing memory sizes, MB and MBytes are used in this document to mean size in mega

bytes. The use of Mb or Mbits (small b) indicates size in mega bits.

Technical Support

Customers who purchased Mellanox products directly from Mellanox are invited to contact us

through the following methods.

•URL:http://www.mellanox.com => Support

• E-mail: support@mellanox.com

Mellanox Firmware Tools (MFT) User Manual

Document no. 2204UG

User Manual describing the set of MFT firmware management tools for a

single node.

See http://www.mellanox.com => Firmware & Downloads => Download

Firmware Tools

http://www.mellanox.com => Support => Download Firmware Tools

IEEE Std 802.3 Specification This is the IEEE Ethernet specification

http://standards.ieee.org/getieee802

PCI Express 2.0 Specifications Industry Standard PCI Express 2.0 Card Electromechanical Specification,

Rev 1.3.

ConnectX-2 Ethernet Card User Manual Rev 1.6

Mellanox Technologies 9

• Tel: +1.408.916.0055

Customers who purchased Mellanox M-1 Global Support Services, please see your contract for

details regarding Technical Support.

Customers who purchased Mellanox products through a Mellanox approved reseller should first

seek assistance through their reseller.

Firmware and Software Updates

The Mellanox support downloader contains software, firmware and knowledge database informa-

tion for Mellanox products. Access the data base from the Mellanox Support Web page,

http://www.mellanox.com=>Support

or use the following link to go directly to the Mellanox Support Download Assistant page,

http://www.mellanox.com/supportdownloader/.

Overview

Rev 1.6

Mellanox Technologies

1 Overview

This document is a User Manual for Mellanox Technologies cards based on the ConnectX®-2

ENintegrated circuit device. The cards described in this manual have the following main features:

• IEEE Std 802.3 compliant

• 10 Gb/s Ethernet

• Dual SFP+ ports for connection Ethernet traffic

• PCI Express 2.0 (1.1 compatible) through an x8 edge connector up to 5GT/s

• Fiber Channel encapsulation (FCoE)

• RDMA over Converged Ethernet (RoCE)

•RoHS-R6

• Two bracket heights: short and tall

Ce manuel convient aux modèles suivants

Table des matières

Autres manuels Mellanox Technologies Carte réseau

Mellanox Technologies

Mellanox Technologies ConnectX-3 MCX341A-XCAN Manuel utilisateur

Mellanox Technologies

Mellanox Technologies ConnectX-2 Series Manuel utilisateur

Mellanox Technologies

Mellanox Technologies ConnectX-4 Lx Mode d’emploi

Mellanox Technologies

Mellanox Technologies ConnectX-4 MCX413A-BCAT Manuel utilisateur

Mellanox Technologies

Mellanox Technologies ConnectX MNEH28-XSC Manuel utilisateur

Mellanox Technologies

Mellanox Technologies MetroX TX6240 Instructions d'utilisation

Mellanox Technologies

Mellanox Technologies ConnectX-3 Pro MCX349A-XCCN Manuel utilisateur

Manuels Carte réseau populaires d'autres marques

FirstComm

FirstComm OBiWiFi5G Manuel utilisateur

Sun Microsystems

Sun Microsystems Interface Adapter Manuel utilisateur

TRENDnet

TRENDnet TU2-ETG Manuel utilisateur

YASKAWA

YASKAWA SI-EN3 Manuel utilisateur

Paradyne

Paradyne BitStorm 2600 IP DSLAM Manuel utilisateur

Belkin

Belkin F5D7050 Manuel utilisateur

3Com

3Com EtherLink 3C509B Manuel utilisateur

TRENDnet

TRENDnet TEG-PCITX Manuel utilisateur

Cisco

Cisco MC16E Manuel utilisateur

Delta Electronics

Delta Electronics Braking Modules VFDB Series Manuel utilisateur

TwinMOS

TwinMOS Booming Manuel utilisateur

Dialogic

Dialogic Media Board DM/V1200BTEPEQ Manuel utilisateur

Buffalo

Buffalo AirStation WLI-PCM-L11GP Manuel utilisateur

National Instruments

National Instruments NI 9234 Manuel utilisateur

Hama

Hama 49276 Manuel utilisateur

Linksys

Linksys WCF54G - Wireless-G Compact Flash Card Manuel d'utilisation

Compaq

Compaq Wireless LAN 100 Manuel utilisateur

Bose

Bose PowerMatch Dante Manuel utilisateur