Summary of the content on the page No. 1
®
QLogic HCA and InfiniPath Software
Install Guide
Version 2.2
IB0056101-00 G
Summary of the content on the page No. 2
® QLogic HCA and InfiniPath Software Install Guide Version 2.2 S Information furnished in this manual is believed to be accurate and reliable. However, QLogic Corporation assumes no responsibility for its use, nor for any infringements of patents or other rights of third parties which may result from its use. QLogic Corporation reserves the right to change product specifications at any time without notice. Applications described in this document for any of these products are for illustrative
Summary of the content on the page No. 3
Table of Contents 1 Introduction Who Should Read this Guide. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-1 How this Guide is Organized . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-1 Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-2 Interoperability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1-3 Conventions Used in this Guide.
Summary of the content on the page No. 4
® QLogic HCA and InfiniPath Software Install Guide Version 2.2 S Hardware Installation for QLE7240, QLE7280, or QLE7140 with PCI Express Riser . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-9 Dual Adapter Installation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-9 Installation Steps. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-9 Hardware Installation for QHT7140 with HTX Riser . . . . . . . . . . . . . . 4-1
Summary of the content on the page No. 5
® QLogic HCA and InfiniPath Software Install Guide Version 2.2 A Starting and Stopping the InfiniPath Software . . . . . . . . . . . . . . . . . . . . . . . 5-26 Rebuilding or Reinstalling Drivers After a Kernel Upgrade . . . . . . . . . . . . . 5-28 Rebuilding or Reinstalling Drivers if a Different Kernel is Installed. . . . . . . . 5-29 Further Information on Configuring and Loading Drivers . . . . . . . . . . . . . . . 5-29 LED Link and Data Indicators. . . . . . . . . . . . . . . . . . . . .
Summary of the content on the page No. 6
® QLogic HCA and InfiniPath Software Install Guide Version 2.2 S B Configuration Files C RPM Descriptions InfiniPath and OpenFabrics RPMs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . C-1 Different Nodes May Use Different RPMs . . . . . . . . . . . . . . . . . . . . . . . . . . C-1 RPM Version Numbers and Identifiers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . C-1 RPM Organization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Summary of the content on the page No. 7
® QLogic HCA and InfiniPath Software Install Guide Version 2.2 A List of Figures Figure Page 4-1 QLogic QLE7280 with IBA7220 ASIC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-7 4-2 QLogic QLE7140 Card with Riser, Top View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4-7 4-3 QLogic QHT7040/QHT7140 Full and Low Profile Cards with Riser, Top View . . . . 4-8 4-4 PCIe Slot in a Typical Motherboard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Summary of the content on the page No. 8
® QLogic HCA and InfiniPath Software Install Guide Version 2.2 S Notes Page viii IB0056101-00 G
Summary of the content on the page No. 9
1 Introduction This chapter describes the contents, intended audience, and organization of the QLogic HCA and InfiniPath Software Install Guide. The QLogic HCA and InfiniPath Software Install Guide contains instructions for installing the QLogic Host Channel Adapters (HCAs) and the InfiniPath and OpenFabrics software. The following adapters are covered in this guide: ® QLE7140 PCI Express (PCIe) QLE7240 PCI Express QLE7280 PCI Express QHT7040/QHT7140 HyperTransport Expansion (HTX™) Who S
Summary of the content on the page No. 10
1 – Introduction Overview S Section 3, Step-by-Step Installation Checklist, provides a high-level overview of the hardware and software installation procedures. Section 4, Hardware Installation, includes instructions for installing the QLogic QLE7140, QLE7240, QLE7280, QHT7040, and QHT7140 HCAs. Section 5, Software Installation, includes instructions for installing the QLogic InfiniPath and OpenFabrics software. Appendix A, Installation Troubleshooting, contains information about issues
Summary of the content on the page No. 11
1 – Introduction Interoperability A InfiniPath OpenFabrics software is interoperable with other vendors’ InfiniBand Host Channel Adapters (HCAs) running compatible OpenFabrics releases. There are several options for subnet management in your cluster: Use the embedded Subnet Manager (SM) in one or more managed switches supplied by your InfiniBand switch vendor. Use the Open source Subnet Manager (OpenSM) component of OpenFabrics. Use a host-based Subnet Manager. Interoperability QLogic In
Summary of the content on the page No. 12
1 – Introduction Documentation S Table 1-1. Typographical Conventions (Continued) Convention Meaning user input Bold fixed-space font is used for literal items in commands or con- structs that you type. $ Indicates a command line prompt. # Indicates a command line prompt as root when using bash or sh. [ ] Brackets enclose optional elements of a command or program con- struct. ... Ellipses indicate that a preceding element can be repeated. > A right caret identifies the cascading path of menu com
Summary of the content on the page No. 13
1 – Introduction Contact Information A Contact Information Support Headquarters QLogic Corporation 4601 Dean Lakes Blvd Shakopee, MN 55379 USA QLogic Web Site www.qlogic.com Technical Support Web Site support.qlogic.com Technical Support Email support@qlogic.com Technical Training Email tech.training@qlogic.com North American Region Email support@qlogic.com Phone +1-952-932-4040 Fax +1 952-974-4910 All other regions of the world QLogic Web Site www.qlogic.com IB0056101-00 G 1-5
Summary of the content on the page No. 14
1 – Introduction Contact Information S Notes 1-6 IB0056101-00 G
Summary of the content on the page No. 15
2 Feature Overview This section contains the features for this release, the supported QLogic adapter models, supported distributions and kernels, and a list of the software components. What’s New in this Release This release adds support for the QLE7240 and QLE7280 InfiniBand DDR Host Channel Adapters (HCAs), which offer twice the link bandwidth of SDR HCAs. The extra bandwidth improves performance for both latency-sensitive and bandwidth-intensive applications. This version of the InfiniPa
Summary of the content on the page No. 16
2 – Feature Overview New Features S Table 2-1. QLogic Adapter Model Numbers (Continued) QLogic Model Description Number QLE7280 Single port 20Gbps DDR 4X InfiniBand to PCI Express x16 adapter. Supported on systems with PCI Express x16 slots. The QLE7280 is backward compatible; it can also be used with PCIe adapters that connect to x8 slots. Table Notes PCIe is Gen 1 a The QHT7140 has a smaller form factor than the QHT7040, but is otherwise the same. Throughout this document, the QHT7040 and
Summary of the content on the page No. 17
2 – Feature Overview Supported Distributions and Kernels A A subset of the QLogic InfiniBand Fabric Suite, the enablement tools, are offered with this release. Two separate SCSI RDMA Protocol (SRP) modules are provided: the standard OpenFabrics (OFED) SRP, and QLogic SRP. QLogic MPI supports running exclusively on a single node without the installation of the HCA hardware. OpenMPI and MVAPICH libraries built with the GNU, PGI, PathScale™, and ® Intel compilers are available, with corres
Summary of the content on the page No. 18
2 – Feature Overview Compiler Support S Table 2-2. InfiniPath/OpenFabrics Supported Distributions and Kernels (Continued) InfiniPath/OpenFabrics Supported Distribution Kernels Red Hat Enterprise Linux 5.0 (RHEL 5.0), 2.6.18-8, 2.6.18-53 (x86_64) RHEL 5.1 CentOS 5.0, 5.1 (Rocks 5.0, 5.1) 2.6.18, 2.6.18-53 (x86_64) Scientific Linux 5.0, 5.1 2.6.18, 2.6.18-53 (x86_64) ® SUSE Linux Enterprise Server 2.6.16.21, 2.6.16.46 (x86_64) (SLES 10 GM, SP 1) NOTE: Fedora Core 4 and Fedora Core 5 are not supp
Summary of the content on the page No. 19
2 – Feature Overview Software Components A Included components are: InfiniPath driver InfiniPath Ethernet emulation (ipath_ether) InfiniPath libraries InfiniPath utilities, configuration, and support tools, including ipath_checkout, ipath_control, ipath_pkt_test, and ipathstats QLogic MPI QLogic MPI benchmarks and utilities OpenMPI and MVAPICH libraries built with the GNU, PGI, PathScale, and Intel compilers, with corresponding mpitests RPMs and mpi-selector OpenFabrics protocols, inc
Summary of the content on the page No. 20
2 – Feature Overview Software Components S More details about the hardware and software can be found in Section 4 and Section 5. 2-6 IB0056101-00 G
