Summary of the content on the page No. 1
™
Sun StorEdge 3900 and 6900
Series 2.0 Troubleshooting Guide
Sun Microsystems, Inc.
4150 Network Circle
Santa Clara, CA 95054 U.S.A.
650-960-1300
Part No. 816-5255-12
March 2003, Revision A
Send comments about this document to:docfeedback@sun.com
Summary of the content on the page No. 2
Copyright 2003 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, California 95054, U.S.A. All rights reserved. Sun Microsystems, Inc. has intellectual property rights relating to technology embodied in the product that is described in this document. In particular, and without limitation, these intellectual property rights may include one or more of the U.S. patents listed at http://www.sun.com/patents and one or more additional patents or pending patent applications in the U.S. and in ot
Summary of the content on the page No. 3
Contents Preface XV How This Book Is Organized XV Using UNIX Commands XVI Typographic Conventions XVII Shell Prompts XVII Related Documentation XVIII Accessing Sun Documentation Online XX Sun Welcomes Your Comments XX 1. Introduction 1 Predictive Failure Analysis (PFA) Capabilities 2 2. General Troubleshooting Procedures 3 High-Level Troubleshooting Tasks 3 Host-Side Troubleshooting 6 Storage Service Processor-Side Troubleshooting 6 Verifying the Configuration Settings 7 ▼ To Verify Configuratio
Summary of the content on the page No. 4
Sun StorEdge 6900 Series Multipathing Example 11 Multipathing Options in the Sun StorEdge 6900 Series 16 Manually Halting the I/O 17 ▼ To Quiesce the I/O 17 ▼ To Unconfigure thec2 Path 17 Suspending the I/O 18 ▼ To Put thec2 Path Back into Production 19 ▼ To View the Dynamic Multi-Pathing (DMP) Properties 20 ▼ To Put theDMP-Enabled Paths Back into Production 22 3. Troubleshooting Tools 23 Storage Automated Diagnostic Environment 2.2 23 Example Topology 24 Generating Component-Specific Event Grid
Summary of the content on the page No. 5
Troubleshooting the A1 or B1 FC Link 42 Verifying the Data Host 45 FRU Tests Available for the A1 or B1 FC Link Segment 46 ▼ To Isolate the A1 or B1 FC Link 48 Troubleshooting the A2 or B2 FC Link 49 Verifying the Data Host 51 Verifying the A2 or B2 FC Link 52 FRU Tests Available for the A2 or B2 FC Link Segment 52 ▼ To Isolate the A2 or B2 FC Link 52 Troubleshooting the A3 or B3 FC Link 54 Verifying the Data Host 56 Verifying the Storage Service Processor-Side 57 FRU Tests Available for the A3
Summary of the content on the page No. 6
▼ To Replace the Alternate Master or Slave Monitoring Host 72 7. Troubleshooting Switches 73 About the Switches 73 Zone Modifications 74 Switchless Configurations 75 ▼ Diagnosing and Troubleshooting Switch Hardware Problems 75 Using the Switch Event Grid 77 ▼ To Use the Switch Event Grid 77 setupswitch Exit Values 85 8. Troubleshooting the Sun StorEdge T3+ Array Devices 87 Troubleshooting the T1 or T2 Data Path 88 Notification Events 89 ▼ To Verify the Storage Service Processor 92 FRU Tests Avai
Summary of the content on the page No. 7
▼ To Clear the Log 110 Virtualization Engine LEDs 110 Power LED Codes 111 Interpreting LED Service and Diagnostic Codes 111 Back Panel Features 112 Ethernet Port LEDs 112 FC Link Error Status Report 113 ▼ To Check the FC Link Error Status Manually 113 Translating Host-Device Names 115 Displaying the VLUN Serial Number 116 ▼ To Display Devices That are Not Sun StorEdge Traffic Manager (MPxIO)- Enabled 116 ▼ To Display Sun StorEdge Traffic Manager (MPxIO)-Enabled Devices 117 Viewing the Virtualiza
Summary of the content on the page No. 8
▼ To Use the Sun StorEdge T3+ Array Failover Driver GUI 140 ▼ To Use the Sun StorEdge T3+ Array Failover Driver Command Line Interface (CLI) 142 11. Example of Fault Isolation 147 A. Virtualization Engine References 155 SRN Reference 155 SRN/SNMP Single Point-of-Failure Descriptions 159 Port Communication Numbers 160 Virtualization Engine Service Codes 160 B. Configuration Utility Error Messages 163 Virtualization Engine Error Messages 164 Switch Error Messages 168 Sun StorEdge T3+ Array Partner
Summary of the content on the page No. 9
List of Figures FIGURE 2-1 Sun StorEdge 6900 Series Logical View 11 FIGURE 2-2 Primary Data Paths to the Alternate Master 12 FIGURE 2-3 Primary Data Paths to the Master Sun StorEdge T3+ Array 13 FIGURE 2-4 Path Failure—Before the Second Tier of Switches 14 FIGURE 2-5 Path Failure—I/O Routed Through Both HBAs 15 FIGURE 3-1 Storage Automated Diagnostic Environment Example Topology 24 FIGURE 3-2 Microsoft Windows 2000 Event Properties System Log 26 FIGURE 3-3 Qlogic SANblade Manager HBA Driver and
Summary of the content on the page No. 10
FIGURE 5-11 A4 or B4 FC Link Data-Host Notification 60 FIGURE 5-12 Storage Service Processor-Side Notification 61 FIGURE 6-1 Sample Host Event Grid 68 FIGURE 7-1 Switch Event Grid 77 FIGURE 8-1 Storage Service Processor Event 89 FIGURE 8-2 Virtualization Engine Alert 90 FIGURE 8-3 Manage Configuration Files Menu 92 FIGURE 8-4 Example Link Test Text Output from the Storage Automated Diagnostic Environment 93 FIGURE 8-5 Sun StorEdge T3+ Array Event Grid 95 FIGURE 9-1 Virtualization Engine Front Pa
Summary of the content on the page No. 11
FIGURE 11-8 Successful Switch Test Results 153 FIGURE 11-9 Multipath Recovery using the Sun StorEdge T3+ Array Multipath Configurator 154 FIGURE 11-10 Recovered Paths 154 List of Figures XI Sun Proprietary/Confidential: Internal Use Only
Summary of the content on the page No. 12
XII Sun StorEdge 3900 and 6900 Series 2.0 Troubleshooting Guide • March 2003 Sun Proprietary/Confidential: Internal Use Only
Summary of the content on the page No. 13
List of Tables TABLE 1-1 Sun StorEdge 3900 and 6900 Series Configurations 1 TABLE 3-1 Event Grid Sorting Criteria 25 TABLE 5-1 FC Links 38 TABLE 5-2 Ax to Bx FC Links. 40 TABLE 6-1 Storage Automated Diagnostic Environment Event Grid for the Host 69 TABLE 7-1 Storage Automated Diagnostic Environment Event Grid for 1 Gbit Switches 78 TABLE 7-2 Storage Automated Diagnostic Environment Event Grid for 2 GBit Switches 82 TABLE 0-1 setupswitch Exit Values 85 TABLE 8-1 Storage Automated Diagnostic Envi
Summary of the content on the page No. 14
TABLE A-5 Virtualization Engine Service Codes —400-599 Device-Side Interface Driver Errors 162 TABLE B-1 Virtualization Engine Error Messages 164 TABLE B-2 Sun StorEdge Network FC Switch Error Messages 168 TABLE B-3 Sun StorEdge T3+ Array Error Messages 171 TABLE B-4 Other SUNWsecfg Error Messages 175 XIV Sun StorEdge 3900 and 6900 Series 2.0 Troubleshooting Guide • March 2003 Sun Proprietary/Confidential: Internal Use Only
Summary of the content on the page No. 15
Preface The Sun StorEdge 3900 and 6900 Series 2.0 Troubleshooting Guide provides guidelines TM for isolating problems in supported configurations of the Sun StorEdge 3900 and 6900 series. For detailed configuration information, refer to the Sun StorEdge 3900 and 6900 Series Reference Manual. The scope of this troubleshooting guide is limited to information pertaining to the components of the Sun StorEdge 3900 and 6900 series, including the Storage Service Processor, Sun StorEdge 1 Gbit and 2 Gbi
Summary of the content on the page No. 16
Chapter 6 provides information on host device troubleshooting. Chapter 7 provides information on troubleshooting a Sun StorEdge Network FC switch-8 and switch-16 switch device. Chapter 8 describes how to troubleshoot the Sun StorEdge T3+ array devices. Also included in this chapter is information about the Explorer Data Collection Utility. Chapter 9 provides detailed information for troubleshooting the virtualization engines. Chapter 10 describes how to troubleshoot using Microsoft Windows 2000.
Summary of the content on the page No. 17
Typographic Conventions Typeface Meaning Examples AaBbCc123 The names of commands, files, Edit your.login file. and directories; on-screen Use ls -a to list all files. computer output % You have mail. AaBbCc123 What you type, when % su contrasted with on-screen Password: computer output AaBbCc123 Book titles, new words or terms, Read Chapter 6 in the User’s Guide. words to be emphasized These are called class options. You must be superuser to do this. Command-line variable; replace To delete a f
Summary of the content on the page No. 18
Related Documentation Product Title Part Number Late-breaking News • Sun StorEdge 3900 and 6900 Series 2.0 Release Notes 816-5254 Sun StorEdge 3900 and • Sun StorEdge 3900 and 6900 Series 2.0 Installation Guide 816-5252 6900 series information • Sun StorEdge 3900 and 6900 Series 2.0 Reference and Service Guide 816-5253 • Sun StorEdge 3900 and 6900 Series 2.0 Regulatory and Safety Compliance Manual 816-5257 • Sun StorEdge 3900 and 6900 Series 2.0 Site Prep Guide 816-5256 Sun StorEdge T3 and • Sun
Summary of the content on the page No. 19
Product Title Part Number SANbox-8/16 • SANbox-8/16 Segmented Loop Fibre Channel Switch Management 875-3060 Segmented Loop FC User’s Manual Switch • SANbox-8 Segmented Loop Fibre Channel Switch Installer’s/User’s 875-1881 Manual • SANbox-16 Segmented Loop Fibre Channel Switch Installer’s/User’s 875-3059 Manual Expansion cabinet • Sun StorEdge Expansion Cabinet Installation and Service Manual 805-3067 Storage Server Processor • Sun V100 Server User’s Guide 806-5980 • Netra X1 Server User’s Guide
Summary of the content on the page No. 20
Accessing Sun Documentation Online You can view, print, or purchase a broad selection of Sun documentation, including localized versions, at: http://www.sun.com/documentation Sun Welcomes Your Comments Sun is interested in improving its documentation and welcomes your comments and suggestions. You can email your comments to Sun at: docfeedback@sun.com Please include the part number (816-5255) of your document in the subject line of your email. XX Sun StorEdge 3900 and 6900 Series 2.0 Troubleshoo
