Page 1 IBM System Storage SAN384B Installation, Service, and User Guide Service information: 2499-192 Read Before Using This product contains software that is licensed under written license agreements. Your use of such software is subject to the license agreements under which they are provided.
Page 3 IBM System Storage SAN384B Installation, Service, and User Guide Service information: 2499-192 GC52-1333-02...
Page 5: Read This First
Read this first Summary of changes This is the third edition of the IBM System Storage SAN384B Installation, Service, and User Guide. The content changes since the last edition of this publication are noted by a vertical line placed in the left margin beside each change. Minor edits are not identified by this mark.
Page 6: Taiwan Contact Information
Your feedback is important in helping us provide the most accurate and high-quality information. If you have comments or suggestions for improving this document, send us your comments by e-mail to starpubs@us.ibm.com . Be sure to include the following: v Exact publication title...
Page 7: Table Of Contents
Figures ....ix Chapter 3. Starting and configuring the SAN384B ....33 Tables ....xi Providing power to the SAN384B .
Page 8 Data transmission ranges . . 125 Installing an ICL cable . . 85 FR4-18i routing blade port specifications . . 125 Removing and replacing a SAN384B chassis . . 91 Fibre Channel port specifications . . 125 Time required . 92 GbE port specifications .
Page 9 Appendix C. Diagnostics and Avis de conformité à la réglementation d'Industrie Canada . 144 troubleshooting ..131 European Union EMC Directive Conformance Obtaining chassis and component status . . 131 Statement .
Page 10 SAN384B Installation, Service, and User Guide...
Page 11: Figures
Port side of the SAN384B (sample Power supply . . 57 configuration) . Blower assembly LEDs . . 58 Port side of the SAN384B with the exhaust kit WWN bezel . . 59 installed (sample configuration) . Chassis door . . 62 Blower (non-port) side of the SAN384B Cable management finger assemblies .
Page 12 SAN384B Installation, Service, and User Guide...
Page 13: Tables
. 84 Blades available for the SAN384B Critical information checklist example. . 94 Security features . Cable routing table for SAN384B (64 ports Installation tasks, time, and items required shown). . 104 Parts list for port-side exhaust kit for C36 General product specifications .
Page 14 SAN384B Installation, Service, and User Guide...
Page 15: Safety Notices
IBM Systems Safety Notices (G229–9054) publication, which is on the CD-ROM that accompanies this product. The following notices and statements are used in IBM documents. They are listed below in order of increasing severity of potential hazards. Follow the links for more detailed descriptions and examples of the danger, caution, and attention notices in the sections that follow.
Page 16 (D004) A general electrical danger notice provides instructions on how to avoid shock hazards when servicing equipment. Unless instructed otherwise, follow the procedures in the following danger notice. SAN384B Installation, Service, and User Guide...
Page 17 Electrical voltage and current from power, telephone, and communication cables are hazardous. To avoid a shock hazard: v Connect power to this unit only with the IBM provided power cord. Do not use the IBM provided power cord for any other product.
Page 18: Caution Notices
Delivery and subsequent transportation of the equipment The customer should prepare his environment to accept the new product based on the installation planning information provided, with assistance from an IBM Installation Planning Representative (IPR) or IBM authorized service provider. In...
Page 19: Safety Labels
(C032) CAUTION: For CA residents only: IBM recommends installing this product in a room size of 62 cubic meters (2190 cubic feet) or larger at 0.4 ACH ventilation rate to reduce the concentrations of any chemicals emitted by the product.
Page 20: Esd Precautions
Attention: Many of the field replaceable units (FRUs) are sensitive to electrostatic discharge (ESD), and can potentially be damaged by improper handling. Wear a wrist grounding strap connected to chassis ground (if the SAN384B is plugged in) or a bench ground. Store all ESD-sensitive components in antistatic packaging.
Page 21: Rack Safety
Rack safety Rack installation DANGER Observe the following precautions when working on or around your IT rack system: v Heavy equipment—personal injury or equipment damage might result if mishandled. v Always lower the leveling pads on the rack cabinet. v Always install stabilizer brackets on the rack cabinet. v To avoid hazardous conditions due to uneven mechanical loading, always install the heaviest devices in the bottom of the rack cabinet.
Page 22: Rack Relocation (19" Rack)
Pack the rack cabinet in the original packaging material, or equivalent. Also, lower the leveling pads to raise the casters off of the pallet and bolt the rack cabinet to the pallet. (R002) SAN384B Installation, Service, and User Guide...
Page 23: Safety Inspections
Internal machine checks Perform the following internal machine checks: 1. Check for any non-IBM changes that might have been made to the machine. If any are present, obtain the “Non-IBM Alteration Attachment Survey” form, number R009, from the IBM branch office. Complete the form and return it to the branch office.
Page 24: Product Recycling And Disposal
Product recycling and disposal Refer to the IBM Systems Environmental Notices and User Guide (Z125-5823) on the product documentation CD for translated environmental statements and information regarding product recycling and disposal. This document may be provided either in printed version or on the product documentation CD. See “Removing the battery”...
Page 25: About This Document
Redbook), SG24-6116 Brocade documents IBM switches use software licensed from Brocade Communications Systems, Inc. You can find information related to the software that supports the SAN384B in the following documents on the CD-ROM supplied with this product: Brocade Fabric OS...
Page 26: Keyboard Navigation
When you use any of the Brocade documents, you will notice that the model numbers reflect the original Brocade products. Table 1 provides a product matrix for you to use to correlate the Brocade products and models to the IBM product names and machine types and model numbers. Products withdrawn from marketing are not listed.
Page 27 Vendor software The SAN384B includes certain vendor software that is not covered under the IBM license agreement. IBM makes no representation about the accessibility features of these products. Contact the vendor for the accessibility information about its products. Related accessibility information You can view the publications for the SAN384B in Adobe Portable Document Format (PDF) using the Adobe Acrobat Reader.
Page 28 SAN384B Installation, Service, and User Guide...
Page 29: Chapter 1. Introduction
Chapter 1. Introduction This chapter introduces the features and components of the IBM System Storage SAN384B fabric backbone. Throughout this document, the product is referred to as the SAN384B, or more generically as system, device, or chassis, where appropriate. This chapter contains the following information: v “Overview of the SAN384B”...
Page 30: Hardware Components
Two slots for control processor blades (CP8): – A single active CP8 blade can control all 256 ports in the chassis – The standby CP8 blade assumes control of the SAN384B if the active CP fails v Two slots for core switch blades (CR4S-8): –...
Page 31: Port Side Of The San384B (Sample Configuration)
Redundant AC primary power connections to ensure high availability. Each power supply has its own connector Note: Airflow in the SAN384B is from the non-port (non-cable) side to the left side of the chassis. With the port-side exhaust kit installed (see Figure 2 on page 4, the air flows out the vent on the port side of the chassis.
Page 32: Port Side Of The San384B With The Exhaust Kit
Figure 2. Port side of the SAN384B with the exhaust kit installed (sample configuration) Figure 3 shows the non-port side of the SAN384B. Figure 3. Blower (non-port) side of the SAN384B WWN bezel Blower assembly (2x) Power supply (2x) SAN384B Installation, Service, and User Guide...
Page 33: San384B Blades
SAN384B blades Table 2 summarizes the port, application, control processor, and core switch blades that are available for the SAN384B. Table 2. Blades available for the SAN384B Description Feature Code Name Function Control processor The CP8 blade blade contains the control plane for the chassis.
Page 34 Table 2. Blades available for the SAN384B (continued) Description Feature Code Name Function 64-port 8-Gbps port FC3864 FC8-64 A 64-port port blade blade supporting 2, 4, and 8 Gbps port speeds. This blade cannot be used in the same chassis with an FCOE10-24 blade.
Page 35: High Availability
Reliability The SAN384B uses the following error detection and correction mechanisms to ensure reliability of data: v Error Detection and Fault Isolation (EDFI) mechanism, which checks for encoder errors and fault isolation, such as cyclic redundancy checking (CRC), parity checking, checksum, and illegal address checking.
Page 36: Software Features
Accelerator (optional feature), which is designed to support secure high-speed data movement between multiple locations Security Table 3 highlights some of the key security features available for the SAN384B and for other switches running Fabric OS 5.2.0 or later. Table 3. Security features...
Page 37: Network Manageability
E_port disable Network Manageability The SAN384B has a single domain and is managed as a single element with the Data Center Fabric Manager or Web Tools. The SAN384B responds to its own IP address and appears as a separate entity to the Telnet protocol and SNMP.
Page 38 SAN384B Installation, Service, and User Guide...
Page 39: Chapter 2. Installing A San384B In A Cabinet
C36 cabinet, and the third will be installed in the cabinet at the customer site. This chapter describes how to install a SAN384B into a C36 cabinet, and how to remove the SAN384B from the cabinet in the event you need to move or replace the SAN384B.
Page 40: World Trade Locations
Do not use the 18–inch load plate. You must order and use a 24–inch load plate when you install the SAN384B to be able to safely install this product. The 24-inch load plate includes a platform with a middle section that can slide out to extend across the gap between the lift tool and the mounting position inside the C36 cabinet.
Page 41: Installation Guidelines
4. Plan for managing the cables before you install the chassis. A fully populated SAN384B will have a large number of cables that must be carefully routed to minimize problems with installation and replacement of components, and in order to maintain the minimum bend radius required for optical cables.
Page 42: Installing A San384B In A 2109 C36 Cabinet
Ethernet cables, transceivers, attaching and routing the fiber optic cables, or completing the initial configuration. The SAN384B and the lift tool should be delivered to a location near to the final installation, with clear aisles for maneuvering the lift tool loaded with the chassis.
Page 43: Unpacking And Assembling The Lift Tool
If the winch is in the lowest position, you may need to raise it to provide enough clearance to slide the forks into position. Secure each lifting fork in place with two ring-pins. Chapter 2. Installing a SAN384B in a cabinet...
Page 44: Unpacking The San384B
The weight of this part or unit is more than 55 kg (121.2 lb). It takes specially trained persons with a lifting device to safely lift this part or unit. (C011) 55 kg ( 121.2 lbs) To unpack the SAN384B, follow these steps: SAN384B Installation, Service, and User Guide...
Page 45: Lift Tool Positioned Next To The Chassis On The Shipping Tray
9. Carefully slide the chassis across the foam blocking in the shipping tray and onto the center of the load plate. Do not use any of the handles on the blowers or power supplies to move the chassis. Chapter 2. Installing a SAN384B in a cabinet...
Page 46: Installing The Port-Side Exhaust Kit
Installing the port-side exhaust kit Complete the following instructions to install the port-side exhaust kit in a 2109-C36 cabinet before installing the SAN384B chassis. Exhaust kit parts list Table 5 lists items illustrated in Figure 6 on page 19.
Page 47: Port-Side Exhaust Kit Assembly For 27 To 31 In
10-32 x .5" 10-32 x .63" 10-32 Clip Nut 10-32 Retainer Nut Alignment Washer 6-32 x .25" Figure 6. Port-side exhaust kit assembly for 27 to 31 in. (68.58 to 78.74 cm) cabinets Chapter 2. Installing a SAN384B in a cabinet...
Page 48: Torque Requirements
2. The exhaust side of the port side exhaust kit will be installed facing the rear of the C36 cabinet, and the port side of the SAN384B chassis will also face this direction. 3. Install 10 clip nuts (F in Figure 6 on page 19) or retainer nuts (G) in the rear vertical cabinet rail locations shown in Figure 7 on page 21, and 4 clip nuts or retainer nuts in the front vertical cabinet rails.
Page 49: Clip And Retainer Nut Locations On Exhaust Side
Secure the shelf to the cabinet with eight 10-32 screws with washers (E in Figure 6 on page 19), two screws in each corner of the shelf (see Figure 8 on page 22). Tighten screws according to specifications under “Torque requirements” on page 20. Chapter 2. Installing a SAN384B in a cabinet...
Page 50 The top-rail assembly can be adjusted to a length of between 27 and 31 inches (68.58 to 78.74 cm) to fit on the inside of the cabinet rails. To lengthen or shorten the top-rail assembly, loosen, by approximately 1/2 turn, the two SAN384B Installation, Service, and User Guide...
Page 51: Installing The Top Rail Assembly To The Duct Assembly And Cabinet Rails
Tighten screws according to specifications under “Torque requirements” on page 20. 8. Tighten the two 6-32 screws (I-3 in Figure 6 on page 19) that were loosened in step 6a to adjust the top rail length. Chapter 2. Installing a SAN384B in a cabinet...
Page 52: Installing The San384B Into The Cabinet
(C011) 55 kg ( 121.2 lbs) Now that the port-side exhaust kit is securely installed, the SAN384B chassis can be safely installed into the C36 cabinet. Perform the following steps to install the chassis.
Page 53: Load Plate Extended Inside The Cabinet To The Exhaust Kit Shelf
Note: If necessary, adjust the height of the load plate to allow a smooth transfer of the chassis from the extended load plate to the top of the shelf. Chapter 2. Installing a SAN384B in a cabinet...
Page 54 Do not install the screws until you determine the position of the cable management fingers. Note: Screws, clip nuts, and retainer nuts to secure the chassis to the cabinet are provided in the SAN384B hardware accessory kit. SAN384B Installation, Service, and User Guide...
Page 55: Location Of Screws To Attach The Chassis To The Cabinet Rails
These screws do not attach the cable management assemblies to the chassis or rack. Figure 15 on page 28 shows the cable management fingers positioned towards the top of the chassis. Chapter 2. Installing a SAN384B in a cabinet...
Page 56: Port Numbering
Note: For turning on the power and for the configuration instructions, see Chapter 3, “Starting and configuring the SAN384B,” on page 33. Attention: Do not connect the SAN384B to the network until the IP addresses are correctly set. Port numbering Table 7 provides a list of available port blades for the SAN384B.
Page 57 Fibre Channel over Ethernet blade 3880 The SAN384B uses the following port numbering for each of the blades that can be installed in the chassis. See illustrations of the different blades in Appendix D, “Blade port numbering,” on page 137. Refer to Implementing an IBM/Brocade SAN with 8 Gbps Directors and Switches, (an IBM Redbook), SG24-6116 for more details on port numbering and other technical information.
Page 58: Chassis Slots
Slots are numbered 1 through 8, from bottom to top of the chassis when facing the port side of the SAN384B. Control processor blades (CP8) can be installed only in slots 4 and 5. Core switch blades (CR4S-8) can be installed only in slots 3 and 6.
Page 59 Table 26 on page 125 provides a listing of supported cable speeds and distances. Optional inter-chassis link cables (ICL) can also be installed between two or three chassis. See “Removing and installing inter-chassis link (ICL) cables” on page 84 for instructions on installing these cables. Chapter 2. Installing a SAN384B in a cabinet...
Page 60 SAN384B Installation, Service, and User Guide...
Page 61: Chapter 3. Starting And Configuring The San384B
Select the SAN384B product link v On the SAN384B product page, click the Interoperability Matrix link. The SAN384B must be configured before it is connected to the fabric, and all of the configuration commands must be entered through the active CP blade. The...
Page 62: Flow Of Configuration Tasks For The San384B
2. Specify a switch name. See “Customizing the switch name” on page 38. 3. Specify a domain ID for the SAN384B. See “Setting the Domain ID” on page 4. Set the date and time. See “Setting the date and time” on page 39.
Page 63: Providing Power To The San384B
3. Turn the AC power switches on the power supplies to ON (|). The AC power switches light green when switched on and power is supplied. 4. The SAN384B performs a power-on self-test (POST) each time it is powered on. POST takes approximately 10 minutes and is complete when indicator light activity displays the operational state.
Page 64: Logging In To The Serial Console Port
1. When the terminal emulator application stops reporting information, press Enter. You will receive the following login prompt: CP0 Console Login: 2. Log in to the SAN384B as admin. The default password is "password." At the initial login, you are prompted to change the default passwords. Record the new passwords and keep this information in a secure location.
Page 65: Logging Off The Serial Console Port And Disconnecting The Serial Cable
Follow these steps to configure the IP addresses for both CP blades (from the active CP blade): 1. Log in to the active CP as admin using the serial cable connection. 2. Set up the SAN384B IP address by entering the ipaddrset -chassis command at the prompt. swDir:admin> ipAddrSet -chassis Enter the information at the prompts.
Page 66: Establishing An Ethernet Connection
Customizing the switch name The switch name of the SAN384B can be up to 30 characters long as of Fabric OS release 6.3.0; can include letters, numbers, and underscore characters; and must begin with a letter. Fabric OS releases earlier than 6.3.0 require switch names of 15 characters or less.
Page 67: Setting The Domain Id
Each switch in the fabric must have a unique Domain ID. The Domain ID can be set using the configure command or can be automatically set. The default Domain ID for the SAN384B is "1". Use the fabricShow command to view the already assigned domain IDs.
Page 68: Synchronizing Local Time
DNS name: switch:admin> tsclockserver "10.32.170.1;10.32.170.2;ntp.localdomain.net" Updating Clock Server configuration...done. Updated with the NTP servers Changes to the clock server value on the principal or primary FCS switch are propagated to all switches in the fabric SAN384B Installation, Service, and User Guide...
Page 69: Verifying The Pid Mode And Connecting To The Fabric
In the example above, the license key is AAbbccDDeeFFeeGG. Keep a copy of the license key for reference. The 64-bit chassis ID is required to obtain and activate licenses for the SAN384B. The chassis ID is available through the licenseIdShow command.
Page 70: Managing Cables
Managing cables Attention: The minimum bend radius should be no smaller than 10x the cable radius. Note: Contact your IBM representative for options regarding different cable and patch panel configurations to simplify cable management with higher density FC8-64 port blades.
Page 71: Verifying Correct Operation And Backing Up The Configuration
This command provides information about switch and port status. 4. Verify the correct operation of the SAN384B in the fabric by entering the fabricShow command from the workstation. This command provides general information about the fabric.
Page 72: Downloading And Installing Firmware
3. Enter firmwareDownload -s on your to download the firmware to one of the CP blades from your server. Powering off the SAN384B If you need to power off the SAN384B, follow these steps to avoid loss of data. 1. Shut down the SAN384B using the sysShutdown command. switch::admin> sysshutdown This command will shutdown the operating systems on your switch.
Page 73: Chapter 4. Monitoring System Components
Chapter 4. Monitoring system components The SAN384B is engineered for reliability and requires no routine operational steps or maintenance. This chapter provides information about determining the status of the following components using LEDs and CLI commands. Refer to the Fabric OS Administrator's Guide and the Web Tools Administrator's Guide for more information on monitoring component status.
Page 74 Figure 18. FC8-16 port blade Status LED Fibre Channel port Power LED Port Status LED Figure 19. FC8-32 port blade Status LED Fibre Channel port Power LED Port Status LED SAN384B Installation, Service, and User Guide...
Page 75: Fc8-48 Port Blade
Figure 20. FC8-48 port blade StatusLED Fibre Channel port Power LED Port Status LED Figure 21. FC8-64 port blade Status LED Fibre Channel port Power LED Port Status LED Note: The FC8-64 port blade requires narrower OM-3 LC cables offered by several major manufacturers Chapter 4.
Page 76: Fc10-6 Port Blade
Figure 22. FC10-6 port blade Status LED Fibre Channel Port Power LED Port Status LED SAN384B Installation, Service, and User Guide...
Page 77 Figure 23. FR4-18i routing blade Status LED Fibre Channel Port Power LED Port Status LED Figure 24. FX8-24 extension blade Status LED FC ports 0-5 (numbered right to left) Power LED FC ports 6-11 (numbered right to left) 1 GbE ports 0-3 (numbered right 1 GbE ports 4-9 (numbered right to left) to left) 10 GbE ports 0-1 (numbered right...
Page 78 SAN384B Installation, Service, and User Guide...
Page 79: Port And Routing Blade Led Descriptions
Table 9. Port and routing blade LED descriptions LED purpose Color Status Recommended Action Power LED Steady green Blade is enabled. No action required. No light (LED is off) Blade is not powered on. Ensure that the blade is firmly seated and either the thumbscrew is fully engaged or the slider is pushed up and...
Page 80 1 second) switch. used to locate/identify port. Amber, amber, pause (cycle is Beaconing initiated on the No action required. Beaconing about 1 second) HBA and reflected on the port. used to locate/identify port. SAN384B Installation, Service, and User Guide...
Page 81: Control Processor Blade (Cp8) Status
Table 9. Port and routing blade LED descriptions (continued) LED purpose Color Status Recommended Action GbE Port Status (FX8-24) - both No light (LED is off) Port has no incoming power, Verify that the power LED is GbE and 10 GbE ports or there is no light or signal on, check the transceiver and carrier detected.
Page 82: Control Processor Blade (Cp8) Leds
If the off 2 seconds) faulty. LED continues to flash, replace blade. Fast-flashing amber Environmental range Check for (on 1/2 second; then exceeded. out-of-bounds off 1/2 second) environmental condition and correct SAN384B Installation, Service, and User Guide...
Page 83: Core Switch Blade (Cr4S-8) Status
Table 10. CP blade LED descriptions (continued) Recommended LED purpose Color Status Action Ethernet Link Status No light (LED is off) Either an Ethernet Ensure that the blade link is not detected, has power, the or it does not have Ethernet cable is incoming power.
Page 84: Power Supply Status
LED patterns, see Table 12 on page 2. Check the power supply status by entering psShow. The power supply status displays OK, Absent, or Faulty. If a power supply is absent or faulty, contact IBM. SAN384B Installation, Service, and User Guide...
Page 85: Blower Assembly Status
Power supply does Ensure that the not have incoming power supply is power and is not firmly seated, the providing power to SAN384B has the SAN384B. incoming power, both power cables are connected, and AC power switches are on. Steady green Power supply has No action required.
Page 86: Blower Assembly Leds
Fast-flashing amber Environmental range Check for (on 1/2 sec, then off exceeded. out-of-bounds 1/2 sec) environmental condition, resolve any problems, and reseat the unit. If the LED continues to flash, replace the unit. SAN384B Installation, Service, and User Guide...
Page 87: Wwn Card Status
WWN card status Note: The WWN bezel (see Figure 30) covers the WWN cards. The LEDs on the WWN cards are not visible unless the bezel is removed. To determine the status of the WWN card, enter the chassisShow command to display information about the WWN card.
Page 88 SAN384B Installation, Service, and User Guide...
Page 89: Chapter 5. Removing And Installing Components
“Removing and replacing a SAN384B chassis” on page 91 Removing and installing the chassis door Note: The chassis door must be installed to ensure the SAN384B meets EMI and other regulatory certifications. Additionally, if ICL cables are not used, EMI plugs must be inserted in the ICL cable ports to meet certification standards.
Page 90: Removing And Installing Cable Management Finger Assemblies
Figure 31. Chassis door Removing and installing cable management finger assemblies The SAN384B comes equipped with two vertical cable management finger assemblies. It can continue to operate during the replacement of the cable management assemblies. Due to the horizontal orientation of the blades, the cable management assemblies are attached to the uprights of the mounting rack.
Page 91: Installing A Cable Management Finger Assembly
To install a cable management finger assembly: 1. Position the vertical cable management finger assembly along the upright rails of the rack, aligning the holes on the assembly with the holes in the SAN384B chassis. 2. Insert and tighten the two screws to secure the cable management assembly to the rack's vertical rails.
Page 92: Removing And Installing Port And Application Blades
Slots are numbered from 1 through 8, from bottom to top when facing the port side of the SAN384B. Port, application, and router blades can be installed in slots 1–2 and 7–8.
Page 93: Port Blade Removal And Installation (48-Port Blade Shown As Example)
Note: Before removing any cables from a blade, note the cable order (identify each cable by its physical port). If multiple blades are being installed, install one blade at a time. Labeling the cables before removal is recommended. Note: If multiple blades are being replaced, replace one blade at a time. 7.
Page 94: Installing A Blade
To install a port blade, do the following: Attention: Follow ESD precautions (see “ESD precautions” on page xviii). Note: An FA4-18i routing blade and the SAN384B must have the same version of firmware. To upgrade firmware versions, refer to the Fabric OS Administrator’s Guide.
Page 95: Removing And Installing Blade Filler Panels
6. Verify that the power LED on the blade displays a steady green light (it might require a few seconds to turn on). If it does not turn on, ensure that the blade is firmly seated. 7. Install the SFP, SFP+, or XFP (FC10-6 only) transceivers and cables in the port blade.
Page 96: Removing And Installing A Cp8 Control Processor Blade
This section describes how to remove and install a control processor (CP8) blade. Each SAN384B has two CP8 blades located in slot 4 and slot 5. Note: If the new CP blade does not have the same firmware as the active CP blade, the new blade must be upgraded to the same firmware version.
Page 97: Recording Critical San384B Information
Recording critical SAN384B information Back up the SAN384B configuration before you replace a CP blade. Refer to the Fabric OS Administrator’s Guide for backup information. 1. Login to the functioning CP blade as admin, using either a Telnet or a serial console connection.
Page 98: Installing A Control Processor Blade (Cp8)
6. Connect the cables to the new CP blade. 7. Remain logged in to the active CP and continue to“Verifying operation of the new CP blade” on page 71. SAN384B Installation, Service, and User Guide...
Page 99: Verifying Operation Of The New Cp Blade
Enter all requested information (use default values). 3. To download firmware, go to www.ibm.com/servers/storage/support/san and select your product, then click on the Download tab. Select the appropriate firmware version and release notes version. Enter all requested information (use default values): 4.
Page 100: Downloading Firmware From A Usb Drive
This section describes how to remove and install a core switch blade. The SAN384B has two core switch blades: one in slot 3 and one in slot 6. Note that the blade shown in Figure 36 on page 74 is shown with EMI plugs installed.
Page 101: Time And Items Required
For more information about error messages, refer to the Fabric OS Message Reference. Removing a CR4S-8 core switch blade The SAN384B continues to operate while a core switch blade is being replaced. Attention: Follow ESD precautions (see “ESD precautions” on page xviii) whenever handling blades.
Page 102: Installing A Cr4S-8 Core Switch Blade
7. Install the chassis door. (See “Removing and installing the chassis door” on page 61.) 8. Pack the faulty core switch blade in the packaging provided with the new core switch blade for return to IBM, following local procedures. SAN384B Installation, Service, and User Guide...
Page 103: Removing And Installing A Power Supply
Removing and installing a power supply Use this procedure to remove and replace a power supply. The SAN384B can continue operating during the replacement if the other power supply is operating. Note: The SAN384B base configuration includes two power supplies for full redundancy.
Page 104: Installing A Power Supply
If the SAN384B is going to continue operating during the replacement, check the power LEDs to verify that the remaining power supply is functioning. The SAN384B requires a minimum of one power supply at all times to function. 2. Turn off the power switch on the power supply you are replacing.
Page 105: Removing And Installing A Blower Assembly
Removing and installing a blower assembly This procedure provides instructions for removing and installing a blower assembly. Attention: The system can continue operating during the replacement if the second blower assembly is operating, To ensure continuous adequate cooling, maintain both blower assemblies except for the brief period during replacement. Time and items required The installation procedure for each blower assembly takes less than 5 minutes.
Page 106: Installing A Blower Assembly
Allow approximately 20 minutes to install a WWN card. The following items are needed to install a WWN card: v ESD grounding strap v #2 Phillips screwdriver (required only for some versions of the WWN card) SAN384B Installation, Service, and User Guide...
Page 107: Verifying Necessity Of Installation
Attention: Follow ESD precautions (see “ESD precautions” on page xviii) whenever handling cards or blades. 1. Open a Telnet session to the SAN384B and log in to the active CP as admin. The default password is password. Chapter 5. Removing and installing components...
Page 108: Installing The Wwn Bezel And Wwn Card
To install the WWN bezel and WWN card, do the following: Attention: Follow ESD precautions (see “ESD precautions” on page xviii) whenever handling cards or blades. 1. Unpack the new WWN card and save the packaging for returning the faulty WWN card. SAN384B Installation, Service, and User Guide...
Page 109: Removing And Installing Transceivers
Go to the IBM SAN web page http://www.ibm.com/systems/storage/ v Select the SAN384B product link v On the SAN384B product page, click the Interoperability Matrix link. v In the Interoperability matrix, click the Transceivers link. Note: The 8-Gbps-capable mSFPs and SFP+s auto-negotiate at 2, 4, and 8 Gbps.
Page 110: Removing And Replacing An Sfp, Sfp+, Or Xfp Optical Transceiver
Figure 41. Optical transceiver (SFP, SFP+, and XFP) extraction tool Note: This tool is part of the SAN384B ship group and should be kept with the chassis. Attention: mSFP optical transceivers should not be inserted into ports intended for SFP or SFP+ transceivers.
Page 111: Transceiver
Note: The mSFP transceivers are used only with the FC8-64 port blade. Narrower OM-3 LC cables are used to connect the FC8-64. These cables are offered by several major manufacturers. Contact your IBM representative for options regarding different cable and patch panel configurations to simplify cable management with higher density FC8-64 port blades.
Page 112: Removing And Installing Inter-Chassis Link (Icl) Cables
Figure 44 on page 85 shows the two ends of an ICL cable. The ICL cables (2 meters long) and the ICL connectors are color-coded and labeled for ease of installation. The cables can connect ICL connector ports on the SAN384B core switch blades (CR4S-8) or SAN768B core switch blades (CR8).
Page 113: Time And Items Required
3. Using the latch release tabs, pull each plug on the cable from its respective socket on the SAN384B core switch blades (CR4S-8) or SAN768B core switch blades (CR8). 4. Repeat for each cable that requires replacement.
Page 114 (top) connectors (ICL 1) of the CR4S-8 blades in the second chassis. Figure 45 on page 87 and Figure 46 on page 88 show two of the acceptable cabling configurations for the ICL feature between two SAN384B chassis and between a SAN384B and a SAN768B, respectively. The first drawing for two SAN384B systems shows the cables attached between the blades in slot 3 on one chassis and slot 6 on the second chassis.
Page 115: Icl Cable Connections Between Two San384B Chassis
Figure 45. ICL cable connections between two SAN384B chassis 1 Chassis 1 2 Core switch blades (CR4S-8) 3 Control processor blades (CP8) 4 Port blades 5 ICL connector (ICL 1) 6 ICL connector (ICL 0) 7 ICL cables 8 Chassis 2...
Page 116: Icl Cable
Figure 46. ICL cable connections between a SAN384B chassis and a SAN768B chassis. 1 Chassis 1 (SAN384B) 2 Core switch blades (CR4S-8) 3 Control processor blades (CP8) 4 Port blades 5 ICL connector (ICL 1) 6 ICL connector (ICL 0)
Page 117: Way Icl Cable Connections Between A San384B Chassis And Two San768B Chassis
Figure 47. 3-way ICL cable connections between a SAN384B chassis and two SAN768B chassis. 1 Chassis 1 (SAN384B) 2 Core switch blades (CR4S-8) 3 Chassis 2 (SAN768B) 4 Chassis 3 (SAN768B) 5 ICL connector (ICL 1) Chapter 5. Removing and installing components...
Page 118: Way Icl Cable Connections Between A San768B Chassis And Two San384B Chassis
6 ICL connector (ICL 0) Figure 48. 3-way ICL cable connections between a SAN768B chassis and two SAN384B chassis. 1 Chassis 1 (SAN384B) 2 Core switch blades (CR4S-8) 3 Chassis 2 (SAN768B) 4 Chassis 3 (SAN384B) 5 ICL connector (ICL 1)
Page 119: Removing And Replacing A San384B Chassis
Figure 47 on page 89 through Figure 49. Also note that one set is connected to only the blades in the "low order" slots (slot 3 in the SAN384B and slot 5 in the SAN768B) and the other set is connected to the blades in the "high order"...
Page 120: Time Required
“Reconnecting the system to the network and fabric” on page 102 v “Verifying correct configuration of the fabric” on page 102 Note: The SAN384B must be removed from the fabric and powered off to perform this procedure. Contact IBM Support if you have any questions about whether the chassis requires replacement.
Page 121 Note: Run supportShow which includes all of the information in Table 18 on page 94 and more. The customer should record the location of the .txt files, which are created by the customer and are not called out in the supportShow results.
Page 122: Critical Information Checklist Example
New factory serial number: | | | New serial number (if available): 1. Open a Telnet session and log in to the SAN384B as admin. The default password is password. Enable the logging function on your Telnet or serial console connection.
Page 123 Enter ipAddrShow -sw; then copy the command output into the “config-miscinfo.txt” file. switch:admin> ipaddrshow -sw SWITCH Ethernet IP Address: 10.32.50.12 Ethernet Subnetmask: 255.55.0.0 Fibre Channel IP Address: 1.2.3.4 Fibre Channel Subnetmask: 255.255.255.0 Ethernet IP Address: 10.32.50.10 Ethernet Subnetmask: 255.55.0.0 HostName : cp0 Gateway Address: 10.32.40.1 Ethernet IP Address: 10.32.50.11 Ethernet Subnetmask: 255.55.0.0...
Page 124: Disconnecting From The Network And Fabric
Copy the command output into a text file named “SANbefor.txt”. After the SAN384B is restored to the fabric, this information can be used to verify that no unintentional changes have occurred to the fabric. switch:admin> nsshow Enter Pid COS PortName NodeName TTL <output truncated>...
Page 125: Removing Components From The Chassis
WWN card” on page 78). 8. Remove the chassis from the rack and port side exhaust kit (“Removing a SAN384B from the cabinet” on page 98). Note: If the chassis being removed was factory installed, additional shipping braces were added for stability during shipment. These consist of L-brackets and flat mounting plates.
Page 126: Removing A San384B From The Cabinet
SAN384B you are removing is fully shut down and not connected to the fabric. The instructions can be used for moving a SAN384B to a new location, or when replacing a defective chassis. See “Removing and replacing a SAN384B chassis”...
Page 127: Installing The Replacement Chassis
1. Follow the steps in “Unpacking the SAN384B” on page 16 to unpack the replacement chassis. 2. Follow the steps in “Installing the SAN384B into the cabinet” on page 24 to complete the installation of the replacement chassis. You can either install the empty chassis now, or first install the components steps 1-7 (“Installing...
Page 128: Downloading The Configuration
The configDownload command can be entered through a Telnet or serial session, but the SAN384B must have an Ethernet connection to the server name or IP of the host for the download process to complete. For more information, refer to the help configdownload command or the Fabric OS Command Reference Manual.
Page 129 ENABLED 8 SW BLADE 51 FC8-48 ENABLED switch:admin> 3. Verify that the system is functioning correctly by entering switchShow or switchStatusShow. The switchShow command displays the SAN384B and port status information. switch:admin> switchshow switchName: switch switchType: 62.1 switchState: Online switchMode: Native...
Page 130: Reconnecting The System To The Network And Fabric
Connect the other ends to an Ethernet 10/100 Base-T LAN, if not already connected. Note: The SAN384B can be accessed by remote connection using any of the available management tools, such as Telnet or Web Tools. Ensure that the system is not modified using other connections during the rest of this procedure.
Page 131 ISL and port states v Number of switches in the fabric 3. Resolve any issues or unintentional changes to the SAN384B or fabric. v If there are any mechanical problems, try reseating the associated component. v If the configuration information is not correct for the system, modify as required.
Page 132: Cable Routing Table Template
Cable routing table template Table 19 is a 64-port template for a cable-routing table. Expand or duplicate the table as needed, for the number of ports in the chassis. Table 19. Cable routing table for SAN384B (64 ports shown) Slot/Port Cable labels...
Page 133: Removing The Battery
Table 19. Cable routing table for SAN384B (64 ports shown) (continued) Slot/Port Cable labels Connected Slot/Port of | | | | | Slot Port Switch end Device end device device | | | | | | | | | | | |...
Page 134: Battery Locations On The San384B
U109 U176 CR15 U181 Figure 50. Battery locations on the SAN384B 7. Recycle the four batteries as appropriate. Refer to the Environmental Notices and User Guide shipped with the product for more information on battery recycling and disposal. SAN384B Installation, Service, and User Guide...
Page 135: Chapter 6. Installing New Features
Refer to “Safety notices and labels” on page xiii before performing any service or installation procedures. The SAN384B can be upgraded with any of the following hot-pluggable features while the SAN384B is operational. Refer to the individual feature installation instructions for any possible exceptions.
Page 136: Procedures
8. Verify the installation. For information about how to check the status of hardware components using the CLI, see the Fabric OS Administrator's Guide, which is located on the product documentation CD. SAN384B Installation, Service, and User Guide...
Page 137: Fc3864 - Installing An 8-Gb 64-Port Port Blade
Note: This 8-Gb 64-port blade (FC3864) cannot be installed in the same chassis as a FCOE10-24 blade (FC3880) These instructions cover installing a new FC3864 in the SAN384B chassis. Time required 20 minutes or more per port blade due to port and cable density...
Page 138 FC8-64 port blade. Narrower OM-3 LC cables are used to connect the FC8-64. These cables are offered by several major manufacturers. Contact your IBM representative for options regarding different cable and patch panel configurations to simplify cable management with higher density FC8-64 port blades.
Page 139: Fc3850 - Installing An Fr4-18I Routing Blade
Disassembling any part of a blade voids the part warranty and regulatory certifications. There are no user-serviceable parts inside the blade. These instructions cover installing a new FC3850 in the SAN384B chassis. Time required Approximately 20 minutes per blade...
Page 140: Fc3870 - Installing An Fc10-6 10 Gb Blade
CD. FC3870 - Installing an FC10-6 10 Gb blade This feature can be installed while the SAN384B is operational. Attention: Follow these precautions for all procedures in this section to avoid damaging the port blades or chassis: v Wear a grounded ESD strap when handling a port blade (see “ESD precautions”...
Page 141: Procedures
Procedures Follow the links in the steps below to complete this installation. 1. Verify that the port blade is the correct part: 17P9637. 2. Verify which slot to install the blade. Slots are numbered from one through eight, from bottom to top, when facing the port side of the SAN384Bs. Port blades can be installed in any of the slots 1, 2, 7, or 8.
Page 142: Fc3880 - Installing An Fcoe10-24 Blade
FC3880 - Installing an FCOE10-24 blade This feature can be installed while the SAN384B is operational. Attention: Follow these precautions for all procedures in this section to avoid damaging the port blades or chassis: v Wear a grounded ESD strap when handling a port blade (see “ESD precautions”...
Page 143: Fc3890 - Installing An Fx8-24 Extension Blade
CD. FC3890 - Installing an FX8-24 extension blade This feature can be installed while the SAN384B is operational. Attention: Follow these precautions for all procedures in this section to avoid damaging the port blades or chassis: v Wear a grounded ESD strap when handling a port blade (see “ESD precautions”...
Page 144: Fc7870 - Installing An Inter-Chassis Cable Kit
CD. FC7870 - Installing an inter-chassis cable kit This feature can be installed while the SAN384B is operational. Time required Less than 10 minutes, not including installation of the ICL license or any needed configuration.
Page 145 2. Verify with the customer that the ICL license is installed on each chassis to be connected. Enter the licenseIdShow command for each chassis. If required, install the ICL license, following the instructions included with the license. 3. Remove the chassis door (“Removing and installing the chassis door” on page 61).
Page 146 SAN384B Installation, Service, and User Guide...
Page 147: Appendix A. Product Specifications
A minimum aggregate routing capacity of four million frames per second (for Class 2, Class 3, and Class F frames in a 64-port switch) System architecture Table 21 lists the system architecture for the SAN384B. Table 21. System architecture Fibre Channel Ports...
Page 148 FCoE to FC: <5 msec any port to any port at 10 Gbps, cut-through routing. Maximum frame size 2112-byte payload Frame buffers 2048 per ASIC, dynamically allocated. Classes of service Class 2, Class 3, Class F (interswitch frames) SAN384B Installation, Service, and User Guide...
Page 149 Note: Brocade-branded SFPs are required on this product.For a listing of SFPs and XFPs compatible with this product: v Go to the IBM SAN web page http://www.ibm.com/ systems/storage/san v Select the SAN384B product link v On the SAN384B product page, click the Interoperability Matrix link.
Page 150: System Size And Weights
System size and weights The weight of the SAN384B can vary considerably depending on the combination of blades installed. Use Table 22 and Table 23 to determine the weight of the system with your combination of port and application blades.
Page 151: Facility Requirements
Facility requirements The facility where the SAN384B is in use must meet the following requirements to provide for correct operation: v Adequate supply circuit, line fusing, and wire size, as specified by the electrical rating on the chassis nameplate v An air flow of at least 425 cubic meters per hour (250 cubic feet per minute),...
Page 152: Fibre Channel Port Specifications
Fibre channel port specifications The Fibre channel ports in the SAN384B support full duplex link speeds at 10.51875, 8.50, 4.25, 2.125, or 1.0625 Gbps inbound and outbound, automatically negotiating to the highest common speed of all devices connected to the port.
Page 153: Data Transmission Ranges
Table 25. Power specifications (continued) Specification Value System power consumption AC power consumption is configuration-specific. A system with four FC8-48 port blades (loaded with 1W SFPs), two CP8 blades, two CR4S-8 blades, and two blower assemblies consumes 841W. Data transmission ranges Table 26 provides the data transmission ranges for different cable types and port speeds.
Page 154: Gbe Port Specifications
Power cords Two power cords for connecting between the SAN384B and the power distribution units on the 2109 C36 cabinet are shipped with the product. See the IBM TotalStorage SAN Cabinet 2109 Model C36 Installation and Service Guide for information on connecting the cabinet to the facility power source. If the stand-alone feature is ordered for the SAN384B, then you must also order the country-specific power cords.
Page 155: Appendix B. Application Blades
GbE port mode. If operating in 10GbE mode the other end of the circuit must also be an FX8-24 operating in either 10GbE mode or dual mode with the corresponding VE_ports in 10GbE mode. © Copyright IBM Corp. 2009, 2010...
Page 156 Up to three FC trunking groups. The three groups are defined as: – Trunk group 0: FC ports 0, 1 – Trunk group 1: FC ports 6, 7 – Trunk group 2: FC ports 2, 3, 4, 5, 8, 9, 10, 11 SAN384B Installation, Service, and User Guide...
Page 157: Fcoe10-24 Blade
FCOE10-24 blade The FCOE10-24 blade has 24 Fibre Channel over Ethernet (FCoE) ports that enable the transmission of FC frames over an Ethernet network via encapsulation in standard Ethernet packets. This is enabled by adherence to Converged Enhanced Ethernet (CEE) standards, a low latency, lossless Ethernet standard. This does not require dedicated Ethernet lines, but rather can make use of existing Ethernet infrastructure to reduce costs.
Page 158 SAN384B Installation, Service, and User Guide...
Page 159: Appendix C. Diagnostics And Troubleshooting
Fabric Manager, Web Tools, Fabric Watch, and Advanced Performance Monitoring. If the SAN384B does not operate as expected, the following steps can be taken to diagnose the problem: v Check the LEDs and refer to the LED tables (see Chapter 4, “Monitoring system components,”...
Page 160: Interpreting Post And Boot Results
Interpreting POST and boot results The SAN384B performs power on self test (POST) by default each time the system is powered on, rebooted, or reset. The system can be rebooted using the reboot (to reboot each CP individually), or fastBoot commands. The fastBoot command reboots the SAN384B without running POST.
Page 161: Boot
1. Universal port configuration is performed. 2. Links are initialized. 3. Fabric is analyzed. If any ports are connected to other switches, the SAN384B participates in a fabric configuration. 4. The SAN384B obtains a domain ID and assigns port addresses.
Page 162 9600 bits per second, 8 databits, no parity, 1 stop bit, no flow control. Serial port might be incompatible Ensure that the SAN384B is connected to an (only RS–232 is supported). RS–232 port. RS–423 serial ports might experience difficulties due to corner-case incompatibilities of the standards.
Page 163 Table 28. Troubleshooting (continued) None of the LEDs on an Component might not be seated Ensure that the SAN384B has power and individual component are correctly. component is firmly seated. If problem continues, run the sensorShow command to determine component status. If component is a CP blade or port blade, enter the slotShow command to determine the status.
Page 164 SAN384B Installation, Service, and User Guide...
Page 165: Appendix D. Blade Port Numbering
Appendix D. Blade port numbering You can print or copy the illustrations in this appendix and use them to record the port numbering pattern for your SAN384B. See “Port numbering” on page 28 for details on the port numbering pattern for the different blades.
Page 166: Fc8-48 Port Blade
FC ports 0-31 (right to left) Figure 55. FC10-6 port blade, ports 0-5 from right to left Figure 56. FR4-18i routing blade | | | | | FC ports 0-15 (right to left) GbE ports (GE0 right, GE1 left) SAN384B Installation, Service, and User Guide...
Page 167 Figure 57. FX8-24 extension blade | | | | | Status LED FC ports 0-5 (numbered right to left) | | | | Power LED FC ports 6-11 (numbered right to left) | | | | 1 GbE ports 0-3 (numbered right to left) 1 GbE ports 4-9 (numbered right to left) | | | | 10 GbE ports 0-1 (numbered right to left)
Page 168 SAN384B Installation, Service, and User Guide...
Page 169: Notices
The materials at those web sites are not part of the materials for this IBM product and use of those web sites is at your own risk.
Page 170 Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products.
Page 171: Trademarks
International Business Machines Corporation in the United States, other countries, or both. A complete and current list of other IBM trademarks is available on the Web at http://www.ibm.com/legal/copytrade.shtml Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.
Page 172: Electronic Emission Notices
Properly shielded and grounded cables and connectors must be used in order to meet FCC emission limits. IBM is not responsible for any radio or television interference caused by using other than recommended cables and connectors or by unauthorized changes or modifications to this equipment.
Page 173: Germany Electromagnetic Compatibility Directive
Klasse A ein. Um dieses sicherzustellen, sind die Geräte wie in den Handbüchern beschrieben zu installieren und zu betreiben. Des Weiteren dürfen auch nur von der IBM empfohlene Kabel angeschlossen werden. IBM übernimmt keine Verantwortung für die Einhaltung der Schutzanforderungen, wenn das Produkt ohne Zustimmung der IBM verändert bzw.
Page 174: People's Republic Of China Class A Electronic Emission Statement
Korea Communications Commission (KCC) Statement Please note that this equipment has obtained EMC registration for commercial use. In the event that it has been mistakenly sold or purchased, please exchange it for equipment certified for home use. SAN384B Installation, Service, and User Guide...
Page 175: Russia Electromagnetic Interference (Emi) Class A Statement
Russia Electromagnetic Interference (EMI) Class A Statement Australia and New Zealand Class A Statement Attention: This is a Class A product. In a domestic environment this product might cause radio interference in which case the user might be required to take adequate measures.
Page 176 SAN384B Installation, Service, and User Guide...
Page 177: Index
45, 51 C36 11 FC3816 SAN384B installation 14 installing 16-port blade 107 cable management finger assembly danger notices xiii FC3832 installing 62 definitions xiii installing 32-port blade 107 removing 62 examples xiii © Copyright IBM Corp. 2009, 2010...
Page 178 107 FR4-18i routing blade 49 machine checks FR4-18i 66 components 49 external xxi FX8-24 blade 66, 115 installing 111 internal xxi inter-chassis cable kit 116 LEDs 51 modem 33 inter-chassis link (ICL) cable 85 SAN384B Installation, Service, and User Guide...
Page 179 24–inch load product documents xxiii rack relocation xx plate 11 product specifications 119 safety inspection organizing providing power to the SAN384B 35 external machine checks xxi cables 42 internal machine checks xxi overview 1 safety inspections xxi safety labels xvii...
Page 180 ESD 109, 111, 112, 114, 115 who should read this document xxiii switch name changing 38 bezel 59 synchronizing card time zone 40 status 59 system architecture 119 WWN bezel system component installing 78 status 45 removing 78, 79 SAN384B Installation, Service, and User Guide...
Page 182 Part Number: 45W8160 Printed in USA GC52-1333-02...

IBM SAN384B Installation, Service And User Manual

Read this First

Figures

Tables

Safety Notices

About this Document

Chapter 1. Introduction

Chapter 2. Installing a SAN384B in a Cabinet

Chapter 3. Starting and Configuring the SAN384B

Connecting the SAN384B and Host with a Serial Cable

Chapter 4. Monitoring System Components

Chapter 5. Removing and Installing Components

Chapter 6. Installing New Features

Appendix A. Product Specifications

Appendix B. Application Blades

Appendix C. Diagnostics and Troubleshooting

Appendix D. Blade Port Numbering

Notices

Quick Links

Troubleshooting

Related Manuals for IBM SAN384B

Summary of Contents for IBM SAN384B