Page 1 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide Corporate Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 526-4100 Text Part Number: OL-8794-04...
Page 2 OR ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. CCVP, the Cisco Logo, and the Cisco Square Bridge logo are trademarks of Cisco Systems, Inc.; Changing the Way We Work, Live, Play, and Learn is a service mark of Cisco Systems, Inc.;...
Page 3: Table Of Contents
Key Design Features SFS 7024 Product Specifications Mechanical/Thermal/Power Specifications Thermal Management Features Power Design Features Switch Characteristics Chassis Viewer Software Chassis Viewer Functionality Subnet Manager Subnet Management OL-8794-04 xiii Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide xiii Contents...
Page 4 Connect Equipment to the Ports and Power On the System Bringing Up the System For the First Time Changing the SFS 7024 IP Address and Default Gateway via the CLI Updating Management Spine IP Addresses in a Redundant Management Configuration...
Page 5 Modifying Switch Component Information Configuration and Monitoring Features Chassis View Menu Logging Set Level Reset Log Levels Firmware Update SNMP Target Configuration Filter Status Setting Community Strings Chassis Traps OL-8794-04 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide Contents...
Page 6 A P P E N D I X Overview Commands and Functional Groups Online Help Keyboard Shortcuts Accessing the CLI Groups and Commands General Firmware IbSwitchInfo Chassis KeyManagement TimeManagement SNMP Capture Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide OL-8794-04...
Page 7 OOB Ethernet RJ45 Port Problem SFS 7024 Leaf Module IB Ports Problem Troubleshooting Scenarios InfiniBand Invalid IP Address entered for SWC via Console Port Bad IB Cable Improperly Seated IB Cable OL-8794-04 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide Contents...
Page 8 S e n d d o c u m e n t a t i o n c o m m e n t s t o m d s f e e d b a c k - d o c @ c i s c o . c o m . Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 9: New And Changed Information
New and Changed Information The Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide applies to the SFS 7024 Release 3.1 or later. Table 1 lists the new and changed features available with each supported SFS 7024 release. Table 1...
Page 10 Table 1 Documented Features for the Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide (continued) Feature Redundant Management Double Data Rate (DDR) capabilities Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide viii Description Added redundant management information. 3.3...
Page 11: Preface
Preface This preface describes the audience, organization, and conventions of the Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide . It also provides information on how to obtain related documentation. Audience The intended audience for this document are network administrators responsible for configuring and operating network equipment.
Page 12: Conventions
Regulatory Compliance and Safety Information document that accompanied this device. Related Documentation The documentation set for the SFS 7012 and SFS 7024 includes the following documents: Regulatory Compliance and Safety Information for the Cisco SFS 7012 and SFS 7024 •...
Page 13: Product Documentation Dvd
Obtain assistance with security incidents that involve Cisco products Register to receive security information from Cisco • A current list of security advisories, security notices, and security responses for Cisco products is available at this URL: http://www.cisco.com/go/psirt OL-8794-04 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 14: Reporting Security Problems In Cisco Products
To access the Product Alert Tool, you must be a registered Cisco.com user. (To register as a Cisco.com user, go to this URL: http://tools.cisco.com/RPF/register/register.do) Registered users can access the tool at this URL: Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide security-alert@cisco.com psirt@cisco.com http://tools.cisco.com/Support/PAT/do/ViewMyProfiles.do?local=en...
Page 15: Obtaining Technical Assistance
Technical Support & Documentation radio button. To provide feedback about the Cisco.com website or a particular technical document, click Contacts & Feedback at the top of any Cisco.com web page. OL-8794-04 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide xiii...
Page 16: Submitting A Service Request
Cisco e-mail newsletters and other communications. Create a profile and then select the subscriptions that you would like to receive. To visit the Cisco Online Subscription Center, go to this URL: http://www.cisco.com/offer/subscribe Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide OL-8794-04...
Page 17 You can access the Internet Protocol Journal at this URL: http://www.cisco.com/ipj Networking products offered by Cisco Systems, as well as customer support services, can be • obtained at this URL: http://www.cisco.com/en/US/products/index.html...
Page 18 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide OL-8794-04...
Page 19: Product Overview
Leveraging InfiniBand (IB) — an industry-standard interconnect — the SFS 7024 provides high performance, offering a full bisectional bandwidth (FBB) fabric (10Gb-30Gb) and ultra-low switching latency. Additionally, the SFS 7024 can be configured to run at 2.5 Gbps single data rate (SDR), 5.0 Gbps double data rate (DDR), or both.
Page 20: Sfs 7024 Product Specifications
• Status indicators • • Four (4) independent AC input lines Switch Characteristics • 14U form factor • Full module enclosure • Available power (all copper): 1489 Watts max Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide Chapter OL-8794-04...
Page 21: Chassis Viewer Software
Diagnostics Figure 1-1 Chassis Viewer Home Page The Chassis Viewer runs on the Chassis Management Unit (CMU) processor of the SFS 7024 spine module(s), and is accessed through an OOB LAN workstation connected to the Ethernet port of the switches.
Page 22: Subnet Manager
From that point on, the Subnet Manager periodically sweeps the network for changes. Once the InfiniBand network is up and running, the InfiniBand General Services Managers (GSMs) begin to interface with General Services Agents (GSAs). Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide InfiniBand Subnet Manager...
Page 23: Subnet Management
IB-capable switches, routers, and channel adapters. Each node implements a Subnet Management Agent. Within the SFS 7024 Switch, a Subnet Management Agent (SMA) is implemented within its firmware. An SMA also runs on every InfiniBand-capable server that is equipped with an HCA. As shown in Figure 1-3 the Subnet Manager interacts with these SMAs to discover information about the nodes on the fabric.
Page 24: Snmp Support
InfiniBand devices on the fabric. SNMP Support Built-in support for Simple Network Management Protocol (SNMP) allows users to integrate a SFS 7024 into their existing management frameworks. SNMP allows users access to all statistics, trend analysis, alarm handling, filtering, and performance monitoring capabilities supported by these management frameworks.
Page 25: Installation
Installation This chapter describes how to install the Cisco SFS 7024 and its components, and it includes the following information: • Planning the Installation, page 2-13 Installation Tasks, page 2-20 • Hot Swapping Components, page 2-39 • Note Before you install, operate, or service the system, read the Regulatory Compliance and Safety Information for the Cisco SFS 7012 and SFS 7024 for important safety information.
Page 26: Statement 1019-Main Disconnecting Device
Ausschaltvorrichtung dient. Avvertenza Il gruppo spina-presa deve essere sempre accessibile, poiché viene utilizzato come dispositivo di scollegamento principale. Advarsel Kombinasjonen støpsel/uttak må alltid være tilgjengelig ettersom den fungerer som hovedfrakoplingsenhet. Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide Chapter OL-8794-04...
Page 27: Statement 1045-Short-Circuit Protection
Effettuare l’installazione rispettando le Norme CEI pertinenti. Advarsel Dette produktet krever beskyttelse mot kortslutninger (overspenninger) som en del av installasjonen. Bare installer utstyret i henhold til nasjonale og lokale krav til ledningsnett. Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide OL-8794-04...
Page 28 Advarsel Dette produkt kræver beskyttelse mod kortslutning (overstrøm). Dette skal være en del elinstallationen i bygningen. Installation skal ske i overensstemmelse med nationale og lokale ledningsregler. Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide Chapter OL-8794-04...
Page 29: Statement 1074-Comply With Local And National Electrical Codes
A instalação do equipamento tem de estar em conformidade com os códigos eléctricos locais e nacionais. ¡Advertencia! La instalación del equipo debe cumplir con las normativas de electricidad locales y nacionales. Varning! Installation av utrustningen måste ske i enlighet med gällande elinstallationsföreskrifter. Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide OL-8794-04...
Page 30: Statement 1075-Hazardous Voltage Or Energy Present On Dc Power Terminals
Os terminais de corrente contínua podem fornecer tensão ou energia perigosa. Volte a colocar a tampa, sempre que os terminais não estiverem a ser utilizados. Certifique-se de que os condutores sem isolamento não estão acessíveis, quando a tampa estiver colocada. Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide OL-8794-04...
Page 31: Planning The Installation
Cabinet doors must not impede the front-to-back air flow. Power supplies use the air inside the chassis and exhaust out the front of the chassis. 5% to 85% relative humidity (noncondensing). Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 32: Rack Specifications And Recommendations
Rack Specifications and Recommendations The SFS 7024 switch is designed to be installed in an existing 19-inch equipment rack or server rack. The SFS 7024 switch is designed for a four-post server cabinet. It is not designed for a two-post telco cabinet.
Page 33: Power Requirements
Transition time (the time necessary for the UPS to transfer from utility power to full-load battery • power). The longest potential time period the UPS might be required to supply backup power. • Whether or not the UPS unit also provides online protection. • OL-8794-04 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 34: Installation Tasks Checklist
Step 4 Physically install the switch in the rack. Step 5 Step 6 Install IB cables between the SFS 7024 and other IB-enabled network devices. Step 7 Install intra-cabinet power and grounding cables for the switch. Step 8 Power up the switch.
Page 35 When transporting an ESD sensitive component, first place it in an antistatic container or packaging. Caution Electrical Safety Precautions Warning Do not work alone when working with high voltage components. OL-8794-04 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 36: Tools And Equipment Required
The unit exhibits a distinct change in performance, indicating a need for service. – Tools and Equipment Required An ESD wrist strap • A #2 Phillips screwdriver • • Pen (felt-tip) to mark the mounting holes Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide Chapter OL-8794-04...
Page 37: Check The Installation Site
Chapter Check the Installation Site The SFS 7024 switch is designed to be installed in an existing server cabinet (not a telco cabinet), where it can be mounted in a standard equipment rack. Mounting brackets are integrated with the switch.
Page 38: Installation Tasks
The following is an overview of the installation tasks detailed in this section: If applicable, remove the doors of the rack. Step 1 Mark the rack, allowing 14 U (24.50 inches) of vertical space to install the SFS 7024 switch. Step 2 Install the support rails.
Page 39: Rack-Mount The Switch
To install the switch into the rack, perform the following steps: OL-8794-04 Rail Back Flange Install 2 screws to top and bottom holes Rail Front Flange Install 2 screws to op and bottom holes Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 40 Step 2 wrist with the metal button against the skin. Lift the switch and, from the front of the cabinet, slide it onto the rails. The fans and power supplies are Step 3 on the front of the chassis; leaf modules are to the rear.
Page 41 Install 1 screw and caged nut into each hole in the chassis sheet metal Top Rail Assembly Install the heyclip here Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide Figure Install 1 screw into each hole in the chassis sheet metal Figure...
Page 42: Installing The Switch Face Plate
Installing the Switch Face Plate To install the switch face plate(s): On the switch fan side, insert the notches on the top of the fascia into the two slots on the chassis frame. Step 1 Snap the bottom of the faceplate in place.
Page 43: Installing The Spine And Leaf Modules
Chapter Installing the Spine and Leaf Modules The purchased configuration for the SFS 7024 is shipped fully populated. Follow these steps when it Note becomes necessary to install or replace spine modules and leaf modules. Remove the necessary spine modules, spine module blanks, leaf modules, and leaf module blanks. For...
Page 44: Removing A Module Or Blank
Figure 2-12 SFS 7024 Chassis — Leaf Module Slot Numbering To install a module or filler, hold it so that the ejector handles are on the bottom. Step 2 Pull the handles out to extend them. Slide the module into the appropriate slot of the chassis until it Step 3 makes contact with the backplane.
Page 45: Connect Equipment To The Ports And Power On The System
Figure 2-13 SFS 7024 Chassis Front View OL-8794-04 Upper Hemisphere Spine 6 (Managed) Spine 5 (Managed) Spine 4 (Unmanaged) Spine 3 (Unmanaged) Spine 2 (Managed) Spine 1 (Managed) Lower Hemisphere Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide Figure 2-13 Figure 2-14...
Page 46 Figure 2-14 SFS 7024 Chassis Back View Connect a Category 5 or 6 (Cat 5/6) Ethernet cable to one of the RJ-45 connectors on the SFS 7024. Step 1 Connect the other end of the Cat 5/6 to the OOB LAN workstation. Refer to connector(s) to use: Connect the switch to IB-enabled hosts using 4X-to-4X IB cables.
Page 47: Bringing Up The System For The First Time
Provide strain relief for the power cable(s) by feeding them into the heyclips on the support rails. Step 1 Note Be certain that the power cords are firmly seated into the SFS 7024 AC power inlets. Depending upon the purchased configuration, refer to Step 2 If necessary, replace the faceplates over the switch fans.
Page 48: Changing The Sfs 7024 Ip Address And Default Gateway Via The Cli
Changing the SFS 7024 IP Address and Default Gateway via the CLI Note The following tasks must be performed for both the upper and lower hemispheres of the SFS 7024 The CLI can be accessed via Telnet, SSH, or through the SFS 7024 RS232 serial ports.
Page 49: Updating Management Spine Ip Addresses In A Redundant Management Configuration
– Power up the SFS 7024. Step 2 If using the RS-232 port, skip to Step 6. Steps 3 through 5 are for those users accessing the SFS 7024 Note via Telnet or SSH. If using Telnet or SSH, access the SFS 7024 with the following command: Step 3 open 192.168.100.9...
Page 50 Found Intel Strata Flash 128 MBit (0x8918). Mounted raw file system on device /image1. (size=6291456 bytes) Mounted raw file system on device /image2. (size=6291456 bytes) Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide Jan 19 2006, 15:03:31 Chapter OL-8794-04...
Page 51 (pw) (blank = use rsh): ftp flags (f) target name (tn) OL-8794-04 Jan 19 2006, 15:03:31 : icspkg0 : home : /image1 <NEW IP ADDRESS> : 192.168.100.1 : ftp : 0x0 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 52: Sfs 7024 Component Leds
• The user is able to bring up the Chassis Viewer (for each hemisphere) through a web browser on the OOB LAN. The home page displays the front and back views of the SFS 7024 switch. SFS 7024 Component LEDs...
Page 53 The fan speed has fallen below the minimum allowed RPM for a fan. – Power Supply LEDs Each SFS 7024 power supply has two LEDs: DC OK and AC OK. Following are the statuses for each. DC OK Green –...
Page 54: Sfs 7024 Leaf And Spine Module Leds
– ensure that no damage is done to its components. Blinking Amber • Spine Module Management LEDs Each SFS 7024 spine module has three management LEDs: • Capable: Green – Off indicates that the spine slot does not support management.
Page 55: Accessing On-Line Help
• Green – Off indicates that the switch is not capable of running at DDR speeds (i.e., SDR only). – Accessing On-line Help Online help can be accessed from anywhere within the Chassis Viewer by clicking on the ? buttons as...
Page 56: Shutdown Procedures
Figure 2-19 Reboot Window Select the radio button of the spine to be rebooted, or select the radio button to reboot the entire Step 2 hemisphere. Click Reboot. Step 3 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide Chapter OL-8794-04...
Page 57: Hot Swapping Components
Be certain that the managed spine to be hot swapped is a that same firmware level as all other Caution components in the SFS 7024. A hot swap of a managed spine with another firmware level will cause a disruptive reboot (i.e., I/O traffic is interrupted).
Page 58: Hot Swapping The Fan Unit
Tighten the captive panel screw. Hot Swapping Power Supplies The SFS 7024 switch requires a minimum of six power supplies for normal operation. Power supplies can be hot swapped without powering down the switch. To replace a power supply: Loosen the captive panel screw.
Page 59: Operations And Administration
Operations and Administration This chapter describes how to administer and configure the Cisco SFS 7024 and its components, and it includes the following information: • Logging, page 3-53 Firmware Update, page 3-58 • SNMP, page 3-59 • Chassis Traps, page 3-64 •...
Page 60: Home Page
Figure 3-1 Chassis Viewer The Chassis Viewer’s home page provides a high-level overview of each hemisphere of the SFS 7024 switch and individual leaf and spine modules. This area is the starting point to more detailed information for the SFS 7024 chassis and components (fans and power supplies), leaf modules, and spine modules.
Page 61: Displaying The Leaf And Spine Module Views
Displaying the Leaf and Spine Module Views Leaf Module View To display the leaf module view for the SFS 7024: Mouse over the leaf module to display. The edges of the leaf module are highlighted green as shown in Step 1...
Page 62: Spine Module View
Figure 3-6 Leaf Module View Spine Module View To display the spine module view for the SFS 7024: Mouse over the spine module to display. The edges of the spine module are highlighted green as shown Step 1 in Figure 3-7 below:...
Page 63: Leaf And Spine Module Component Details Area
Figure 3-9 Leaf and Spine Component Details Area Leaf and Spine Details Header The leaf and spine Details Header allows the user to execute the most common tasks for the SFS 7024 switch: Display the applicable hemisphere Home page •...
Page 64: Displaying The Chassis View
Displaying the Chassis View There are two ways to display the chassis view for the SFS 7024: Mouse over the outer region of the leaf module view. The edges of the chassis are highlighted green as Step 1 shown in Figure 3-11 below: Figure 3-11 Leaf Module Chassis Mouseover Left click the mouse.
Page 65: Chassis View Component Details Area
Details Header • Information area. • Menu • Chassis Details Header The Chassis Details Header allows the user to execute the most common tasks for the SFS 7024 switch: Display the applicable hemisphere Home page • Reboot • View FRU •...
Page 66 This is accomplished through the CLI of the master spine. Step 1 Access the master spine CLI via Telnet, SSH, or through the SFS 7024 RS232 serial ports. Step 2 The system prompts for a user name. At the prompt enter: admin The system prompts for a password.
Page 67: Chassis View Component Information Area
The LEDs and Sensors tab displays for the applicable hemisphere: Switch component LED information for chassis status, chassis SMA, fan and power supplies. • Slot-based temperature and AC-power sensor data for the internal switching complex. • OL-8794-04 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 68 For a detailed explanation of physical LEDs on the hardware components, please refer to the section 7024 Component LEDs, page System Tab The System tab displays the overall system information for the applicable hemisphere of the SFS 7024. This information includes the following items: Out of Band LAN IP The IP address for the applicable hemisphere of the switch.
Page 69 The Power tab displays switch power supply information. This information includes the following items: Description A description of the component, assigned by an administrator. Status Displays the status of the component. Part Num Displays the part number of the component. Detail OL-8794-04 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 70: Modifying Switch Component Information
Refreshes all fields in the Power tab. Fan Tab The Fan tab displays switch fan information. For descriptions of the fields, see the Power Tab. Backplane Tab The Backplane tab displays switch backplane information. For descriptions of the fields, see the Power Tab.
Page 71: Configuration And Monitoring Features
The Chassis View Menu allows the user to execute all configuration and operation tasks available for the SFS 7024 switch. Logging The Logging submenu allows the user to set and reset levels for the message log file. OL-8794-04 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 72: Set Level
From this screen, the user can change any of the log level settings for a specific software module by clicking on the Configure hyperlink, which displays a configuration screen: Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide Chapter OL-8794-04...
Page 73 INFO: Informational messages that occur during a system or component boot. The user does not need to take any action. – PERIODIC: An informational message containing periodic statistics. The user does not need to take action. OL-8794-04 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 74 Specifically, debug 3-5 have the most affect on system performance. Preset Tab The Preset tab allows the user to quickly change log level settings for all software modules on the switch. Figure 3-24 Log System Configurator: Preset Tab To change the log level settings: Click the On-Off checkbox to the right of the setting(s).
Page 75: Reset Log Levels
Type /etc/init.d/syslog restart, and press Enter. Step 2 To centralize logging for all switches in an IB fabric, the user can configure each switch to point to the Note same syslog server (running Linux), which has the syslog daemon (syslogd) running.
Page 76: Firmware Update
Firmware Update Figure 3-28 Firmware Update Button The Firmware Update button allows the user to select an alternate firmware file for the SFS 7024. These alternate files are reflected in the drop-down lists in the Firmware Update screen. To download firmware: From the menu, select Maintenance.
Page 77: Snmp
Figure 3-31 Target MIB Configuration Button To display the Target Configuration window: From the menu, select SNMP. Step 1 Select Target Configuration. Step 2 The SNMP Target Configuration window is displayed: Step 3 OL-8794-04 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 78 Specifies the IP address and port in hex, separated by colons. The first eight values make up the IP address, the last 4 make up the port number. For example, specify 0xc0:a8:00:65:00:a2 for 192.168.0.101 Port: 162. Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide [-p port] [-t timeout] [-r retry_count] [-l Chapter...
Page 79 SNMP to use. Storage Type • This field determines whether or not the entry is saved for each reboot of the SFS 7024. Nonvolatile means that the value is saved, and remains with each subsequent reboot. – Volatile or Other indicates it will not be saved.
Page 80: Filter Status
AuthPriv: Authentication and privacy – Storage Type • This field determines whether or not the entry is saved for each reboot of the SFS 7024. – Nonvolatile means that the value is saved, and remains with each subsequent reboot. –...
Page 81: Setting Community Strings
Read/Write Community Name • Figure 3-35 Set Community Strings Button To set the Community Strings: Click SNMP Step 1 Click Set Community Strings. The Set Community Strings screen is displayed. Step 2 OL-8794-04 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 82: Chassis Traps
In each field, enter a meaningful name (such as public and private shown above), and click on Apply. Step 3 Chassis Traps The Chassis Trap Control screen allows the user to set default trap scenarios related to SFS 7024. Figure 3-37 Chassis Trap Control Click Chassis.
Page 83 This trap indicates that the internal service used to support the management of the chassis has terminated abnormally. icsChassisTrapSystemSwitchFailover This trap indicates that there was a fail over from one switch in the chassis to the other. Slot Group icsChassisTrapModuleNotResponding This trap indicates that a module is not responding to HEARTBEAT poll requests, that are issued by the internal chassis management service.
Page 84 This trap indicates that a fan has failed and is not operational. icsChassisTrapFanTrayEEPROMReadFailure This trap indicates, that an error condition was encountered when reading the EEPROM of the fan tray. Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide OL-8794-04...
Page 85: Sfs 7024 Port Statistics
A = Spine module switch chip A B = Spine module switch chip B Example: S4AL24 is the ISL between spine module 4, switch chip A and leaf module 24. OL-8794-04 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 86: Port Statistics Field Descriptions
Spine chips are referenced by the spine number and the switch chip identifier. Each spine module Note contains two switch chips (Switch chip A and B). Port Statistics Field Descriptions Port Name/Port Number: Corresponds to external leaf module number/port number, spine module number/port number, and all interswtich links.
Page 87 Raw Violations Inbound: Number of times raw inbound packet discarded. Raw Violations Outbound: Number of times raw outbound packet was discarded. OL-8794-04 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 88: Leaf And Spine Module Ib Port Statistics
From the Spine Port Stats menu, select IB Port Stats. Step 2 Figure 3-43 Spine Port Stats Menu The spine port statistics window is displayed: Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide Chapter Port Statistics Field Descriptions, OL-8794-04...
Page 89: Set Field Thresholds
Set Field Thresholds The Set Field Thresholds screen allows the user to set, for a specific parameter(s), an error message threshold for the 12 cable ports on the SFS 7024. Figure 3-45 Set Field Thresholds To change error reporting thresholds, do the following: Click on Port Stats.
Page 90 The threshold for the number of 32-bit data words received by the port. portXmitPktsThresh The threshold for the number of data packets transmitted by the port. portRecvPktsThresh The threshold for the number of data packets received by the port. Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide Chapter OL-8794-04...
Page 91: Time Service
The threshold for the number of excessive buffer overrun errors on the port. Time Service The System Time Information screen allows the user to set the system time using either network time protocol (NTP) or manual overrides. OL-8794-04 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 92 Enter the IP address for the NTP server. Step 2 Step 3 To save, click on Apply. Figure 3-49 Time Service - NTP Setup To manually set the system time: Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide Chapter OL-8794-04...
Page 93 Date will always be the 1st Sunday in April. However, the Daylight Saving Time End Date will vary between the 4th and 5th Sunday of October. Be certain to check a calendar when setting this parameter. Following are upcoming DST end dates: OL-8794-04 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 94: Configuring The Switch Oob Ip Address
OOB management port to an external network. To configure the Switch default gateway IP address: From the OOB LAN IP submenu, click Set Default Gateway IP. Step 1 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide Chapter OL-8794-04...
Page 95 Figure 3-55 Set Default Gateway IP Window Type in the correct switch default gateway IP address. Step 3 Click Apply. Step 4 A reboot is required to activate the new gateway IP address. Note OL-8794-04 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 96: Spine View Menu
Viewing the Log The View Log button allows the user to view the message log. Figure 3-58 View Log Button To view the message log: Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide SFS 7024 Port Statistics, page 3-67. Chapter...
Page 97: Purging The Log
The Purge Log button purges the RAM, clearing the log file(s). Figure 3-60 Purge Log Button To purge the log: From the menu, click Logging. Step 1 Click Purge Log. The Purge Log confirmation window is displayed Step 2 OL-8794-04 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 98: Select Boot Image
The message log file is now purged. Step 4 Select Boot Image The Select Boot Image button allows the user to choose an alternative boot image for the SFS 7024. To select a boot image: Figure 3-62 Select Boot Image Button From the menu, select Maintenance.
Page 99: Adding A New License Key
Figure 3-67 License Key Submenu Click on Key Administration. The Key Management window is displayed. Step 2 Step 3 To delete a license key, click the Delete button. The system prompts with the following: OL-8794-04 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 100 Chapter Figure 3-68 License Key Delete Prompt Step 4 Click OK to delete. Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide OL-8794-04...
Page 101: Appendix
30A @ 230VAC (25°C cold start) • Power Factor 0.95 • Two IEC 320 connectors for independent AC inputs • UL, CSA, CE, VCCI, GS, FCC Class B, IC Class B, ICES - 003 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 102 Appendix Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide OL-8794-04...
Page 103: Appendix
Chassis Viewer GUI. The CLI is accessed via a terminal attached to the SFS 7024 spine module(s) RS232 port(s) or via the OOB management port using Telnet and secure shell (SSH). For a standalone SFS 7024, the user would Telnet to the unit's IP address(es).
Page 104: Commands And Functional Groups
The CLI is also accessible through the RS232 serial port of the SFS 7024. Accessing the CLI through the serial port never requires a login and password and defaults to administrator privileges. Providing access through the serial port means that users will always have access to the SFS 7024, even if Telnet and SSH are not functioning.
Page 105: Online Help
• or lists all the available commands that begin with the characters already typed. Accessing the CLI The CLI can be accessed via Telnet, SSH, or through the SFS 7024 RS232 serial port. The following Note instructions use Telnet. Telnet to the IP address of the SFS 7024 (the default IP address is 192.168.100.9) with the following...
Page 106: Groups And Commands
– Type the appropriate password and press Enter. The system responds with: Welcome to the SFS 7024 CLI. Type 'list' for the list of commands. Groups and Commands The following section lists the CLI’s functional groups along with the commands for each group. For more specific information for each functional group, the user would execute the help <GROUP NAME>...
Page 107 Use smShowLids smGetPriority Use smShowPriority smDumpGroups Use smShowGroups smDumpServices Use smShowServices smDumpSubscriptions Use smShowSubscriptions smDisplayMasterLMC Use smShowMasterLMC smDisplaySmMasterLid Use smShowMasterLid smDumpLidMap Use smShowLidMap smDisplayMaxLid Use smShowMaxLid smDisplaySMParms Use smShowSMParms ismTune OL-8794-04 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 108: Ibswitchinfo
PID: 74-4323-01, VID: N/A, SN: N/A NAME: "Fan Tray 4", PID: 74-4323-01, VID: N/A, SN: N/A Total devices found: 9 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide DESCR: "4X 12-Port Card" DESCR: "Fabric Module-MGR'D" DESCR: "144 Port IB Server Switch"...
Page 109: Chassis
Displays the default gateway IP address setDefaultRoute Change the default gateway IP address arpShow Displays the link level adress resolution protocol (ARP) table hostShow Displays the host name table OL-8794-04 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 110: Firmware
Configure the syslog host address logShowConfig Display the current log configuration KeyManagement showKeys Display the list of installed license keys addKey Install a license key removeKey Remove a license key Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide Appendix OL-8794-04...
Page 111: Timemanagement
Configure the daylight savings time settings SNMP snmpCommunityConf Configure the SNMP community strings snmpTargetAddr Configure the SNMP trap targets snmpTargetParams Access the snmpTargetParamsTable snmpNotifyProfile Access the snmpNotifyFilterProfileTable snmpNotifyFilter Access the snmpNotifyFilterTable snmpNotify Access the snmpNotifyTable OL-8794-04 Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide...
Page 112: Capture
Capture miscellaneous information. This includes information such as license keys, memory test, time zone, and time Daylight Saving Time (DST) captureSnmp Capture SNMP information captureShell Capture shell command information Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide Appendix OL-8794-04...
Page 113: Troubleshooting
Troubleshooting This appendix describes how to troubleshoot the Cisco SFS 7024, and it includes the following information: • Hardware Checks, page C-95 Troubleshooting Scenarios, page C-97 • Hardware Checks Switch Power Supply OL-8794-04 A P P E N D I X...
Page 114: Oob Ethernet Rj45 Port
OOB Ethernet RJ45 Port SFS 7024 Leaf Module IB Ports Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide Problem Red LED is lit Fan not running Problem The SFS 7024 Ethernet Port(s) have a RJ45 Cable with a Noise Problem:...
Page 115: Troubleshooting Scenarios Infiniband
Resolution / Workaround Possibly a bad IB cable(s). Ensure that there is a Blue LED illuminated on the leaf module IB ports of the SFS 7024 switch. Make sure that all devices (nodes) can be seen in the subnet manager window.
Page 116 Appendix Cisco SFS 7024 InfiniBand Server Switch Hardware Users Guide OL-8794-04...

Cisco SFS 7024 Hardware User's Manual

New and Changed Information

Preface

Product Overview

Installation

Operations and Administration

Appendix

Technical Specifications

Appendix

Command Line Interface

Troubleshooting

Quick Links

Related Manuals for Cisco SFS 7024

Summary of Contents for Cisco SFS 7024

Table of Contents