SPARC Enterprise M4000/M5000 Servers Installation Guide Part No.: 819-2211-14, Manual Code: C120-E351-07EN December 2010, Revision A...
Page 2
INFRINGEMENT, ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID. Unless otherwise expressly set forth in such agreement, to the extent allowed by applicable law, in no event shall Oracle or Fujitsu Limited, and/or any of their affiliates have any liability to any third party under any legal theory for any loss of revenues or profits, loss of use or data, or business interruptions, or for...
Page 3
Aucune partie de ce produit, de ces technologies ou de ce document ne peut être reproduite sous quelque forme que ce soit, par quelque moyen que ce soit, sans l’autorisation écrite préalable d’Oracle et/ou ses sociétés affiliées et de Fujitsu Limited, et de leurs éventuels bailleurs de licence.
Contents Preface ix Installation Overview 1–1 Installation Workflow 1–1 Preparing to Install the Server 2–1 Safety Precautions 2–1 Before Installing the Server 2–2 2.2.1 Facility Power 2–2 2.2.1.1 Facility Power Requirements and Characteristics 2–4 2.2.1.2 Grounding 2–7 2.2.2 Cable Connections 2–8 2.2.3 Checking the Installation Location 2–8 Tools and Equipment 2–9...
Page 6
Connecting the Administration Console 3–5 3.3.1 Connecting the Console 3–7 3.3.2 Initializing the XSCF Unit 3–9 Powering On the Server 3–10 3.4.1 Verifying the Configuration 3–11 3.4.2 Checking the Dual-Power Feed 3–15 Connecting Additional Peripheral Devices 3–15 Connecting the Domains to the Network 4–1 Overview of Network Configuration 4–1 Connecting to the Network 4–1 Verifying the Network Connection 4–2...
Page 7
B.2.6 Using the fmstat Command B–8 Traditional Oracle Solaris Diagnostic Commands B–9 B.3.1 Using the iostat Command B–9 B.3.1.1 Options B–9 B.3.2 Using the prtdiag Command B–11 B.3.2.1 Options B–11 B.3.3 Using the prtconf Command B–14 B.3.3.1 Options B–14 B.3.4 Using the netstat Command B–16 B.3.4.1 Options B–16...
Page 8
viii SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010...
Preface This installation guide describes how to install and set up the SPARC Enterprise M4000/M5000 servers from Oracle and Fujitsu. This document is intended for authorized service providers. References herein to the M4000 server or M5000 server are references to the SPARC Enterprise M4000 or SPARC Enterprise M5000 server.
Text Conventions This manual uses the following fonts and symbols to express specific types of information. Fonts/symbols Meaning Example What you type, when contrasted AaBbCc123 XSCF> adduser jsmith with on-screen computer output. This font represents the example of command input in the frame. The names of commands, files, and AaBbCc123 XSCF>...
For Oracle users: ■ http://docs.sun.com For Fujitsu users in U.S.A., Canada, and Mexico: ■ http://www.computers.us.fujitsu.com/www/support_servers.shtml?s upport/servers For Fujitsu users in other countries, refer to this SPARC Enterprise contact: ■ http://www.fujitsu.com/global/contact/computing/sparce_index.html SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010...
C H A P T E R Installation Overview This chapter provides the process for installing the servers. Installation Workflow Installing a server requires the steps in FIGURE 1-1...
Workflow Required for Installation FIGURE 1-1 Preparation Checking the cables and environmental conditions. “Before Installing the Server” on page 2-2 Installation and Connecting the power cords checking the “Connecting Input Power Cords” on page 3-2 power supply Connecting the console “Connecting the Administration Console”...
C H A P T E R Preparing to Install the Server This chapter describes the items you are required to check, the environmental requirements for installation, installation areas, and other related matters. It contains the following sections: Section 2.1, “Safety Precautions” on page 2-1 ■...
Be careful not to allow the ambient temperature to rise sharply in winter. Such a ■ sudden temperature change would cause condensation to form inside the product. Allow for a sufficient warm-up period prior to operation. Do not install the server near a copy machine, air conditioner, welding machine, or ■...
Page 17
Electrical Specifications for the M4000 Server TABLE 2-1 Parameter Value Number of power cords 2 (1 power cord per power supply unit) Redundancy 1 + 1 redundant. Second power supply is redundant at 200 VAC Input current Voltage range 100–127 VAC 200–240 VAC Current, maximum 24.0A at 100–127 VAC (12A per cord)
2.2.1.1 Facility Power Requirements and Characteristics For proper redundancy your facility should have two independent power sources: Either circuit breakers connected to separate power company utility feeds or UPS (uninterruptible power system). For power redundancy the power cords should not be connected to the same facility power source.
Page 19
M5000 Server With Redundant PSU Connection FIGURE 2-2 PSU#1 PSU#2 PSU#3 PSU#0 Circuit breaker Chapter 2 Preparing to Install the Server...
Page 20
For a dual-power feed connection, connect the individual power cords separately to each AC power supply system. M4000 Server With Dual-power Feed Connection FIGURE 2-3 PSU#0 PSU#1 Circuit breaker Circuit breaker SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010...
M5000 Server With Dual-power Feed Connection FIGURE 2-4 PSU#0 PSU#1 PSU#2 PSU#3 Circuit breaker Circuit breaker 2.2.1.2 Grounding The system is shipped with grounding-type (three-wire) power cords. Always connect the cords into grounded power outlets. Contact your facilities manager or a qualified electrician to determine what type of power is supplied to your building.
2.2.2 Cable Connections lists the powercords for the servers. TABLE 2-3 Power Cords TABLE 2-3 System Location Powercord type SPARC Enterprise Americas, Taiwan NEMA L5-15 125V 15A M4000 Server Korea, Japan NEMA L6-20 250V 20A Connector Rest of the world IEC60309 16A 250V, 3PIN with IEC 60320 SPARC Enterprise Americas, Taiwan...
Tools and Equipment The following sections list the tools that are required to install the servers. The following tools are required to install the servers: Screwdriver, Phillips No. 2 ■ Antistatic wrist strap ■ Antistatic mat ■ Ethernet cable of category 5 or higher ■...
C H A P T E R Installing the Server This chapter describes how to install the server. It contains the following sections: Section 3.1, “Checking Components” on page 3-1 ■ Section 3.2, “Connecting Input Power Cords” on page 3-2 ■...
2. Check for a model name and input format on the shipping list. If any of the items on the packing list are missing, incorrect, or damaged, contact your sales representative. Connecting Input Power Cords The servers are shipped with grounding-type (three-wire) power cords. Always connect the cords into grounded power outlets.
3.2.1 Connecting a UPS Unit An uninterruptible power supply (UPS) unit is used to provide a stable supply of power to the system in the event of a power failure or an extensive power interruption. A UPS with an UPC interface can be connected to the UPC ports on the eXtended System Control facility unit (XSCFU or XSCF Unit) ( ) so that FIGURE 3-2...
M5000 Server Dual-power Feed UPC Connections FIGURE 3-1 UPC Interface Cables UPC#1 UPC#0 #3 #2 #1 #0 AC#0 UPC#0 Circuit breaker AC#1 UPC#1 Circuit breaker 3.2.2 Verifying the Power Input Connections Before Applying Power ● Have the site electrician verify that the input power source fulfills the power requirements.
Connecting the Administration Console The serial port on the XSCF Unit is a RJ-45 interface port used to monitor the boot process and to modify the default settings. The port is monitored and configured using an administrative console connected to the serial port by a serial cable. You can monitor and configure the XSCF Unit using any one of the following devices as the administrative console: ASCII terminal...
Page 30
Ports on XSCF Unit (M5000 Server Shown) FIGURE 3-2 Location Number Component RCI Port Serial Port USB port LAN 1 (Ethernet#1) SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010...
Location Number Component LAN 0 (Ethernet#0) UPC#1 UPC#0 Section A.1, “M4000 Server Views” on page A-1 for the location of the XSCF Unit on the SPARC Enterprise M4000 server. 3.3.1 Connecting the Console This section explains how to physically connect and configure the console. 1.
Page 32
Operator Panel Mode Switch FIGURE 3-3 For more details on the operator panel see Section A.3, “Operator Panel Overview” on page A-9. 4. Turn on the input power. Note – Wait at least 30 seconds before turning on the system power that you turned off, by pulling out the power cord or using the circuit breakers on the distribution panel.
Note – If Step 10 is not performed within 1 minute the login certification will expire. 11. Confirm that the XSCF Shell prompt is displayed on the administration console. XSCF> 3.3.2 Initializing the XSCF Unit To use full XSCF functionality, various settings need to be set. 1.
Note – setdualpowerfeed requires a complete chassis power cycle (all power cords removed) to apply any changes. Make certain to allow 30 seconds before plugging the power cords back into the chassis. To perform XSCF initial settings, use the XSCF default user account. Until user accounts for user environment is registered, log in with a default user account and default password.
6. Confirm that the POWER LED (green) on the operator panel is lit. 7. Check the POWER LED on each component. If the POWER LEDs are not lit see Appendix B for installation troubleshooting information. 8. Press and hold the Enter key, and press the “#.” (shift-3 and period) keys. These key combinations switch you from the domain console to the XSCF console.
Page 36
2. Type the showhardconf command with the -u option from the XSCF Shell. XSCF> showhardconf -u SPARC Enterprise M5000; Memory_Size:64 GB; +-----------------------------------+------------+ Quantity +-----------------------------------+------------+ | MBU_B CPUM Freq:2.530 GHz; MEMB Type:1A; Size:1 GB; DDC_A DDC_B | IOU DDC_A DDCR DDC_B | XSCFU | OPNL | PSU...
Page 37
4. From the ok prompt, use the probe-scsi-all command to confirm that the storage devices are installed. ok probe-scsi-all /pci@0,600000/pci@0/pci@8/pci@0/scsi@1 MPT Version 1.05, Firmware Version 1.07.00.00 Target 0 Unit 0 Disk SEAGATE ST973401LSUN72G 0556 143374738 Blocks, 73 GB SASAddress 5000c5000092beb9 PhyNum 0 Target 1 Unit 0...
Page 38
The show-devs command command output continued.. /pci@40,600000/pci@0/pci@8/pci@0/scsi@1 /pci@40,600000/pci@0/pci@8/pci@0/scsi@1/disk /pci@40,600000/pci@0/pci@8/pci@0/scsi@1/tape /pci@48,4000/ebus@1 /pci@48,4000/ebus@1/panel@14,280030 /pci@48,4000/ebus@1/scfc@14,200000 /pci@48,4000/ebus@1/serial@14,400000 /pci@48,4000/ebus@1/flashprom@10,0 /cmp@480,0/core@1 /cmp@480,0/core@0 /cmp@480,0/core@1/cpu@1 /cmp@480,0/core@1/cpu@0 /cmp@480,0/core@0/cpu@1 /cmp@480,0/core@0/cpu@0 /openprom/client-services /packages/obp-tftp /packages/terminal-emulator /packages/disk-label /packages/deblocker /packages/SUNW,builtin-drivers 6. Compare the configuration shown by showhardconf -u, probe-scsi-all, and show-devs with the shipping list. If the configuration is incorrect contact your sales representative.
3.4.2 Checking the Dual-Power Feed If the dual-power feed option is used, follow the procedure below to confirm that the system can operate even if one power feed is stopped. Note – Dual-Power Feed mode cannot be used with 100V power. 1.
C H A P T E R Connecting the Domains to the Network This chapter discusses how to establish a network for the servers. It contains the following sections: Section 4.1, “Overview of Network Configuration” on page 4-1 ■ Section 4.2, “Connecting to the Network” on page 4-1 ■...
● Connect the network to the domains using an Ethernet cable. You can connect to either the Gigabit Ethernet (GbE) port on the I/O unit or on an Ethernet card installed in the I/O unit. Verifying the Network Connection 1. Check the LAN link lamp on the I/O Unit or PCI slot that is connected to the network for activity.
A P P E N D I X System Views Appendix A provides views of the systems. This appendix has the following sections: Section A.1, “M4000 Server Views” on page A-1 ■ Section A.2, “M5000 Server Views” on page A-5 ■...
Page 44
M4000 Server Component Locations FIGURE A-1 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010...
Page 45
Location Number Component 60-mm fan (FAN_B#0) 60-mm fan (FAN_B#1) Top cover Fan cover Backplane Unit (BPU_A - includes IOBP, Power distribution board) 172-mm fan backplane (FANBP_A) 60-mm fan backplane (FANBP_B) Tape drive backplane (TAPEBP) Hard disk drive backplane (HDDBP#0) CD-RW/DVD-RW backplane (DVDBP_A) CD-RW/DVD-RW drive unit (DVDU) Hard disk drive (HDD#1) Hard disk drive (HDD#0)
Page 46
Location Number Component Memory board (MEMB#1) Memory board (MEMB#0) PCI slot (IOU#0 PCI#0) PCI slot (IOU#0 PCI#1) PCI slot (IOU#0 PCI#2) PCI slot (IOU#0 PCI#3) PCI slot (IOU#0 PCI#4) eXtended System Control facility unit (XSCFU) I/O Unit (IOU#0) DC-DC Converter Riser (DDCR IOU#0 Not shown) DC-DC Converter (DDC_B on DDCR on IOU#0) DC-DC Converter (DDC_A IOU#0 Not shown) * Contact your sales representative for tape drive unit options on...
Page 49
Location Number Component Top cover CPU module (CPUM#0) CPU module (CPUM#1) CPU module (CPUM#2) CPU module (CPUM#3) 172-mm fan (FAN_A#1) 172-mm fan (FAN_A#0) 172-mm fan (FAN_A#3) 172-mm fan (FAN_A#2) Backplane unit (BPU_B - includes IOBP, Power distribution board, bus bar) 172-mm fan backplane (FANBP_C) CD-RW/DVD-RW backplane (DVDBP_B) Tape drive backplane (TAPEBP)
Page 50
Location Number Component DC-DC Converter Riser (DDCR IOU#0 Not shown) DC-DC Converter (DDC_B on DDCR on IOU#0) DC-DC Converter (DDC_A IOU#0 Not shown) I/O Unit (IOU#1) DC-DC Converter Riser (DDCR IOU#1 Not shown) DC-DC Converter (DDC_B on DDCR on IOU#1) DC-DC Converter (DDC_A IOU#1 Not shown) PCI slot (PCI#0 IOU#1) PCI slot (PCI#1 IOU#1)
Location Number Component Memory Board (MEMB#3) Memory board (MEMB#2) Memory board (MEMB#1) Memory board (MEMB#0) * Contact your sales representative for tape drive unit options on M4000/M5000 servers. Operator Panel Overview When no network connection is available the operator panel is used to start or stop the system.
Page 52
M4000 Server Operator Panel FIGURE A-3 Location Number Component POWER LED XSCF STANDBY LED CHECK LED Power switch Mode switch (keyswitch) Antistatic ground socket shows the M5000 server operator panel. FIGURE A-4 A-10 SPARC Enterprise M4000/M5000 Servers Installation Guide • December 2010...
Page 53
M5000 Server Operator Panel FIGURE A-4 Location Number Component POWER LED XSCF STANDBY LED CHECK LED Power switch Mode switch (keyswitch) Antistatic ground socket Appendix A System Views A-11...
Page 54
During startup, the firmware toggles the front panel LEDs on and off to verify that each one is working correctly. After that, the front panel LEDs operate as described in TABLE A-1 Operator Panel LEDs and Switches TABLE A-1 Icon Name Color Description...
Page 55
The following table provides the meanings of the mode switch. Meanings of the Mode Switch TABLE A-2 Function Mode Switch State Definition Locked Service Inhibition of Break Signal Reception Enabled. Reception of the break Disabled signal can be enabled or disabled for each domain using setdomainmode.
A P P E N D I X Fault Isolation This chapter describes basic fault isolation information related to installation of the SPARC Enterprise M4000/M5000 servers from Oracle and Fujitsu. This appendix has the following sections: Section B.1, “Corrective Actions to Common Problems” on page B-1 ■...
Refer to the SPARC Enterprise M4000/M5000 Servers Service Manual for LED status. ■ Types of Troubleshooting Methods TABLE B-2 Troubleshooting Method Description Check LEDs The system LEDs (on the operator panel) indicate any system or hardware error detected during initial diagnosis or system operation.
B.2.2 Using the showlogs Command The showlogs command displays the contents of a specified log in order of timestamp starting with the oldest date. The showlogs command displays the following logs: error log ■ power log ■ event log ■ temperature and humidity record ■...
B.2.3 Using the showstatus Command The showstatus displays the information concerning the server’s degraded FRUs. An asterisk (*) which indicates that the unit has been degraded is displayed along with any of the following states: Normal ■ Faulted ■ Degraded ■...
At least three lines of new output are delivered to the user with the -V option: The first line is a summary of information you have seen before in the console ■ message but includes the timestamp, the UUID, and the Message-ID. The second line is a declaration of the certainty of the diagnosis.
B.2.5.1 fmadm config Command The fmadm config command output shows the version numbers of the diagnosis engines in use by your server, as well as their current state. You can check these versions against information on the My Oracle Support website to determine if you are running the latest diagnostic engines.
Traditional Oracle Solaris Diagnostic Commands These superuser commands can help you determine if you have issues in your server, in the network, or within another server that you are networking with. The following commands are detailed in this section. Section B.3.1, “Using the iostat Command” on page B-9 ■...
Page 66
Options for (Continued) iostat TABLE B-3 Option Description How It Can Help Displays device error summary statistics. The total Provides a short table with accumulated errors, hard errors, soft errors, and transport errors errors. Identifies suspect I/O devices. are displayed. Displays all device error statistics.
B.3.2 Using the prtdiag Command The prtdiag command displays configuration and diagnostic information. The diagnostic information identifies any failed component. The prtdiag command is located in the /usr/platform/platform-name/sbin/ directory. Note – The prtdiag command might indicate a slot number different than that identified elsewhere in this document.
Page 68
The following example shows output for the prtdiag command in verbose mode. # prtdiag -v System Configuration: xxxx Server System clock frequency: 1012 MHz Memory size: 262144 Megabytes ==================================== CPUs ==================================== Chip Impl. Mask ---- ---------------------------------------- ---- ----- ---- 2660 11.0 2660 11.0...
Page 69
prtdiag -v output continued. Lane/Frq LSB Type LPID RvID,DvID,VnID State Act, Max Name Model Logical Path ------------ PCIx 0 50, 1000 5, 1, 0 okay --, 133 scsi-pci1000,50 LSI,1064 /pci@0,600000/pci@0/pci@8/pci@0/scsi@1 00 PCIx 0 10, 1648, 14e4 5, 2, 0 okay --, 133 network-pci14e4,1648 /pci@0,600000/pci@0/pci@8/pci@0/network@2 00 PCIx 0...
B.3.3 Using the prtconf Command Similar to the show-devs command run at the ok prompt, the prtconf command displays the devices that are configured. The prtconf command identifies hardware that is recognized by the Oracle Solaris OS. If hardware is not suspected of being bad yet software applications are having trouble with the hardware, the prtconf command can indicate if the Oracle Solaris software recognizes the hardware, and if a driver for the hardware is loaded.
Page 71
The following example shows output for the prtconf command. prtconf System Configuration: xxxx Memory size: 1024 Megabytes System Peripherals (Software Nodes): SUNW,Sun SPARC packages (driver not attached) SUNW,builtin-drivers (driver not attached) deblocker (driver not attached) disk-label (driver not attached) terminal-emulator (driver not attached) dropins (driver not attached) kbd-translator (driver not attached) obp-tftp (driver not attached)
B.3.4 Using the netstat Command The netstat command displays the network status. B.3.4.1 Options describes options for the netstat command and how those options can TABLE B-6 help troubleshooting. Options for netstat TABLE B-6 Option Description How It Can Help Displays the interface state, Provides a quick overview of the network status.
B.3.5 Using the ping Command The ping command sends ICMP ECHO_REQUEST packets to network hosts. Depending on how the ping command is configured, the output displayed can identify troublesome network links or nodes. The destination host is specified in the variable hostname.
The following example shows output for the ping -s command. # ping -s san-ff2-17-a PING san-ff2-17-a: 56 data bytes 64 bytes from san-ff2-17-a (10.1.67.31): icmp_seq=0. time=0.427 ms 64 bytes from san-ff2-17-a (10.1.67.31): icmp_seq=1. time=0.194 ms ----san-ff2-17-a PING Statistics---- 2 packets transmitted, 2 packets received, 0% packet loss round-trip (ms) min/avg/max/stddev = 0.172/0.256/0.427/0.102 B.3.6...
# ps PID TTY TIME CMD 101042 pts/3 0:00 ps 101025 pts/3 0:00 sh Note – When using sort with the option, the column headings are printed so that the value in the first column is equal to zero. B.3.7 Using the prstat Command The prstat utility iteratively examines all active processes and reports statistics based on the selected output mode and sort order.
B.3.7.1 Options describes options for the prstat command and how those options can TABLE B-9 help troubleshooting. Options for prstat TABLE B-9 Option Description How It Can Help No option Displays a sorted list of the top Output identifies process ID, user ID, memory used, state, processes that are consuming CPU consumption, and command name.