Managing pcie adapters for ibm power system l922 9008-22l; ibm power system s922 9009-22a; ibm power system h922 9223-22h; ibm power system s914 9009-41a; ibm power system s924 9009-42a; ibm power system h924 9223-42h; ibm emx0 pcie gen3 i/o expansion dra (226 pages)
Flex system fc5054 4-port 16 gb fc adapter (34 pages)
Summary of Contents for IBM OpenCAPI
Page 1
Power Systems Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Page 2
Note Before using this information and the product it supports, read the information in “Safety notices” on page v, “Notices” on page 57, the IBM Systems Safety Notices manual, G229-9054, and the IBM Environmental Notices and User Guide, Z125–5823. ®...
Safety notices......................v 8335-GTH system OpenCAPI PCIe adapter enablement introduction...... 1 Installing the OpenCAPI adapter support on the 8335-GTH system......3 Removing and replacing OpenCAPI adapter support on the 8335-GTH system..13 Common procedures for servicing or installing features........25 Before you begin............................25 Identifying the system that contains the part to replace.................
Das Produkt ist nicht für den Einsatz an Bildschirmarbeitsplätzen im Sinne § 2 der Bildschirmarbeitsverordnung geeignet. Laser safety information IBM servers can use I/O cards or features that are fiber-optic based and that utilize lasers or LEDs. Laser compliance IBM servers may be installed inside or outside of an IT equipment rack.
Page 6
• Each rack cabinet might have more than one power cord. – For AC powered racks, be sure to disconnect all power cords in the rack cabinet when directed to disconnect power during servicing. vi Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Page 7
– For racks with a DC power distribution panel (PDP), turn off the circuit breaker that controls the power to the system unit(s), or disconnect the customer’s DC power source, when directed to disconnect power during servicing. • Connect all devices installed in a rack cabinet to power devices installed in the same rack cabinet.
Page 8
(for example, when working from a ladder). Stability hazard: • The rack may tip over causing serious personal injury. • Before extending the rack to the installation position, read the installation instructions. viii Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Page 9
• Do not put any load on the slide-rail mounted equipment mounted in the installation position. • Do not leave the slide-rail mounted equipment in the installation position. (L002) (L003) Safety notices ix...
Page 10
There are no serviceable parts inside the device. • Use of the controls or adjustments or performance of procedures other than those specified herein might result in hazardous radiation exposure. (C026) x Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Page 11
Exchange only with the IBM-approved part. Recycle or discard the battery as instructed by local regulations. In the United States, IBM has a process for the collection of this battery. For information, call 1-800-426-4333. Have the IBM part number for the battery unit available when you call.
Page 12
Freewheeling will cause uneven cable wrapping around winch drum, damage cable, and may cause serious injury. • This TOOL must be maintained correctly for IBM Service personnel to use it. IBM shall inspect condition and verify maintenance history before operation. Personnel reserve the right not to use TOOL if inadequate.
Page 13
The dc-powered system employs an isolated DC return (DC-I) design. The DC battery return terminal shall not be connected to the chassis or frame ground. The dc-powered system is intended to be installed in a common bonding network (CBN) as described in GR-1089-CORE.
Page 14
Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
GPUs in GPU positions 1 and 2 when the interposer card is installed. An OpenCAPI cable connects between the interposer and the OpenCAPI PCIe adapter. If you need to replace the interposer card or OpenCAPI cable, order part number 03FP138 and replace both parts at the same time.
Page 16
2 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Installing the OpenCAPI adapter support on the 8335-GTH system Before you begin Power off the system and place it in the service position. For instructions, see “Preparing the 8335-GTC, 8335-GTG, 8335-GTH, 8335-GTW, or 8335-GTX system to remove and replace internal parts” on page...
Page 18
Be careful of the pins on the bottom of the GPUs to avoid damaging the pins and the GPU. c) Place the protective covers on the bottom of the removed GPUs. 4 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Page 19
(0.47 in, 12 mm in length) by using the sequence that is shown. Take care to not damage the system backplane with the screw driver tip. Installing the OpenCAPI adapter support on the 8335-GTH system 5...
Page 20
Figure 4. Installing the OpenCAPI interposer 6. If needed, label and remove any plugs that extend out of the rear OpenCAPI PCIe adapter. 7. Attach the OpenCAPI cable to the OpenCAPI PCIe adapter as shown in the following figure. 6 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Page 21
Figure 5. Inserting the OpenCAPI cable into the PCIe adapter 8. Pass the OpenCAPI cable through the bulkhead as shown in the following figure. Installing the OpenCAPI adapter support on the 8335-GTH system 7...
Page 22
Figure 6. Routing the OpenCAPI cable 9. Insert the OpenCAPI PCIe adapter into PCIe adapter slot 4. Align the adapter properly and insert it fully into the slot as shown in the following figure. 8 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Page 23
Figure 7. Inserting the PCIe adapter 10. Attach the OpenCAPI cable to the OpenCAPI interposer adapter in GPU position 3 as shown in the following figure. Installing the OpenCAPI adapter support on the 8335-GTH system 9...
Page 24
Figure 8. Inserting the OpenCAPI cable into the interposer 11. Using your labels, replace any plugs that you removed from the rear of the OpenCAPI PCIe adapter. 12. Install the air baffle (A) onto the interposer. Use four screws (0.16 in, 4 mm in length) at (B), secure the air baffle to the interposer.
Page 25
13. Install a GPU air baffle (A) into GPU position 4. Use four screws (0.16 in, 4 mm in length) in positions (B) to secure the air baffle to the system backplane. Installing the OpenCAPI adapter support on the 8335-GTH system 11...
Page 26
Prepare the system for operation. For instructions, see “Preparing the 8335-GTC, 8335-GTG, 8335-GTH, 8335-GTW, or 8335-GTX system for operation after you remove and replace internal parts” on page 36. 12 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Page 28
Figure 11. Removing the OpenCAPI cable from the interposer 3. If needed, label and remove any plugs that extend out of the rear OpenCAPI PCIe adapter. 4. Remove the OpenCAPI PCIe adapter from PCIe adapter slot 4 as shown in the following figure.
Page 29
Figure 12. Removing a PCIe adapter 5. Remove the OpenCAPI cable from the OpenCAPI PCIe adapter as shown in the following figure. Removing and replacing OpenCAPI adapter support on the 8335-GTH system 15...
Page 30
Figure 13. Removing the OpenCAPI cable from the PCIe adapter 6. Remove the air baffle (A) from the interposer. Remove the four screws at (B). 16 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Page 31
Figure 14. Removing the interposer air baffle 7. Remove the eight screws and remove the old interposer from GPU position 3 as shown in the following figure. Do not unscrew the four inner most screws. Removing and replacing OpenCAPI adapter support on the 8335-GTH system 17...
Page 32
(0.47 in, 12 mm in length) by using the sequence that is shown. Take care to not damage the system backplane with the screw driver tip. 18 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Page 33
Figure 16. Installing the OpenCAPI interposer 9. Attach the OpenCAPI cable to the OpenCAPI PCIe adapter as shown in the following figure. Removing and replacing OpenCAPI adapter support on the 8335-GTH system 19...
Page 34
Figure 17. Inserting the OpenCAPI cable into the PCIe adapter 10. Pass the OpenCAPI cable through the bulkhead as shown in the following figure. 20 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Page 35
Figure 18. Routing the OpenCAPI cable 11. Insert the OpenCAPI PCIe adapter into PCIe adapter slot 4. Align the adapter properly and insert it fully into the slot as shown in the following figure. Removing and replacing OpenCAPI adapter support on the 8335-GTH system 21...
Page 36
Figure 19. Inserting the PCIe adapter 12. Attach the OpenCAPI cable to the OpenCAPI interposer adapter in GPU position 3 as shown in the following figure. 22 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Page 37
Figure 20. Inserting the OpenCAPI cable into the interposer 13. Using your labels, replace any plugs that you removed from the rear of the OpenCAPI PCIe adapter. 14. Install the air baffle (A) onto the interposer. Use four screws (0.16 in, 4 mm in length) at (B), secure the air baffle to the interposer.
Page 38
Prepare the system for operation. For instructions, see “Preparing the 8335-GTC, 8335-GTG, 8335-GTH, 8335-GTW, or 8335-GTX system for operation after you remove and replace internal parts” on page 36. 24 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Electrical voltage and current from power, telephone, and communication cables are hazardous. To avoid a shock hazard: If IBM supplied the power cord(s), connect power to this unit only with the IBM provided power cord. Do not use the IBM provided power cord for any other product. Do not open or service any power supply assembly.
Page 40
• Do not install a unit in a rack where the air flow is compromised. Ensure that air flow is not blocked or reduced on any side, front, or back of a unit used for air flow through the unit. 26 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Page 41
• Consideration should be given to the connection of the equipment to the supply circuit so that overloading of the circuits does not compromise the supply wiring or overcurrent protection. To provide the correct power connection to a rack, refer to the rating labels located on the equipment in the rack to determine the total power requirement of the supply circuit.
Page 42
(L005) CAUTION: Hazardous energy present. Voltages with hazardous energy might cause heating when shorted with metal, which might result in splattered metal, burns, or both. (L005) 28 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
LEDs on the 8335-GTC, 8335-GTG, 8335-GTH, 8335-GTW, or 8335-GTX system Use this information as a guide to the LEDs on the IBM Power System AC922 (8335-GTC, 8335-GTG, and 8335-GTH) or IBM Power System AC922 (8335-GTW and 8335-GTX) system. The LEDs indicate various system statuses. These LEDs are at the front (as shown in Figure 22 on page 30 and Figure 23 on page 30) and at the rear of the system (as shown in Figure 24 on page 31).
Page 44
Figure 22. Front LEDs with bezel on Figure 23. Front LEDs with bezel off 30 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Figure 24. Rear LEDs LED indicators are on the following parts: • At the front of the system: – Disk drives (green LED indicates activity; amber LED indicates a problem). – Fans (green LED indicates activity; amber LED indicates a problem). •...
Preparing the 8335-GTC, 8335-GTG, 8335-GTH, 8335-GTW, or 8335-GTX system to remove and replace internal parts To prepare the IBM Power System AC922 (8335-GTC, 8335-GTG, and 8335-GTH) or IBM Power System AC922 (8335-GTW and 8335-GTX) system to remove and replace internal parts, complete the steps in this procedure.
Page 47
Common procedures for servicing or installing features in the 8335-GTC, 8335-GTG, 8335-GTH, 8335-GTW, or 8335-GTX system 33...
Page 48
Place your other hand underneath the power supply and pull the power supply out of the system and place it on an ESD mat. d) Repeat steps “9.a” on page 34 - “9.c” on page 34 for the other power supply. 34 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Page 49
Figure 25. Removing the power supplies from the system 10. Place the system into the service position. For instructions, see “Placing an 8335-GTC, 8335-GTG, 8335-GTH, 8335-GTW, or 8335-GTX system into the service position” on page 43. CAUTION: Do not place any object on top of a rack-mounted device unless that rack-mounted device is intended for use as a shelf.
8335-GTX system for operation after you remove and replace internal parts To prepare the IBM Power System AC922 (8335-GTC, 8335-GTG, and 8335-GTH) or IBM Power System AC922 (8335-GTW and 8335-GTX) system for operation after you remove and replace internal parts, complete the steps in this procedure.
Page 51
8. If the BMC card was replaced continue to the next step, otherwise go to step “11” on page 37. 9. Configure the BMC IP address. For instructions, see Configuring the BMC IP address (www.ibm.com/support/knowledgecenter/ POWER9/p9eih/p9eih_configuring_bmc_ip.htm). 10. Enter the network settings that you recorded earlier.
Starting and stopping the 8335-GTC, 8335-GTG, 8335-GTH, 8335- GTW, or 8335-GTX system Learn how to start and stop the IBM Power System AC922 (8335-GTC, 8335-GTG, and 8335-GTH) or IBM Power System AC922 (8335-GTW and 8335-GTX) system to perform a service action or system upgrade operation.
What to do next If you press the power button and the system does not start, contact your next level of support or your service provider. Stopping the 8335-GTC, 8335-GTG, 8335-GTH, 8335-GTW, or 8335-GTX system You can use the power button or a command to stop the system. Procedure •...
Removing and replacing covers on an 8335-GTC, 8335-GTG, 8335- GTH, 8335-GTW, or 8335-GTX system Learn how to remove and replace the covers for an IBM Power System AC922 (8335-GTC, 8335-GTG, and 8335-GTH) or IBM Power System AC922 (8335-GTW and 8335-GTX) system so that you can access the hardware parts or service the system.
Figure 29. Removing the cover 3. While you press down on latch (B) and touch point (C), slide the cover (D) towards the rear of the system unit. When the front of the service access cover clears the upper frame ledge, lift the cover up and off the system unit.
3. If applicable, remove the screws that are on both sides of the cover to disengage the cover from the system unit. 4. Pull the cover away from the system. 42 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Service and operating positions for the 8335-GTC, 8335-GTG, 8335-GTH, 8335-GTW, or 8335-GTX system Learn how to place on an IBM Power System AC922 (8335-GTC, 8335-GTG, and 8335-GTH) or IBM Power System AC922 (8335-GTW and 8335-GTX) system into the service or operating position.
Page 58
2. For a water-cooled system, label and disconnect the water hoses at the manifold. Pull the coupling toward you to disconnect the water hoses as shown in Figure 32 on page 45. 44 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Figure 32. Disconnecting the water hoses 3. Remove the screws on either side of the system that secure the system to the rack. 4. While one person is supporting the weight of the front of the system, have the second person move to the rear of the system and push the system partially out of the rack.
Page 60
Figure 33. Placing the system into the operating position 3. Replace the screws on either side of the system that secure the system to the rack. 46 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Page 61
Fixed rails Use this procedure when your system is installed using fixed rails. Before you begin CAUTION: This system requires two people to replace the system into the rack. Do not begin this procedure unless physical assistance is available to replace the system into the rack. Note: When you place the system into the operating position, you must ensure that all stability plates are firmly installed to prevent the rack from toppling.
Removing and replacing power cords in the 8335-GTC, 8335-GTG, 8335-GTH, 8335-GTW, or 8335-GTX system Find information about removing and replacing power cords in an IBM Power System AC922 (8335-GTC, 8335-GTG, and 8335-GTH) or IBM Power System AC922 (8335-GTW and 8335-GTX) system.
Page 63
Unfasten the hook-and-loop fastener that ties the power cord to the power supply handle. Note how the power is looped; you need to make that same loop when you reattach the power cords. Figure 35 on page 49 and Figure 36 on page 50 shows how to loop the cables. Figure 35.
Page 64
Note: This system might be equipped with two or more power supplies. If the removing and replacing procedures require the power to be off, then ensure that all the power sources to the system are disconnected. 50 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Figure 37. Removing the power cords from the system Connecting power cords to an 8335-GTC, 8335-GTG, 8335-GTH, 8335-GTW, or 8335-GTX system To connect a power cord, complete the steps in this procedure. Procedure 1. Open the rear rack door on the system unit that you are servicing. 2.
Page 66
Figure 39 on page 52 and Figure 40 on page 53 shows how to loop the cables. Figure 39. Routing the power cord loop in the cable management arm 52 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Figure 40. Power cord loop with sidewall routing 4. Close the rack door at the rear of the system. Updating the system firmware level of a BMC card to OP940.20, or later, in an 8335-GTH or 8335-GTX system To update the system firmware level of a BMC card to OP940.20, or later, complete the steps in this procedure.
Page 68
5 seconds before you continue with the service process. 4. Remove the air baffles. 5. Install the system processor jumpers on the system backplane as shown in Figure 41 on page 55. 54 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Page 69
Figure 41. System processor jumper positions 6. Install the air baffles. 7. Prepare the system for operation. For instructions, see “Preparing the 8335-GTC, 8335-GTG, 8335- GTH, 8335-GTW, or 8335-GTX system for operation after you remove and replace internal parts” on page 36.
Page 70
14. Prepare the system for operation. For instructions, see “Preparing the 8335-GTC, 8335-GTG, 8335- GTH, 8335-GTW, or 8335-GTX system for operation after you remove and replace internal parts” on page 36. 56 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead.
This product uses standard navigation keys. Interface information The IBM Power Systems servers user interfaces do not have content that flashes 2 - 55 times per second. The IBM Power Systems servers web user interface relies on cascading style sheets to render content properly and to provide a usable experience.
Contact the vendor for accessibility information about its products. Related accessibility information In addition to standard IBM help desk and support websites, IBM has a TTY telephone service for use by deaf or hard of hearing customers to access sales and support services:...
Electronic emission notices Class A Notices The following Class A statements apply to the IBM servers that contain the POWER9 processor and its features unless designated as electromagnetic compatibility (EMC) Class B in the feature information. When attaching a monitor to the equipment, you must use the designated monitor cable and any interference suppression devices supplied with the monitor.
Page 75
Tel: 914-499-1900 Der verantwortliche Ansprechpartner des Herstellers in der EU ist: IBM Deutschland GmbH Technical Relations Europe, Abteilung M456 IBM-Allee 1, 71139 Ehningen, Germany Tel: +49 (0) 800 225 5426 email: HalloIBM@de.ibm.com Generelle Informationen: Das Gerät erfüllt die Schutzanforderungen nach EN 55024 und EN 55022 / EN 55032 Klasse A.
Page 76
Proper cables and connectors are available from IBM-authorized dealers. IBM is not responsible for any radio or television interference caused by using other than recommended cables and connectors 62 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Um dieses sicherzustellen, sind die Geräte wie in den Handbüchern beschrieben zu installieren und zu betreiben. Des Weiteren dürfen auch nur von der IBM empfohlene Kabel angeschlossen werden. IBM übernimmt keine Verantwortung für die Einhaltung der Schutzanforderungen, wenn das Produkt ohne Zustimmung von IBM verändert bzw.
Page 78
This statement applies to products less than or equal to 20 A per phase. This statement applies to products greater than 20 A, single phase. This statement applies to products greater than 20 A per phase, three-phase. 64 Power Systems: Installing and Servicing the OpenCAPI adapter support for the 8335-GTH system...
Contact for FCC compliance information only: fccinfo@us.ibm.com Terms and conditions Permissions for the use of these publications are granted subject to the following terms and conditions. Applicability: These terms and conditions are in addition to any terms of use for the IBM website. Notices 65...
Page 80
IBM reserves the right to withdraw the permissions granted herein whenever, in its discretion, the use of the publications is detrimental to its interest or, as determined by IBM, the above instructions are not being properly followed.