hit counter script
Dell PowerEdge XE9680 Installation And Service Manual
  1. Manuals
  2. Brands
  3. Dell Manuals
  4. Server
  5. PowerEdge XE9680
  6. Installation and service manual

Dell PowerEdge XE9680 Installation And Service Manual

Hide thumbs
Table of Contents

Advertisement

Quick Links

Download this manual
Dell PowerEdge XE9680
Installation and Service Manual
Regulatory Model: E90S
Regulatory Type: E90S001
April 2024
Rev. A05

Advertisement

Table of Contents
loading

Related Manuals for Dell PowerEdge XE9680

Summary of Contents for Dell PowerEdge XE9680

  • Page 1 Dell PowerEdge XE9680 Installation and Service Manual Regulatory Model: E90S Regulatory Type: E90S001 April 2024 Rev. A05...
  • Page 2 A WARNING indicates a potential for property damage, personal injury, or death. © 2023 - 2024 Dell Inc. or its subsidiaries. All rights reserved. Dell Technologies, Dell, and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks may be trademarks of their respective owners.

  • Page 3: Table Of Contents

    Contents Chapter 1: About this document....................8 Chapter 2: Dell PowerEdge XE9680 system configurations and features........9 System configurations - Front view for PowerEdge XE9680.................10 Left Control Panel (LCP)............................12 Right Control Panel (RCP)............................13 System configurations - Rear view for PowerEdge XE9680.................. 14 Inside the system................................
  • Page 4 Chapter 5: Pre-operating system management applications............39 System Setup..................................39 System BIOS.................................40 iDRAC Settings................................60 Device Settings................................61 Dell Lifecycle Controller..............................61 Embedded system management..........................61 Boot Manager..................................61 PXE boot....................................61 Chapter 6: Minimum to POST and system management configuration validation......62 Minimum configuration to POST ..........................62...
  • Page 5 Installing an EDSFF E3.S drive blank........................86 Removing an EDSFF E3.S drive carrier........................86 Installing an EDSFF E3.S drive carrier........................87 Removing an EDSFF E3.S drive from the drive carrier..................88 Installing an EDSFF E3.S drive into the drive carrier..................89 Drive backplane................................. 89 Drive backplane................................89 Removing the drive backplane ..........................90 Installing the drive backplane............................
  • Page 6 Installing the BOSS cage............................139 System memory................................140 System memory guidelines............................140 General memory module installation guidelines....................142 Removing a memory module........................... 142 Installing a memory module............................. 143 Processor and heat sink module..........................145 Removing the processor and heat sink module....................145 Removing the processor............................
  • Page 7 Chapter 10: Getting help......................218 Recycling or End-of-Life service information......................218 Contacting Dell Technologies............................218 Accessing system information by using QRL......................218 Quick Resource Locator for PowerEdge XE9680 system................219 Receiving automated support with Secure Connect Gateway (SCG)............... 219 Chapter 11: Documentation resources..................220 Contents...

  • Page 8: Chapter 1: About This Document

    About this document This document provides an overview about the system, information about installing and replacing components, diagnostic tools, and guidelines to be followed while installing certain components. About this document...

  • Page 9: Chapter 2: Dell Poweredge Xe9680 System Configurations And Features

    ● Up to 8 x 2.5-inch SAS/SATA/NVMe SSD drives or 16 x E3.S NVMe direct drives NOTE: For more information about how to hot swap NVMe PCIe SSD U.2 device, see the Dell Express Flash NVMe PCIe SSD User's Guide at Dell Support page >...

  • Page 10: System Configurations - Front View For Poweredge Xe9680

    Service Tag, NIC, MAC address, and so on. If you have opted for the secure default access to iDRAC, the Information tag will also contain the iDRAC secure default password. Dell PowerEdge XE9680 system configurations and features...
  • Page 11 If you have opted for the secure default access to iDRAC, the Information tag will also contain the iDRAC secure default password. NOTE: For more information about ports, panels, and slots, see the Technical specifications section. Dell PowerEdge XE9680 system configurations and features...

  • Page 12: Left Control Panel (Lcp)

    Status LED indicators section. NOTE: For more information about the indicator codes, see the System diagnostics and indicator codes section. The following table describes the system health and system ID indicators on the LCP. Dell PowerEdge XE9680 system configurations and features...

  • Page 13: Right Control Panel (Rcp)

    This port enables you to connect USB devices to the system. Power button Indicates if the system is powered on or off. Press the power button to manually power on or off the system. Dell PowerEdge XE9680 system configurations and features...

  • Page 14: System Configurations - Rear View For Poweredge Xe9680

    BIOS using the step through mode. When pressed, the system ID LED in the back panel blinks until either the front or rear button is pressed again. Press the button to toggle between on or off mode. Dell PowerEdge XE9680 system configurations and features...
  • Page 15 System ID button for more than 15 seconds. Dedicated iDRAC9 Ethernet Enables you to remotely access iDRAC. For more information, see the port Integrated Dell Remote Access Controller User's Guide at PowerEdge Manuals. USB 2.0 port The USB port is 4-pin, 2.0-compliant. This port enables you to connect USB devices to the system.

  • Page 16: Inside The System

    Inside the system Figure 6. Inside the system 1. Cooling fans 2. Air shroud 3. Power supply unit 4. Power Distribution Board 5. Heat sink for processor 6. Drive cage 7. Express Service Tag Dell PowerEdge XE9680 system configurations and features...
  • Page 17 Figure 7. GPU A100 Inside view 1. NVSwitch Heatsink 2. Rear GPU Heatsink 3. Front GPU Heatsink 4. Chassis 5. Handle Figure 8. GPU H100/H800 Inside view 1. NVSwitch Heatsink 2. GPU Heatsink 3. Chassis 4. Handle Dell PowerEdge XE9680 system configurations and features...

  • Page 18: Locating The Express Service Code And Service Tag

    4. iDRAC MAC address and iDRAC secure password label 5. Service Tag, Express Service Code, QRL label The Exp Svc Code is used by Dell to route support calls to the appropriate personnel. Alternatively, the Service Tag information is located on a label on rear of the chassis.
  • Page 19 Figure 10. Service information Figure 11. Memory information Dell PowerEdge XE9680 system configurations and features...
  • Page 20 Figure 12. Electrical overview Figure 13. LED behavior Dell PowerEdge XE9680 system configurations and features...
  • Page 21 Figure 14. Icon legend Figure 15. Caution Figure 16. Configuration and layout Dell PowerEdge XE9680 system configurations and features...
  • Page 22 Figure 17. CPU Heat sink Figure 18. BOSS-N1 Figure 19. Express service tag Figure 20. A100 GPU Dell PowerEdge XE9680 system configurations and features...

  • Page 23: Rail Sizing And Rack Compatibility Matrix

    ● Rail adjustability range for various types of rack mounting flanges. ● Rail depth with and without cable management accessories. ● Types of racks that are supported for various types of rack mounting flanges. Dell PowerEdge XE9680 system configurations and features...

  • Page 24: Chapter 3: Technical Specifications

    Technical specifications The technical and environmental specifications of your system are outlined in this section. Topics: • Chassis dimensions • System weight • Processor specifications • PSU specifications • Cooling fan specifications • Supported operating systems • System battery specifications •...

  • Page 25: Chassis Dimensions

    Chassis dimensions Figure 22. Chassis dimensions Table 6. Chassis dimension for the PowerEdge XE9680 system  Drives 8 x 2.5-inch SATA/SAS/ 482.0 mm 263.2 mm 973 mm 447.0 mm 35.77 mm (1.4 855.5 mm NVMe SSD drives (18.97 inches) (10.36 inches) (38.30 inches)

  • Page 26: System Weight

    System weight Table 7. Weight for the PowerEdge XE9680 system with 8 x 2U SSDs  System configuration Maximum weight (with all drives/SSDs) XE9680 system with fully populated with H100/H800 107 kg (235.89 pounds) XE9680 system with fully populated with A100 105 kg (231.48 pounds)
  • Page 27 Redundant setting in iDRAC is not supported. NOTE: PowerEdge XE9680 system also supports 3+3 PSU redundancy. When two or more PSUs are down, this fault tolerant redundant mode triggers GPU power brake and GPU clocks are throttled to one-fourth and GPU performance will drop to around one-fifth.

  • Page 28: Cooling Fan Specifications

    For more information about the supported fan configuration or matrix, see Thermal restriction matrix. Supported operating systems The PowerEdge XE9680 supports the following operating systems: ● Canonical Ubuntu Server LTS ● Red Hat Enterprise Linux ● SUSE Linux Enterprise Server...

  • Page 29: System Battery Specifications

    Expansion card riser specifications The PowerEdge XE9680 system supports up to eight PCI express (PCIe) Gen 5 expansion cards installed on PCIe Switch Board (PSB) and two PCI express (PCIe) Gen 5 expansion cards installed on PCIe Base Board (PBB).

  • Page 30: Storage Controller Specifications

    >  Storage Adapters & Controllers > Dell PowerEdge Express Flash NVMe PCIe SSD > Select This Product > Documentation > Manuals and Documents. GPU Specifications The PowerEdge XE9680 system supports 8 NVIDIA HGX H100 80GB 700W SXM5 GPUs or 8 NVIDIA HGX A100 80GB 500W SXM4 GPUs, fully interconnected with NVIDIA NVLink technology. Ports and connectors specifications USB ports specifications Table 19.

  • Page 31: Vga Ports Specifications

    25 GbE x 4, Broadcom 10 GbE x 4, Broadcom 25 GbE x 2 VGA ports specifications The PowerEdge XE9680 system supports One DB-15 VGA port one each on the front and back of the system. iDRAC9 port specifications The PowerEdge XE9680 system supports One RJ45 iDRAC9 ethernet port on the rear of the system.

  • Page 32: Environmental Specifications

    Environmental specifications NOTE: For additional information about environmental certifications, refer to the Product Environmental Datasheet located with the Manuals & Documents on Dell Support. Table 23. Continuous operation specifications for ASHRAE A2  Temperature Specifications Allowable continuous operations Temperature ranges for altitudes <= 900 m (<= 10–35°C (50–95°F) with no direct sunlight on the equipment...

  • Page 33: Thermal Restriction Matrix

    Table 27. Particulate contamination specifications   Particulate contamination Specifications Air filtration Data center air filtration as defined by ISO Class 8 per ISO 14644-1 with a 95% upper confidence limit. NOTE: This condition applies to data center environments only. Air filtration requirements do not apply to IT equipment designed to be used outside a data center, in environments such as an office or factory floor.
  • Page 34 Table 29. Thermal Restriction Matrix (continued) CPU (W) Heat sink Fan Type 8 x 2.5-inch SAS/SATA/NVMe or 16 x E3.s type ASHRAE A2 (Max 35° C) (350W) Intel SPR 32C 6448Y CPU (225W) Intel SPR 24C 6442Y CPU (225W) Intel SPR 36C 8452Y CPU (300W) Intel SPR 32C...

  • Page 35: Chapter 4: Initial System Setup And Configuration

    Initial system setup and configuration This section describes the tasks for initial setup and configuration of the Dell system. The section also provides general steps to set up the system and the reference guides for detailed information. Topics: • Setting up the system •...

  • Page 36: Options To Log In To Idrac

    NOTE: Ensure that you change the default username and password after setting up the iDRAC IP address. For more information about logging in to the iDRAC and iDRAC licenses, see the latest Integrated Dell Remote Access Controller User's Guide at idrac manuals.

  • Page 37: Resources To Install Operating System

    User's Guide , go to PowerEdge Manuals > Product Support page of your system > Documentation. Dell recommends using Lifecycle Controller to install the OS, since all required drivers are installed on the system. NOTE: To determine the most recent iDRAC release for your platform and for latest documentation version, see KB article at KB78115.

  • Page 38: Options To Download And Install Os Drivers

    Ensure that you clear the web browser cache before downloading the drivers and firmware. Steps 1. Go to Drivers. 2. Enter the Service Tag of the system in the Enter a Dell Service Tag, Dell Product ID or Model field, and then press Enter. NOTE: If you do not have the Service Tag, click Browse all products, and navigate to your product.

  • Page 39: Chapter 5: Pre-Operating System Management Applications

    UEFI (Unified Extensible Firmware Interface). You can enable or disable various iDRAC parameters by using the iDRAC settings utility. For more information about this utility, see Integrated Dell Remote Access Controller User’s Guide at PowerEdge Manuals.

  • Page 40: System Bios

    Table 36. System Setup Main Menu  (continued) Option Description Device Settings Enables you to configure device settings for devices such as storage controllers or network cards. Service Tag Settings Enables you to configure the System Service Tag. System BIOS To view the System BIOS screen, power on the system, press F2, and click System Setup Main Menu > System BIOS. Table 37.
  • Page 41 Specify the FRM percentage by using the Fault Resilient Mode Memory Size[%] feature. When Dell NUMA Fault Resilient Mode (FRM) is enabled, a percentage of the installed memory in every NUMA node is configured to create a fault resilient zone for use by select hypervisors for host virtualization resilience.
  • Page 42 Table 39. Memory Settings details (continued) Option Description impact on system performance under certain workloads. This feature only applies to x4 DIMMs, and when Fault Resilient Mode is Disabled. Memory training When the option is set to Fast and memory configuration is not changed, the system uses previously saved memory training parameters to train the memory subsystems and system boot time is also reduced.
  • Page 43 MADT Core Enumeration Specifies the MADT Core Enumeration. This option is set to default in Round Robin. Linear option supports industry core enumeration whereas, Round Robin option supports Dell optimized core enumeration. UMA Based Clustering Status It is a read-only field and displays as Quadrant , when Sub NUMA Cluster is disabled or displays as Disabled, when Sub NUMA Cluster is either 2-way or 4-way.
  • Page 44 Enables you to configure the Dell AVX scaling technology. This option is set to 0 by default. Enter the value from 0 to 12 bins. The value that is entered decreases the Dell AVX Scaling Technology frequency when the Dell-controlled Turbo feature is enabled.
  • Page 45 Table 40. Processor Settings details (continued) Option Description Homeless Prefetch This option allows L1 Data Cache Unit (DCU) to prefetech, when the Fill Buffers (FB) is full. Auto maps to hardware default setting. This option is set to Auto by default. Uncore Frequency RAPL This setting controls whether the Running Average Power Limit (RAPL) balancer is enabled or not.
  • Page 46 Enables or disables the boot mode. The option is set to Non-RAID mode by default. BIOS NVMe Driver Sets the drive type to boot the NVMe driver. The available options are Dell Qualified Drives and All Drives. This option is set to Dell Qualified Drives by default.
  • Page 47 Table 44. Boot Settings details (continued) Option Description Boot Sequence Retry Enables or disables the Boot sequence retry feature or resets the system. When this option is set to Enabled and the system fails to boot, the system re-attempts the boot sequence after 30 seconds. When this option is set to Reset and the system fails to boot, the system reboots immediately.
  • Page 48 This field specifies the name of the NVMe-oF host NQN. Allowed input is in the following format: nqn.yyyy-mm.<Reserved Domain Name>:<Unique String>. Leave it empty to use system generated value with following format: nqn.1988-11.com.dell:<Model name>.<Model number>.<Service Tag>. NVMe-oF Host Id This field specifies a 16 bytes value of the NVMe-oF host identifier that uniquely identifies this host with the controller in the NVM subsystem.
  • Page 49 Table 47. PXE Device n Settings details  Option Description Interface Specifies NIC interface used for the PXE device. Protocol Specifies Protocol used for PXE device. This option is set to IPv4 or IPv6. This option is set to IPv4 by default. VLAN Enables VLAN for PXE device.
  • Page 50 Table 50. TLS Authentication Configuration screen details (continued) Option Description Root Certificate Configuration Import, delete, or export the root certificate. Table 51. NVMe-oF SubSystem Settings screen details  Option Description NVMe-oF SubSystem n (n = 1 to 4) Enables or disables NVMe-oF SubSystem. This option is set to Disabled by default.
  • Page 51 Table 52. NVMe-oF SubSystem n Settings (continued) Option Description SecurityKeyPath Specifies the SecurityKeyPath for this NVMe-oF connection. Integrated Devices To view the Integrated Devices screen, power on the system, press F2, and click System Setup Main Menu > System BIOS > Integrated Devices. Table 53.
  • Page 52 To view the Serial Communication screen, power on the system, press F2, and click System Setup Main Menu > System BIOS > Serial Communication. NOTE: The PowerEdge XE9680 system does not support serial port connectivity. The Serial Communication option is applicable only if the serial COM port is installed in the system. Table 54. Serial Communication details ...
  • Page 53 Table 54. Serial Communication details (continued) Option Description The options available for System without serial COM port (DB9) are On without Console Redirection, On with Console Redirection, Off. This option is set to Off by default. Serial Port Address Enables you to set the port address for serial devices. This option is set to either COM1 or COM2 for the serial device (COM1=0x3F8,COM2=0x2F8)and set to COM1 by default.
  • Page 54 Table 55. System Profile Settings details (continued) Option Description Optimized Power Mode When set to Enabled, processor is tuned for lower power consumption. Also sets C1E to Enabled, sets CPU Power Management to System DBPM mode, sets Energy Efficient Policy to Performance, sets Uncore Frequency to Dynamic, and sets Dynamic Load Line Switch to Enabled.
  • Page 55 System Security To view the System Security screen, power on the system, press F2, and click System Setup Main Menu > System BIOS > System Security. Table 56. System Security details  Option Description CPU AES-NI Improves the speed of applications by performing encryption and decryption by using the Advanced Encryption Standard Instruction Set (AES-NI).
  • Page 56 Table 58. TPM Advanced Settings  (continued) Option Description TPM2 Algorithm Allows the user to change the cryptographic algorithms used in the Trusted Platform Module (TPM). Selection The available options are dependent on the TPM firmware. To enable TPM2 Algorithm Selection, Intel(R) TXT technology must be disabled.
  • Page 57 Table 59. System Security details (continued) Option Description NOTE: BIOS update requires HECI devices to be operational and DUP updates require IPMI interface to be operational. This setting needs to be set to Enabled to avoid updating errors. SMM Security Mitigation Enables or disables the UEFI SMM security mitigation protections.
  • Page 58 Table 59. System Security details (continued) Option Description Custom. Otherwise, the value of this field is selected automatically based on the Secure Boot Policy setting. This option is set to Device Firmware and OS by default. Creating a system and setup password Prerequisites Ensure that the password jumper is enabled.
  • Page 59 Deleting or changing system and setup password Prerequisites NOTE: You cannot delete or change an existing system or setup password if the Password Status is set to Locked. Steps 1. To enter System Setup, press F2 immediately after turning on or restarting your system. 2.

  • Page 60: Idrac Settings

    NOTE: Accessing some of the features on the iDRAC settings needs the iDRAC Enterprise License upgrade. For more information about using iDRAC, see Dell Integrated Dell Remote Access Controller User's Guide at iDRAC Manuals.

  • Page 61: Device Settings

    Dell Lifecycle Controller Dell Lifecycle Controller (LC) provides advanced embedded systems management capabilities including system deployment, configuration, update, maintenance, and diagnosis. LC is delivered as part of the iDRAC out-of-band solution and Dell system embedded Unified Extensible Firmware Interface (UEFI) applications.

  • Page 62: Chapter 6: Minimum To Post And System Management Configuration Validation

    Minimum to POST and system management configuration validation This section describes the minimum to POST system requirement and system management configuration validation of the Dell system. Topics: • Minimum configuration to POST • Configuration validation Minimum configuration to POST The components mentioned below are the minimum configuration to POST: ●...

  • Page 63: Error Messages

    Table 63. Configuration validation error (continued) Error Description Possible cause and Example recommendations Missing element or cable Config Missing : SL cable is reported in HWC8010 PLANAR_SL8 and CTRL_DST_PA1 error logs. Install the missing element (cable, risers, etc). Comm Error A configuration element is not responding System management Comm Error: Backplane 2 to iDRAC using the management interface...

  • Page 64: Chapter 7: Installing And Removing System Components

    Installing and removing system components Topics: • Safety instructions • Before working inside your system • After working inside your system • Recommended tools • Optional front bezel • System cover • Front top cover • Cooling fans • Air shroud •...

  • Page 65: Before Working Inside Your System

    Damage due to servicing that is not authorized by Dell is not covered by your warranty. Read and follow the safety instructions that are shipped with your product.

  • Page 66: Recommended Tools

    Recommended tools You may need some or all of the following tools to perform the removal and installation procedures: ● Key to the bezel lock. The key is required only if your system includes a bezel. ● Phillips 1 screwdriver ●...

  • Page 67: Installing The Front Bezel

    Figure 27. Removing the front bezel with the LCD panel Next steps Replace front bezel. Installing the front bezel The procedure to install the front bezel with and without the LCD panel is the same. Prerequisites 1. Follow the safety guidelines listed in the Safety instructions.

  • Page 68: System Cover

    Figure 28. Installing the front bezel with the LCD panel System cover Removing the system cover Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Power off the system, and any attached peripherals. 3. Disconnect the system from the electrical outlet and peripherals. Steps 1.

  • Page 69: Installing The System Cover

    Figure 29. Removing the system cover Next steps Replace the system cover. Installing the system cover Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in Before working inside your system. 3. Ensure that all internal cables are connected and routed properly, and no tools or extra parts are left inside the system. Steps 1.

  • Page 70: Front Top Cover

    Figure 30. Installing the system cover Next steps 1. Follow the procedure listed in After working inside your system. Front top cover Removing the front top cover Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in Before working inside your system.

  • Page 71: Installing The Front Top Cover

    Figure 31. Removing the front top cover Next steps Replace the front top cover. Installing the front top cover Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in Before working inside your system.

  • Page 72: Cooling Fans

    Figure 32. Installing the front top cover Next steps 1. Follow the procedure listed in After working inside your system. Cooling fans Removing the cooling fan cage assembly Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system.

  • Page 73: Installing The Cooling Fan Cage Assembly

    Figure 33. Removing the cooling fan cage assembly Next steps Replace the cooling fan cage assembly. Installing the cooling fan cage assembly Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. CAUTION: Ensure that the cables inside the system are correctly installed and retained by the cable retention bracket before installing the cooling fan cage assembly.

  • Page 74: Removing A Cooling Fan

    Figure 34. Installing the cooling fan cage assembly Next steps 1. Follow the procedure listed in After working inside your system. Removing a cooling fan Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in Before working inside your system.

  • Page 75: Installing A Cooling Fan

    Figure 35. Removing a cooling fan Next steps Replace a cooling fan. Installing a cooling fan Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in Before working inside your system. Steps Align and lower the cooling fan into the cooling fan assembly until the fan clicks into place. Installing and removing system components...
  • Page 76 Figure 36. Installing a cooling fan Next steps 1. Follow the procedure listed in After working inside your system. Installing and removing system components...

  • Page 77: Air Shroud

    Air shroud Removing the air shroud Prerequisites CAUTION: Never operate your system with the air shroud removed. The system may get overheated quickly, resulting in shutdown of the system and loss of data. 1. Follow the safety guidelines listed in the Safety instructions.

  • Page 78: Side Wall Brackets

    Steps 1. Tilt the air shroud at an angle and align the air shroud tabs with the system slots. NOTE: Ensure that the air shroud tabs are below the surface of the cooling cage fan assembly. 2. Lower the air shroud into the system until it is firmly seated. Figure 38.

  • Page 79: Installing The Side Wall Bracket

    NOTE: Move the cables out of the side wall cable holder. 2. Press the center tab to release the bracket from the chassis, and lift it away from the system. Figure 39. Removing the side wall bracket Next steps Replace the side wall bracket.

  • Page 80: Drives

    Figure 40. Installing the side wall bracket Next steps Install the air shroud. Replace the cooling fan cage assembly. 3. Follow the procedure listed in the After working inside your system. Drives Removing a drive blank Prerequisites 1. Follow the safety guidelines listed in the Safety instructions.

  • Page 81: Installing A Drive Blank

    Figure 41. Removing a drive blank Next steps Replace the drive blank. Installing a drive blank Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. If installed, remove the front bezel. Steps Slide the drive blank into the drive slot until the release button clicks into place. Figure 42.

  • Page 82: Installing The Drive Carrier

    3. Using the management software, prepare the drive for removal. If the drive is online, the green activity or fault indicator flashes while the drive is turning off. When the drive indicators are off, the drive is ready for removal. For more information, see the storage controller documentation.

  • Page 83: Removing The Drive From The Drive Carrier

    CAUTION: To prevent data loss, ensure that your operating system supports hot-swap drive installation. See the documentation supplied with your operating system. CAUTION: When a replacement hot swappable drive is installed and the system is powered on, the drive automatically begins to rebuild. Ensure that the replacement drive is blank or contains data that you wish to overwrite.

  • Page 84: Installing The Drive Into The Drive Carrier

    Figure 45. Removing the drive from the drive carrier Next steps Install the drive into the drive carrier. Installing the drive into the drive carrier Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. Remove the drive blank. Steps 1.

  • Page 85: Removing An Edsff E3.S Drive Blank

    Figure 46. Installing a drive into the drive carrier Next steps Install the drive carrier. Removing an EDSFF E3.S drive blank Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. If installed, remove the front bezel. CAUTION: To maintain proper system cooling, drive blanks must be installed in all empty drive slots.

  • Page 86: Installing An Edsff E3.S Drive Blank

    Next steps Replace the EDSFF E3.S drive blank. Installing an EDSFF E3.S drive blank Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. If installed, remove the front bezel. Steps Slide the drive blank into the drive slot until the release button clicks into place. Figure 48.

  • Page 87: Installing An Edsff E3.S Drive Carrier

    NOTE: If you are not replacing the drive immediately, install an EDSFF E3.S drive blank in the empty drive slot to maintain proper system cooling. Figure 49. Removing an EDSFF E3.S drive carrier Next steps Replace the EDSFF E3.S drive or an EDSFF E3.S drive blank.

  • Page 88: Removing An Edsff E3.S Drive From The Drive Carrier

    Figure 50. Installing an EDSFF E3.S drive carrier Next steps Install the front bezel. Removing an EDSFF E3.S drive from the drive carrier Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. Remove the drive carrier. Steps 1. Using a Torx 6 screwdriver, remove the screws from the slide rails on the drive carrier. 2.

  • Page 89: Installing An Edsff E3.S Drive Into The Drive Carrier

    Next steps Install an EDSFF E3.S drive into the drive carrier. Installing an EDSFF E3.S drive into the drive carrier Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. Remove an EDSFF E3.S drive blank Remove an EDSFF E3.S drive carrier.

  • Page 90: Removing The Drive Backplane

    Table 66. Supported backplane options  System Supported hard drives options 2.5-inch (x 8) SAS/SATA/NVMe backplane PowerEdge XE9680 E3.S (x16) NVMe Gen5 backplane Figure 53. 8 x 2.5-inch SAS/SATA/NVMe drive backplane 1. BP_ DST_PB2 (PCIe/NVMe connector) 2. BP_DST_SB1 (PERC to backplane) 3.

  • Page 91: Installing The Drive Backplane

    Remove the front top cover. Remove the cooling fan cage assembly. Remove the air shroud Remove the drives. 7. Observe and disconnect the drive backplane cables from the connector on the system board and backplane. Steps 1. Press the release tab to disengage the drive backplane from the hooks on the system. 2.

  • Page 92: Removing The Edsff E3.S Backplane

    NOTE: Route the cable properly when you replace it to prevent the cable from being pinched or crimped. Steps 1. Align the slots on the drive backplane with the guides on the system. 2. Slide the drive backplane into the guides and lower the backplane until the blue release tab clicks into place. Figure 56.

  • Page 93: Installing The Edsff E3.S Backplane

    Remove the drives. 7. Observe and disconnect the drive backplane cables from the connector on the system board and backplane. Steps 1. Using a Phillips #2 screwdriver, loosen the captive screw on the EDSFF E3.S backplane module. 2. Lift and pull the drive backplane out of the system. Figure 57.

  • Page 94: Drive Cage

    3. Using a Phillips #2 screwdriver, tighten the captive screw on the EDSFF E3.S backplane module. Figure 58. Installing the EDSFF E3.S backplane module Next steps 1. Connect the drive backplane cables to the connectors on the system board and backplane. Install the drives.

  • Page 95: Sliding In The Drive Cage

    Figure 59. Sliding out the drive cage Next steps Sliding in the drive cage. Sliding in the drive cage Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system.

  • Page 96: Removing The Drive Cage

    Figure 60. Sliding in the drive cage Next steps Replace the drive backplane. 2. Connect the drive backplane cables to the connectors on the system board and backplane. Replace the drives. Replace the air shroud Replace the cooling fan cage assembly.
  • Page 97 2. Lift up the metal plates from both sides of the chassis. Figure 61. Removing the metal plates from drive cage 3. Using both hands, hold and slowly pull the drive cage toward the front of the server. Figure 62. Removing the drive cage Next steps Replace the drive cage.

  • Page 98: Installing The Drive Cage

    Installing the drive cage This is a service technician replaceable part only. Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system. Remove the front top cover. Remove the cooling fan cage assembly.

  • Page 99: Perc Module

    Figure 64. Installing the metal plates to drive cage Next steps Slide in the drive cage. Replace the drive backplane. 3. Connect the drive backplane cables to the connectors on the system board and backplane. Replace the drives. Replace the air shroud Replace the cooling fan cage assembly.

  • Page 100: Installing The Front Perc Module

    Figure 65. Removing the front perc module Next steps Replace the front perc module. Installing the front perc module Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system.

  • Page 101: Removing The Perc Module From Perc Tray

    Figure 66. Installing the front perc module Next steps Slide in the drive cage. Replace the drive backplane. 3. Connect the drive backplane cables to the connectors on the system board and backplane. Replace the drives. Replace the air shroud Replace the cooling fan cage assembly.
  • Page 102 NOTE: The numbers on the image do not depict the exact steps. The numbers are for representation of sequence. Figure 67. Removing the battery holder assembly from the PERC shroud 3. Press and remove the battery from the battery holder. Figure 68.

  • Page 103: Installing The Perc Module On Perc Tray

    Figure 69. Removing the PERC card from PERC tray NOTE: The procedure to remove the other PERC card is similar. Next steps Replace the PERC module on PERC tray. Installing the PERC module on PERC tray Prerequisites 1. Follow the safety guidelines listed in the Safety instructions.
  • Page 104 Figure 70. Installing the PERC card into PERC tray 4. Insert the battery tab into the battery holder and ensure the battery that it is firmly seated. Figure 71. Installing the battery into the battery holder 5. Align and connect the PERC power cable to the PERC card. NOTE: Route the PERC cable into the PERC tray cable holder.
  • Page 105 Figure 72. Installing the battery holder assembly into the PERC shroud NOTE: Procedure to install the other PERC card is similar. Next steps Replace the front PERC module. Slide in the drive cage. Replace the drive backplane. 4. Connect the drive backplane cables to the connectors on the system board and backplane. Replace the drives.

  • Page 106: Cable Routing

    Cable routing Figure 73. Config: 8 x 2.5-inch NVMe Overview-1 Table 67. Config: 8 x 2.5-inch NVMe Overview-1  Order From PBB_DPU_PWR1 (PCIe base board DPU power PDB_DPU_PWR1 (Power distribution board connector) DPU power connector) PBB_PSB_SIG1 (PCIe base board PSB signal PDB_PSB_SIG1 (Power distribution board PSB connector) signal connector)
  • Page 107 Figure 74. Config: 8 x 2.5-inch NVMe Overview-2 Table 68. Config: 8 x 2.5-inch NVMe Overview-2  Order From Left Power Midplane1 PDB-GFB_PWR2 (Power distribution board GPU fan board power connector) and PDB- GFB_PWR6 (Power distribution board GPU fan board power connector) and PDB-GFB_PWR4 (Power distribution board GPU fan board power connector) Right Power Midplane1...

  • Page 108: Expansion Cards And Expansion Card Risers

    Table 69. Config: 8 x 2.5-inch NVMe Overview-3  Order From PSB1_CTRL_DST_PA1 (CTRL input connector) MB_IO_RISER1 (CPU1) (Riser 1 connector on system board) PSB1_CTRL_DST_PA2 (CTRL input connector) MB_SL13_CPU1_PB7 (signal connector on system board) and MB_SL14_CPU1_PA7 (signal connector on system board) PSB2_CTRL_DST_PA1 (CTRL input connector) MB_SL7_CPU1_PB4 (signal connector on system board) and MB_SL8_CPU1_PA4 (signal connector on system board)

  • Page 109: Expansion Card Installation Guidelines

    Expansion card installation guidelines Figure 76. PCIe base board riser slot connectors 1. Slot 31 - supports NIC 2. GPU_SIG1 3. PSB D 4. PSB C 5. PSB_SIG1 6. PSB B 7. GPU_NVSWITCH 8. PSB A 9. Slot 40 - supports NIC 10.
  • Page 110 Figure 77. PCIe switch board riser slot connectors 1. x16_slot 2. x16_slot NOTE: The expansion-card slots are not hot-swappable. The following table provides guidelines for installing expansion cards to ensure proper cooling and mechanical fit. The expansion cards with the highest priority should be installed first using the slot priority indicated. All the other expansion cards should be installed in the card priority and slot priority order.

  • Page 111: Removing The Psb Top Cover

    Table 70. Configuration 2: RS1+RS2+RS3+RS4 (continued) Card type Slot priority Maximum number of cards NVIDIA (GPU A100, 8-GPU SXM4 BB) NVIDIA (GPU A100, 8-GPU SXM4 BB) NVIDIA (GPU A100, 8-GPU SXM4 BB) NVIDIA (GPU A100, 8-GPU SXM4 BB) NVIDIA (GPU A100, 8-GPU SXM4 BB) NVIDIA (GPU A100, 8-GPU SXM4 BB) NVIDIA (GPGPU H100, 8-GPU SXM5 NVIDIA (GPU H100, 8-GPU SXM5 BB)

  • Page 112: Installing The Psb Top Cover

    Steps 1. Using both hands pull to unlock the 2 plungers on the sides of the PSB top cover and slide toward rear of the system. 2. Lift the PSB top cover from the system. Figure 78. Removing the PSB top cover Next steps Replace the PSB top cover.

  • Page 113: Removing The Pcie Switch Board Module

    Figure 79. Installing the PSB top cover Next steps 1. If required, install the front PERC module. Slide in the drive cage. 3. Connect the drive backplane cables to the connectors on the system board and backplane. Replace the drives. Replace the air shroud Replace the cooling fan cage assembly.

  • Page 114: Installing The Pcie Switch Board Module

    Figure 80. Removing the PSB module Next steps Replace the PSB module. Installing the PCIe Switch Board module Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system.

  • Page 115: Removing Expansion Card From The Pcie Switch Board Module

    Figure 81. Installing the PSB module Next steps 1. Connect the cables to PSB module from system board. Replace the PSB top cover. 3. If required, install the front PERC module. Slide in the drive cage. 5. Connect the drive backplane cables to the connectors on the system board and backplane. Replace the drives.
  • Page 116 Steps 1. Rotate the PSB retention latch upward to unlock. 2. Hold the expansion card by the edges and pull the card from the riser. Figure 82. Removing expansion card from the PSB module 3. If the expansion card is not going to be replaced, install a filler bracket and close the card retention latch. Figure 83.

  • Page 117: Installing An Expansion Card Into The Pcie Switch Board Module

    Installing an expansion card into the PCIe Switch Board module The procedure to install the expansion card on PSB 1, PSB 2, PSB 3 and PSB 4 is same. Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2.

  • Page 118: Removing Expansion Card From The Nic Slots On Pcie Base Board Module

    Figure 85. Installing an expansion card into the PSB module Next steps 1. Connect the cables to PSB module from system board. Replace the PSB top cover. 3. If required, install the front PERC module. Slide in the drive cage. 5.
  • Page 119 Steps 1. Lift up and slide the NIC air shroud toward rear of the chassis to remove it from the system. NOTE: There are two NIC air shroud on either side of the system. The procedure to remove is similar. Figure 86.
  • Page 120 Figure 87. Removing expansion card from NIC slot on PCIe Base Board 3. If the expansion card is not going to be replaced, install a filler bracket. Figure 88. Installing the filler bracket Next steps Replace the the expansion card into the PBB module.

  • Page 121: Installing An Expansion Card Into The Nic Slots On Pcie Base Board Module

    Installing an expansion card into the NIC slots on PCIe Base Board module Slots 31 and 40 are present on PCIe Base Board and can be used to install NICs. Prerequisites 1. Follow the safety guidelines listed in the Safety instructions.
  • Page 122 Figure 90. Installing an expansion card into the NIC slot on PCIe Base Board 4. Insert and slide the NIC air shroud toward front of the system and press it down. NOTE: Latch auto locks into its place. NOTE: There are two NIC air shroud on either side of the system. The procedure to install is similar. Installing and removing system components...

  • Page 123: Removing The Pcie Base Board

    Figure 91. Installing the NIC air shroud Next steps Replace the PSB top cover. 2. If required, install the front PERC module. Slide in the drive cage. 4. Connect the drive backplane cables to the connectors on the system board and backplane. Replace the drives.

  • Page 124: Installing The Pcie Base Board

    Steps 1. Using Phillips 2 screwdriver, loosen the thumb screw on the PCIe base board. 2. Hold and slide PCIe base board toward rear of the chassis. 3. Lift the PCIe base board from the chassis. Figure 92. Removing the PCIe base board Next steps Replace the PCIe Base Board.

  • Page 125: Power Supply Unit

    Figure 93. Installing the PCIe base board 3. Using Phillips 2 screwdriver, tighten the thumb screw on the PCIe base board. Next steps Replace the PSB module. 2. Connect the cables to PSB module from system board. Replace the PSB top cover.

  • Page 126: Installing A Power Supply Unit

    1. Follow the safety guidelines listed in the Safety instructions. 2. Disconnect the power cable from the power outlet and from the PSU that you intend to remove. 3. Remove the cable from the strap on the PSU handle. 4. Unlatch and lift or remove the optional cable management accessory if it interferes with the PSU removal. NOTE: For information about the cable management when the PSU is removed or installed while the system is in a rack, see the system’s cable management arm documentation at...

  • Page 127: Psu Cage

    Figure 95. Installing a power supply unit Next steps 1. If you have unlatched or removed the cable management accessory, reinstall or relatch it. For information about the cable management when the PSU is removed or installed while the system is in the rack, see the system’s cable management accessory documentation at PowerEdge Manuals.

  • Page 128: Installing The Psu Cage

    Figure 96. Removing the PSU cage 2. Hold the handle with one hand and the rear label side with the other hand. 3. Lift the PSU cage away from the system. Next steps Replace the PSU cage. Installing the PSU cage Prerequisites 1.

  • Page 129: Power Interposer Board

    Figure 97. Installing the PSU cage 2. Hold the handle with one hand and the rear side of PSU cage with the other hand. 3. Align and insert the PSU cage with the help of guiding slots at both sides of the chassis. 4.

  • Page 130: Installing The Power Interposer Board

    NOTE: Ensure that you note the routing of the cable as you remove it from the system board. Route the cable properly when you replace it to prevent the cable from being pinched or crimped. Steps 1. Disconnect the cables within the busbar from the connectors on the system board. 2.

  • Page 131: Intrusion Switch

    2. Align the power interposer board with the connector on the system board. 3. Pull the plunger and slide the power interposer board toward front of the chassis until the plunger clicks into place. Figure 99. Installing the power interposer board 4.

  • Page 132: Installing The Intrusion Switch Module

    Steps 1. Disconnect the intrusion switch cable from the connector on the rear I/O board. 2. Using a Phillips 1 screwdriver, loosen the screw on the intrusion switch module. 3. Slide the intrusion switch module out of the slot on the system. Figure 100.

  • Page 133: Optional Boss-N1 Module

    Figure 101. Installing the intrusion switch module Next steps Replace the PSU cage. 2. Observe and connect the cables to the connectors on the power distribution board. Replace the air shroud Replace the cooling fan cage assembly. Replace the front top cover.
  • Page 134 Figure 102. Removing the BOSS-N1 card carrier 3. Using the Phillips 1 screwdriver remove the M3 x 0.5 x 4.5 mm screw that secures the M.2 SSD to the BOSS-N1 card carrier. 4. Slide the M.2 SSD out from the BOSS-N1 card carrier. Figure 103.
  • Page 135 Figure 104. Removing the BOSS-N1 power and signal cable from the BOSS-N1 module 7. Using the Phillips 1 screwdriver remove the M3 x 0.5 x 4.5 mm screw that secures the BOSS-N1 module. 8. Slide the BOSS-N1 module toward the front of the chassis and lift the module. Figure 105.

  • Page 136: Installing The Boss-N1 Module

    Next steps Replace the BOSS-N1 module. Installing the BOSS-N1 module Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system. Remove the front top cover. Remove the cooling fan cage assembly.
  • Page 137 Figure 107. Installing the BOSS-N1 module 6. Align the M.2 SSD at an angle with the BOSS-N1 card carrier. 7. Insert the M.2 SSD until it is firmly seated in the BOSS-N1 card carrier. 8. Using the Phillips 1 screwdriver, secure the M.2 SSD on the BOSS-N1 card carrier with the M3 x 0.5 x 4.5 mm screw. Figure 108.

  • Page 138: Removing The Boss Cage

    Figure 109. Installing the BOSS-N1card carrier Next steps 1. Follow the procedure listed in the After working inside your system. Removing the BOSS cage Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system.

  • Page 139: Installing The Boss Cage

    Figure 110. Removing the BOSS cage Next steps Replace the BOSS cage. Installing the BOSS cage Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system. 3. If installed, remove the OCP blank. Steps 1.

  • Page 140: System Memory

    System memory System memory guidelines The PowerEdge XE9680 system supports DDR5 registered DIMMs (RDIMMs). Your system memory is organized into eight channels per processor (two memory sockets per channel),16 memory sockets per processor and 32 memory sockets per system.
  • Page 141 Figure 112. Memory channels Memory channels are organized as follows: Table 71. Memory channels  Processor Channel Channel B Channel C Channel D Channel E Channel F Channel G Channel H Processor Slots A1 Slots A7 Slots A3 Slots A5 and Slots A4 and Slots A6 Slots A2 and...

  • Page 142: General Memory Module Installation Guidelines

    Table 72. Supported memory matrix  DIMM type Rank Capacity DIMM rated Operating Speed voltage and 1 DIMM per 2 DIMMs per speed channel (DPC) channel (DPC) RDIMM 32 GB, 64 GB DDR5 (1.1 V), 4800 4800 MT/s 4400 MT/s MT/s 128 GB DDR5 (1.1 V), 4800 4800 MT/s...

  • Page 143: Installing A Memory Module

    WARNING: The memory modules are hot to touch for some time after the system has been powered off. Allow the memory modules to cool before handling them. Steps 1. Locate the appropriate memory module socket. 2. To release the memory module from the socket, simultaneously press the ejectors on both ends of the memory module socket to fully open.
  • Page 144 2. If a memory module is installed in the socket, remove it. NOTE: Ensure that the socket ejector latches are fully open, before installing the memory module. 3. Align the edge connector of the memory module with the alignment key of the memory module socket, and insert the memory module in the socket.

  • Page 145: Processor And Heat Sink Module

    Processor and heat sink module This is a service technician replaceable part only. Removing the processor and heat sink module Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system.
  • Page 146 Figure 115. Removing the processor heat sink module 3. Lift the PHM from the system and set the PHM aside with the processor side facing up. Figure 116. Removing a heat sink Next steps If you are removing a faulty heat sink, replace the heat sink, if not, remove the...

  • Page 147: Removing The Processor

    Removing the processor Prerequisites WARNING: Remove the processor from processor and heat sink module (PHM) only if you are replacing the processor or heat sink. 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system.

  • Page 148: Installing The Processor

    Figure 118. Removing the retaining clip Next steps Replace the processor. Installing the processor Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in Before working inside your system. Remove the front top cover.
  • Page 149 Figure 119. Installing the retaining clip 3. Align the processor with retaining clip, by using your fingers press the retaining clip on all the four sides until it clicks into place. NOTE: Ensure that the processor is securely latched to the retaining clip. Figure 120.
  • Page 150 CAUTION: Applying too much thermal grease can result in excess grease coming in contact with and contaminating the processor socket. NOTE: The thermal grease syringe is intended for single use only. Dispose the syringe after you use it. Figure 121. Applying thermal grease 6.

  • Page 151: Installing The Processor And Heat Sink Module

    ● Ensure that the pin 1 indicator on the heat sink is aligned with the pin 1 indicator on the retaining clip before placing the heat sink onto the retaining clip. Figure 123. Installing the heat sink onto the processor Next steps Replace the processor heat sink module.
  • Page 152 2. Align the pin 1 indicator of the heat sink to the system board, and then place the processor heat sink module (PHM) on the processor socket. CAUTION: To avoid damaging the fins on the heat sink, do not press down on the heat sink fins. NOTE: Ensure that the PHM is held parallel to the system board to prevent damaging the components.

  • Page 153: Gpu Fans And Cage

    Figure 125. Set the anti-tilt wires to the locked position and tightening the nuts Next steps Install the air shroud. 2. Follow the procedure listed in the After working inside your system. GPU fans and cage Removing a GPU fan module There are ten GPU fan module on the rear of the system.

  • Page 154: Installing A Gpu Fan Module

    Figure 126. Removing a GPU fan module Next steps Replace GPU fan module. Installing a GPU fan module There are ten GPU fan module on the rear of the system. The procedure to install is similar. Prerequisites 1. Follow the safety guidelines listed in the Safety instructions.

  • Page 155: Removing The Gpu Fan Cage

    Figure 127. Installing a GPU fan module Next steps 1. Follow the procedure listed in After working inside your system. Removing the GPU fan cage Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in Before working inside your system.

  • Page 156: Installing The Gpu Fan Cage

    Figure 128. Removing the GPU fan cage Next steps Replace GPU fan cage. Installing the GPU fan cage Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in Before working inside your system. Remove rear GPU fan(s).

  • Page 157: Gpu Tray

    Figure 129. Installing the fan cage module 3. Push the fan cage module into the chassis until the handles touch the middle plane. NOTE: Ensure that the rear fan cage is level and not slanted. 4. Rotate the left and right handles inward by hand. 5.
  • Page 158 NOTE: The screw torque is 10 in-lbs and requires additional effort to release the screws. 2. Using both hands, rotate the handle and slowly pull the GPU tray toward the rear of the system. 3. Press and release the safety latch on both sides of the GPU tray. 4.

  • Page 159: Installing The Gpu Tray

    Figure 131. Removing the A100 GPU tray Next steps Replace the GPU tray. Installing the GPU tray The procedure to install the H100 GPU and A100 GPU is same. Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2.
  • Page 160 Figure 132. Installing the H100/H800 GPU tray Figure 133. Installing the A100 GPU tray 4. Using a Phillips 2 screwdriver, tighten the ten capture screws on both side of the chassis. NOTE: The screw torque is 10 in-lbs and requires additional effort to tighten the screws. Installing and removing system components...

  • Page 161: Gpu Modules

    Depending on your system configuration, the GPUs that are supported are listed here: Table 74. Supported GPU options  System Supported GPU options NVIDIA HGX A100 8-GPU, SXM4, PCIe Gen4 PowerEdge XE9680 NVIDIA HGX H100 8-GPU, SXM5, PCIe Gen5 Figure 134. NVIDIA HGX A100 8-GPU 1. GPU_5 2. GPU_8 3.

  • Page 162: Removing The Gpu Top Cover

    Figure 135. NVIDIA HGX H100 8-GPU 1. GPU_5 2. GPU_8 3. GPU_1 4. GPU_4 5. GPU_7 6. GPU_6 7. GPU_3 8. GPU_2 Removing the GPU top cover The procedure to remove the H100/H800 GPU and A100 GPU top cover is same. Prerequisites 1.
  • Page 163 Figure 136. Removing the H100/H800 GPU top cover Figure 137. Removing the A100 GPU top cover Next steps Replace the GPU top cover. Installing and removing system components...

  • Page 164: Installing The Gpu Top Cover

    Installing the GPU top cover The procedure to install the H100/H800 GPU and A100 GPU top cover is same. Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system.

  • Page 165: Removing The A100 Gpu

    Figure 139. Installing the A100 GPU top cover Next steps Replace the GPU tray. Replace the GPU fan cage. Replace the GPU fans. 4. Follow the procedure listed in After working inside your system. Removing the A100 GPU Prerequisites 1. Follow the safety guidelines listed in the Safety instructions.
  • Page 166 Figure 140. Removing the side GPU air baffle Figure 141. Removing the center GPU air baffle 2. Identify the failed GPU and using Phillips 1 screwdriver, loosen the heatsink screws in the order that is mentioned below: a. Loosen the heatsink screws 3 turns each in the following order. Disassembly order:1, 2, 3, 4. b.
  • Page 167 Figure 142. Removing the A100 GPU heatsink 4. Using Phillips 1 screwdriver, release the screws securing the GPU in the order that is mentioned below: a. Loosen the screws securing the GPU 3 turns each in the following order. Disassembly order:1, 2, 3, 4. b.

  • Page 168: Removing The A100 Baseboard

    Next steps Replace the A100 GPU. Remove the A100 baseboard. Removing the A100 baseboard Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system. Remove the GPU fan cage.
  • Page 169 Figure 145. Removing the center GPU air baffle 2. Using Phillips 1 screwdriver, loosen the screws securing front heatsink in the order that is mentioned below: a. Loosen the heatsink screws 3 turns each in the following order. Disassembly order:1, 2, 3, 4. b.
  • Page 170 Figure 146. Removing the A100 GPU heatsink 4. Using Phillips 1 screwdriver, loosen the screws securing rear heatsink in the order that is mentioned below: a. Loosen the heatsink screws 3 turns each in the following order. Disassembly order:1, 2, 3, 4. b.
  • Page 171 Figure 147. Removing the A100 NVlink heatsink 7. Lift and remove the NVlink heatsink from the GPU baseboard. NOTE: There are six NVlink heatsinks on the GPU baseboard. Repeat steps 6 and 7 to remove remaining NVlink heatsinks. 8. Using Torx 15 screwdriver, release the 16 captive screws that secure the GPU baseboard onto the GPU tray. NOTE: Do not remove any GPUs.

  • Page 172: Installing The A100 Gpu

    Figure 148. Removing the A100 baseboard Next steps Replace the A100 baseboard. Installing the A100 GPU Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system. Remove the GPU fan cage.
  • Page 173 Figure 149. Installing the A100 GPU 4. Align and insert the heatsink on the GPU socket. 5. Using Phillips 1 screwdriver, tighten the heatsink screws in the order that is mentioned below: a. Tighten the screws securing the heatsink 3 turns each in the following order. Assembly order:1, 2, 3, 4. b.
  • Page 174 6. Align and insert the GPU air baffles with the help of guide pins on them. NOTE: There are a total of three GPU air baffles. Figure 151. Installing the side GPU air baffle Figure 152. Installing the center GPU air baffle Next steps Replace the GPU top cover.

  • Page 175: Installing The A100 Baseboard

    Replace the GPU fan cage. 4. Follow the procedure listed in After working inside your system. Installing the A100 baseboard Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system.
  • Page 176 Figure 154. Installing the A100 baseboard captive screws 3. Align and insert each NVlink heatsink on the GPU baseboard. 4. Using Torx 15 screwdriver, tighten the screws securing the NVlink heatsink in the order that is mentioned below: a. Tighten the first screw completely. b.
  • Page 177 Figure 155. Installing the A100 NVlink Heatsink NOTE: There are six NVlink heatsinks installed on the GPU baseboard. Repeat steps 3 and 4 to install remaining NVlink heatsinks. 5. Align and insert each rear heatsink on the GPU socket. 6. Using Phillips 1 screwdriver, tighten the screws securing rear heatsink in the order that is mentioned below: a.
  • Page 178 Figure 156. Installing the A100 GPU heatsink 9. Align and insert the GPU air baffles with the help of guide pins on them. NOTE: There are a total of three GPU air baffles. Figure 157. Installing the side GPU air baffle Installing and removing system components...

  • Page 179: Removing A H100/H800 Gpu And Heatsink Module

    Figure 158. Installing the center GPU air baffle Next steps Replace the GPU top cover. Replace the GPU tray. Replace the GPU fan cage. 4. Follow the procedure listed in After working inside your system. Removing a H100/H800 GPU and heatsink module Prerequisites 1.
  • Page 180 Figure 159. Removing the plastic cover from H100/H800 GPU Heatsink 2. Using Torx 15 screwdriver, release the four outer corner screws securing the GPU and heatsink module. NOTE: H100/H800 GPU and heatsink module is one part and is removed together. NOTE: A flashlight will be helpful in locating and identifying the screws clearly.

  • Page 181: Removing The H100/H800 Baseboard

    Removing the H100/H800 baseboard Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system. Remove the GPU fan cage. Remove the GPU tray. Remove the GPU top cover.
  • Page 182 Figure 162. Removing the H100/H800 GPU and heatsink module NOTE: Do not remove any NVLink heatsinks. The replacement H100/H800 baseboard will have the 4 new NVLink heatsinks already attached. 4. Using Torx 15 screwdriver, loosen the two captive screws on the HGX Management Controller card and lift them from the failed baseboard.

  • Page 183: Installing A H100/H800 Gpu And Heatsink Module

    Figure 164. Removing the H100/H800 baseboard Next steps Replace the H100/H800 baseboard. Installing a H100/H800 GPU and heatsink module Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system.
  • Page 184 Figure 165. Installing the H100/H800 GPU and heatsink module NOTE: Dotted lines represent guiding pins on GPU and heatsink module used for correct alignment and orientation of GPU and Heatsink module. 4. Align and insert the NVIDIA plastic cover on the GPU heatsink. Figure 166.

  • Page 185: Installing The H100/H800 Baseboard

    Installing the H100/H800 baseboard Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system. Remove the GPU fan cage. Remove the GPU tray. Remove the GPU top cover.
  • Page 186 Figure 168. Installing the H100/H800 baseboard captive screws 3. When installing a new GPU and heatsink module, carefully remove the bottom shipping plastic covers that protect the pinfield, and visually inspect the pinfield to ensure that no pins are bent or damaged before installing the module. NOTE: If any pin fields on the module or the GPU baseboard appear damaged, DO NOT install the module.
  • Page 187 Figure 169. Installing the H100/H800 GPU and heatsink module NOTE: Dotted lines represent guiding pins on GPU and heatsink module used for correct alignment and orientation of GPU and Heatsink module. 6. Align and insert the NVIDIA plastic covers on all eight GPU heatsink. Figure 170.

  • Page 188: System Battery

    Figure 171. Installing the HGX Management Controller card Next steps Replace the GPU top cover. Replace the GPU tray. Replace the GPU fan cage. 4. Follow the procedure listed in After working inside your system. System battery This is a service technician replaceable part only. Replacing the system battery Prerequisites WARNING:...
  • Page 189 NOTE: If the battery does not pop out, then lift it out of the socket. Figure 172. Removing the system battery 2. To install a new system battery, hold the battery with the positive side facing up and slide it under the socket battery latch. 3.

  • Page 190: Trusted Platform Module

    Trusted Platform Module This is a service technician replaceable part only. Upgrading the Trusted Platform Module Removing the TPM Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in Before working inside your system.

  • Page 191: Initializing Tpm For Users

    Figure 174. Installing the TPM Initializing TPM for users Steps 1. Initialize the TPM. For more information, see Initializing the TPM 2.0 for users. 2. The TPM Status changes to Enabled, Activated. Initializing the TPM 2.0 for users Steps 1. While booting your system, press F2 to enter System Setup. 2.

  • Page 192: Installing The System Board

    Power supply units (PSU) PSU cage Memory modules Processor and heat sink module BOSS-N1 module BOSS cage OCP card (if installed) Disconnect all the cables from the system board and make note of all the cable connections. CAUTION: Take care not to damage the system identification button while removing the system board from the system.
  • Page 193 CAUTION: Do not lift the system board by holding a memory module, processor, or other components. CAUTION: Take care not to damage the system identification button while placing the system board into the chassis. 2. Hold the blue plastic handle and sheet metal handle on the system board and place it onto the chassis. 3.

  • Page 194: Restoring The System Using Easy Restore

    Upgrading the Trusted Platform Module section. 3. If you are not using Easy Restore, import your new or existing iDRAC Enterprise license. For more information, see the Integrated Dell Remote Access Controller User's Guide available at iDRAC Manuals. 4. Follow the procedure listed in After working inside your system.

  • Page 195: Optional Ocp Card

    Optional OCP card Removing the OCP card Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system. Remove the system cover. Remove the air shroud. Remove the cooling fan cage assembly.
  • Page 196 CAUTION: Do not install GPUs, network cards, or other PCIe devices on your system that are not validated and tested by Dell. Damage caused by unauthorized and invalidated hardware installation will null and void the system warranty. Steps 1. If installed, remove the filler bracket.

  • Page 197: Lom Card, Mic Card, And Rear I/O Board

    LOM card, MIC card, and rear I/O board Removing the LOM card and rear I/O board Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system. Remove the cooling fan cage assembly.

  • Page 198: Installing The Lom Card And Rear I/O Board

    Figure 180. Removing the rear I/O board Next steps Replace the LOM card and rear I/O board. Installing the LOM card and rear I/O board Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system.
  • Page 199 Figure 181. Installing the LOM card Figure 182. Installing the rear I/O board Next steps Replace the BOSS cage. Replace the PSU cage. 3. Observe and connect the cables to the connectors on the power distribution board. 4. Follow the procedure listed in After working inside your system.

  • Page 200: Control Panel

    Control panel This is a service technician replaceable part only. Removing the right control panel Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system. Remove the front top cover.

  • Page 201: Installing The Right Control Panel

    Next steps Replace the right control panel. Installing the right control panel Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system. Remove the front top cover. Remove the cooling fan cage assembly.

  • Page 202: Removing The Left Control Panel

    Next steps Replace the psb top cover. Replace the drive cage. Slide in the drive cage. 4. Connect the drive backplane cables to the connectors on the system board and backplane. Replace the drives. Replace the air shroud Replace the cooling fan cage assembly.

  • Page 203: Installing The Left Control Panel

    Figure 185. Removing the left control panel Next steps Replace the left control panel. Installing the left control panel Prerequisites 1. Follow the safety guidelines listed in the Safety instructions. 2. Follow the procedure listed in the Before working inside your system.
  • Page 204 Figure 186. Installing the left control panel Next steps Replace the psb top cover. Replace the drive cage. Slide in the drive cage. 4. Connect the drive backplane cables to the connectors on the system board and backplane. Replace the drives.

  • Page 205: Chapter 8: Jumpers And Connectors

    Jumpers and connectors This topic provides some basic and specific information about jumpers and switches. It also describes the connectors on the various boards in the system. Jumpers on the system board help to disable the system and reset the passwords. To install components and cables correctly, you must know the connectors on the system board.
  • Page 206 Table 75. System board jumpers and connectors  Item Connector Description LFT_CP Left control panel connector PWR2_B For Riser 4 GPU power and signal cable PWR2_A For left BBU power cable IO_RISER4 (CPU2) Riser 4 PUCK_PSU2 PSU2 PUCK sideband signal SL9_CPU2_PA5 PCIe connector 9 SL10_CPU2_PB5 PCIe connector 10...

  • Page 207: System Board Jumper Settings

    Table 75. System board jumpers and connectors (continued) Item Connector Description SL4_CPU1_PB2 PCIe connector 4 CPU 1 Processor 1 FAN_2U4 Fan 4 connector SL3_CPU1_PA2 PCIe connector 3 A8, A16, A2, A10, A6, A14, A4, A12 DIMMs for CPU 1 channels H, G, F, E SIG_PWR_1 Power connector 1 - use for BP only SL6_CPU2_PA3...

  • Page 208: Disabling A Forgotten Password

    Damage due to servicing that is not authorized by Dell is not covered by your warranty. Read and follow the safety instructions that are shipped with your product.

  • Page 209: Chapter 9: System Diagnostics And Indicator Codes

    System diagnostics and indicator codes The diagnostic indicators on the system front panel display system status during system startup. Topics: • Status LED indicators • System health and system ID indicator codes • iDRAC Direct LED indicator codes • LCD panel •...

  • Page 210: System Health And System Id Indicator Codes

    Table 77. Status LED indicators and descriptions (continued) Icon Description Condition Corrective action the PSU, check the LED on the PSU. Reseat the electrical error (for example, PSU. voltage out of range, or a failed If the problem persists, see the power supply unit...

  • Page 211: Idrac Direct Led Indicator Codes

    Table 78. System health and system ID indicator codes  System health and system Condition ID indicator code Solid blue Indicates that the system is powered on, is healthy, and system ID mode is not active. Press the system health and system ID button to switch to system ID mode. Blinking blue Indicates that the system ID mode is active.

  • Page 212: Viewing Home Screen

    Figure 190. LCD panel features Table 80. LCD panel features  Item Button or Description display Left Moves the cursor back in one-step increments. Select Selects the menu item highlighted by the cursor. Right Moves the cursor forward in one-step increments. During message scrolling: ●...

  • Page 213: View Menu

    Table 81. Setup menu (continued) Option Description Set home Select the default information to be displayed on the Home screen. See View Home menu section for the options and option items that can be set as the default on the Home screen. View menu NOTE: When you select an option in the View menu, you must confirm the option before proceeding to the next action.

  • Page 214: Power Supply Unit Indicator Codes

    Table 83. NIC indicator codes (continued) NIC indicator codes Condition Link indicator is blinking green, and activity is off. Indicates that the NIC identity is enabled through the NIC configuration utility. Power supply unit indicator codes AC and DC power supply units (PSUs) have an illuminated translucent handle that serves as an indicator. The indicator shows if power is present or if a power fault has occurred.
  • Page 215 Table 84. AC PSU status indicator codes (continued) Power indicator codes Condition condition and an unexpected system shutdown. To change from a high output configuration to a low output configuration or vice versa, you must power off the system. CAUTION: AC PSUs support both 240 V and 120 V input voltages with the exception of Titanium PSUs, which support only 240 V.

  • Page 216: Drive Indicator Codes

    Using system diagnostics If you experience an issue with the system, run the system diagnostics before contacting Dell for technical assistance. The purpose of running system diagnostics is to test the system hardware without using additional equipment or risking data loss.
  • Page 217 3. Alternatively, when the system is booting, press F10, select Hardware Diagnostics > Run Hardware Diagnostics. The ePSA Pre-boot System Assessment window is displayed, listing all devices detected in the system. The diagnostics starts executing the tests on all the detected devices. Running the Embedded System Diagnostics from the Dell Lifecycle Controller Steps 1.

  • Page 218: Chapter 10: Getting Help

    Dell contact information on your purchase invoice, packing slip, bill or Dell product catalog. The availability of services varies depending on the country and product, and some services may not be available in your area. To contact Dell for sales, technical...

  • Page 219: Quick Resource Locator For Poweredge Xe9680 System

    Dell. This information is used by Dell Technical Support to troubleshoot the issue. ● Proactive contact — A Dell Technical Support agent contacts you about the support case and helps you resolve the issue.

  • Page 220: Chapter 11: Documentation Resources

    This section provides information about the documentation resources for your system. To view the document that is listed in the documentation resources table: ● From the Dell support site: 1. Click the documentation link that is provided in the Location column in the table.
  • Page 221 Methods to download firmware and drivers section in this document. Managing your system For information about systems management PowerEdge Manuals software offered by Dell, see the Dell OpenManage Systems Management Overview Guide. For information about setting up, using, OpenManage Manuals and troubleshooting OpenManage, see the Dell OpenManage Server Administrator User’s...

This manual is also suitable for:

E90sE90s001

Table of Contents