86A704ET02

download 86A704ET02

of 308

Transcript of 86A704ET02

  • 7/31/2019 86A704ET02

    1/308

  • 7/31/2019 86A704ET02

    2/308

  • 7/31/2019 86A704ET02

    3/308

    NOVASCALE

    NovaScale 3025/3045Maintenance Guide

    HardwareFebruary 2007

    BULL CEDOC

    357 AVENUE PATTON

    B.P.20845

    49008 ANGERS CEDEX 01

    FRANCE

    REFERENCE86 A7 04ET 02

  • 7/31/2019 86A704ET02

    4/308

    The following copyright notice protects this book under Copyright laws which prohibit such actions as, but not limitedto, copying, distributing, modifying, and making derivative works.

    Copyright Bull SAS 2006-2007

    Copyright HITACHI, Ltd. 2006-2007

    Printed in France

    Suggestions and criticisms concerning the form, content, and presentation of thisbook are invited. A form is provided at the end of this book for this purpose.

    To order additional copies of this book or other Bull Technical Publications, youare invited to use the Ordering Form also provided at the end of this book.

    Trademarks and Acknowledgements

    We acknowledge the right of proprietors of trademarks mentioned in this book.

    Intel and Itanium are registered trademarks of Intel Corporation.

    Windows and Microsoft software are registered trademarks of Microsoft Corporation.

    UNIX is a registered trademark in the United States of America and other countries licensed exclusively through theOpen Group.

    Linux is a registered trademark of Linus Torvalds.

    The information in this document is subject to change without notice. Bull will not be liable for errorscontained herein, or for incidental or consequential damages in connection with the use of this material.

  • 7/31/2019 86A704ET02

    5/308

    Intended Readers .......................................................................................................................... xvHighlighting................................................................................................................................. xviRelated Publications...................................................................................................................... xviRegulatory Specifications and Disclaimers...................................................................................... xvii

    Declaration of the Manufacturer or Importer............................................................................ xviiSafety Compliance Statement................................................................................................ xviiEuropean Community (EC) Council Directives.......................................................................... xviiInternational Electrotechnical Commission (IEC) Statement ....................................................... xviiiFederal Communications Commission (FCC) Statement............................................................ xviiiFCC Declaration of Conformity............................................................................................... xixCanadian Compliance Statement (Industry Canada) ................................................................. xix

    Laser Compliance Notice....................................................................................................... xix

    Definition of Safety Notices ............................................................................................................ xxElectrical Safety ............................................................................................................................ xxLaser Safety Information................................................................................................................ xxiData Integrity and Verification ....................................................................................................... xxiEnvironmental Regulation .............................................................................................................. xxi

    1.1 Server Overview.................................................................................................................. 1-11.2 Server Features.................................................................................................................... 1-21.3 Getting to Know NovaScale 3025/3045 Server..................................................................... 1-3

    1.3.1 Server Drawer Front Components ............................................................................ 1-51.3.2 Server Drawer Rear Components ........................................................................... 1-101.3.3 Server Drawer Internal Features (Top View)............................................................. 1-131.3.4 Power Supply Subsystem ...................................................................................... 1-131.3.5 Cooling Subsystem............................................................................................... 1-151.3.6 PCI Card Slots ..................................................................................................... 1-16

    1.4

    Board Set Description......................................................................................................... 1-17

    1.4.1 Block Diagram..................................................................................................... 1-171.4.2 Main Board......................................................................................................... 1-191.4.3 Memory Box Card ............................................................................................... 1-241.4.4 HDD Backplane................................................................................................... 1-251.4.5 Control Panel Board............................................................................................. 1-27

  • 7/31/2019 86A704ET02

    6/308

    iv

    2.1 General Recommendations.................................................................................................... 2-1

    2.1.1 Tools Required....................................................................................................... 2-12.2

    Precautions on Handling of Flat Cables .................................................................................. 2-2

    2.2.1 How to Handle Flat Cables ..................................................................................... 2-22.2.2 Improper Ways of Handling Flat Cables................................................................... 2-3

    2.3 Installing/Removing Flow Chart ............................................................................................. 2-42.4 Processor and Memory Population ......................................................................................... 2-6

    2.4.1 Processor Population Rules ...................................................................................... 2-62.4.2 Memory Population Rules ........................................................................................ 2-92.4.3 Recommended Processor and Memory Configurations.............................................. 2-11

    2.5 Removing / Installing Handles ............................................................................................. 2-162.5.1 Removing Handle................................................................................................. 2-162.5.2 Installing Handle .................................................................................................. 2-17

    2.6 Removing / Installing the Front Bezel.................................................................................... 2-182.6.1 Removing the Front Bezel ...................................................................................... 2-182.6.2 Installing the Front Bezel ....................................................................................... 2-18

    2.7 Removing / Installing the Top Cover..................................................................................... 2-192.7.1 Removing the Top Cover ....................................................................................... 2-192.7.2 Installing the Top Cover ........................................................................................ 2-19

    2.8 Removing / Installing the DVD/Control Panel Unit Assembly................................................... 2-202.8.1 Removing the DVD/Control Panel Unit Assembly ..................................................... 2-202.8.2 Installing the DVD/Control Panel Unit Assembly....................................................... 2-21

    2.9 Removing / Installing / Hot-Swapping a Hard Disk Drive (HDD).............................................. 2-222.9.1 Rules for Populating Server HDD Bays .................................................................... 2-222.9.2 Removing a HDD ................................................................................................. 2-232.9.3 Installing a HDD................................................................................................... 2-262.9.4 Hot-swapping a HDD............................................................................................ 2-29

    2.10Removing / Installing a HDD Backplane Cover...................................................................... 2-302.10.1 Removing a HDD Backplane Cover ....................................................................... 2-302.10.2 Installing a HDD Backplane Cover ......................................................................... 2-31

    2.11Removing / Installing a Memory Box.................................................................................... 2-322.11.1

    Removing a Memory Box ...................................................................................... 2-32

    2.11.2 Installing a Memory Box ....................................................................................... 2-34

    2.12Removing / Installing DIMMs .............................................................................................. 2-362.12.1 Removing of DIMM .............................................................................................. 2-362.12.2 Installing Pattern of DIMM ..................................................................................... 2-382.12.3 Installing of DIMM................................................................................................ 2-38

    2.13Removing / Installing / Hot-Swapping a PCI Card................................................................. 2-402.13.1 Removing a PCI Card ........................................................................................... 2-402.13.2 Installing a PCI Card ............................................................................................ 2-432.13.3 Hot-Swapping a PCI Card..................................................................................... 2-46

  • 7/31/2019 86A704ET02

    7/308

    2.14Removing / Installing a PCI Divider Assembly ....................................................................... 2-472.14.1 Removing a PCI Divider Assembly......................................................................... 2-472.14.2 Installing a PCI Divider Assembly........................................................................... 2-48

    2.15Removing / Installing / Hot-Swapping a Fan Unit.................................................................. 2-492.15.1

    Removing a Fan Unit ............................................................................................ 2-49

    2.15.2 Installing a Fan Unit ............................................................................................. 2-502.15.3 Hot-Swapping a Fan ............................................................................................ 2-51

    2.16Removing / Installing a Fan Box.......................................................................................... 2-522.16.1 Removing a Fan Box ............................................................................................ 2-522.16.2 Cable Removal .................................................................................................... 2-532.16.3 Installing a Fan Box.............................................................................................. 2-54

    2.17Removing / Installing an Air Flow Guide .............................................................................. 2-562.17.1 Removing an Air Flow Guide Removal ................................................................... 2-562.17.2 Installing an Air Flow Guide.................................................................................. 2-57

    2.18Removing / Installing / Hot-Swapping a Power Supply.......................................................... 2-582.18.1 Removing a Power Supply .................................................................................... 2-582.18.2 Installing a Power Supply...................................................................................... 2-612.18.3 Hot-Swapping a Power Supply .............................................................................. 2-63

    2.19Removing / Installing a Power Supply Box Assembly ............................................................. 2-642.19.1 Removing a Power Supply Box Assembly................................................................ 2-642.19.2 Installing a Power Supply Box Assembly ................................................................. 2-66

    2.20Removing / Installing a Power Supply Support ...................................................................... 2-682.20.1 Removing a Power Supply Support ........................................................................ 2-682.20.2 Installing a Power Supply Support.......................................................................... 2-70

    2.21Removing / Installling a HDD Board .................................................................................... 2-722.21.1 Removing a HDD Board ....................................................................................... 2-722.21.2 Installing a HDD Board......................................................................................... 2-74

    2.22Removing / Installing a Mounting Plate Assembly / Main Board ............................................. 2-762.22.1 Removing a Mounting Plate Assembly .................................................................... 2-762.22.2 Installing a Mounting Plate Assembly...................................................................... 2-78

    2.23Removing / Installing IDE Cable and SAS Cable ................................................................... 2-802.23.1 IDE Cable and SAS Cable Removal (1) .................................................................. 2-802.23.2 IDE Cable and SAS Cable Removal (2) .................................................................. 2-802.23.3 IDE Cable and SAS Cable Installation (1) ............................................................... 2-812.23.4 IDE Cable and SAS Cable Installation (2) ............................................................... 2-82

    2.24Removing / Installing MVR Cable ........................................................................................ 2-832.24.1 MVR Cable Removal (1) ....................................................................................... 2-832.24.2 MVR Cable Removal (2) ....................................................................................... 2-832.24.3 MVR Cable Installation (1) .................................................................................... 2-842.24.4 MVR Cable Installation (2) .................................................................................... 2-85

    2.25Removing / Installing Control Panel Cable / Control Panel Power Cable ................................. 2-862.25.1 Control panel Cable/Control panel Power Cable Removal ....................................... 2-862.25.2 Control panel Cable/Control panel Power Cable Installation .................................... 2-87

  • 7/31/2019 86A704ET02

    8/308

    vi

    2.26Removing / Installing a CPU ............................................................................................... 2-892.26.1 Removing a CPU.................................................................................................. 2-892.26.2 Installing a CPU ................................................................................................... 2-942.26.3 Assembling / De-assembling CPU/Heatsink .......................................................... 2-100

    2.27Removing / Installing the Battery........................................................................................ 2-113

    2.27.1 Removing the Battery .......................................................................................... 2-1132.27.2 Installing the battery ........................................................................................... 2-114

    3.1 General Flow of Troubleshooting ........................................................................................... 3-13.2 Collection of Information....................................................................................................... 3-1

    3.2.1 Power Off Status .................................................................................................... 3-23.2.2 Initialization Status ................................................................................................. 3-23.2.3 EFI Shell Working Status ......................................................................................... 3-23.2.4

    OS Working Status ................................................................................................ 3-3

    3.2.5 System Hang Status................................................................................................ 3-3

    3.3 Methods of Information Collection in Detail ............................................................................. 3-43.3.1 How to Read POST Code........................................................................................ 3-43.3.2 How to Read SEL by selview.................................................................................... 3-43.3.3 How to Collect System and Error Logs (Linux) ............................................................ 3-43.3.4 How to Collect System and Error Logs (Windows)...................................................... 3-5

    3.4 Appropriate Actions to Take.................................................................................................. 3-63.4.1 Check POST Code ................................................................................................. 3-63.4.2 Check SEL List........................................................................................................ 3-6

    3.5 Execution of System Diagnosis Program.................................................................................. 3-63.6 Reference for Troubleshooting................................................................................................ 3-7

    3.6.1 POST Code Table .................................................................................................. 3-73.6.2 SEL List.................................................................................................................. 3-73.6.3 System Diagnostic Program ..................................................................................... 3-7

    B.1. POST Code Generated by BMC (Logged at Seven Segment LED).............................................. B-1B.2. POST Code Generated by SAL (Logged at Seven Segment LED) ............................................... B-7

    B.2.1. Progress POST Code Generated by SAL ................................................................... B-7B.2.2. Error POST Code Generated by SAL ........................................................................ B-9

    C.1 BMC SEL .......................................................................................................................... .C-1C.2 SAL SEL ........................................................................................................................ .C-19

  • 7/31/2019 86A704ET02

    9/308

    D.1 SEL Message Display Utility (selview) ..................................................................................... D-1

    D.1.1 Functional Specification.......................................................................................... D-1D.1.2 How to Use and Examples ...................................................................................... D-1

    D.2 Save and Restore System Configuration Utility (syscfg) ............................................................. D-4D.2.1 Functional Specification.......................................................................................... D-4D.2.2 Usage and Output Example .................................................................................... D-5D.2.3 Outline of Input/Output File .................................................................................... D-7

    D.3 F/W Update Tool (fwupdate) .............................................................................................. D-11D.3.1 Outline of Functions ............................................................................................. D-11D.3.2 How to Use and Examples .................................................................................... D-12D.3.3 Execution Screen ................................................................................................. D-14

    D.4 Copy MAC address Tool (copymac) .................................................................................... D-15D.4.1

    Outline of Functions ............................................................................................. D-15

    D.4.2 How to Use and Examples .................................................................................... D-15

    D.5 FRU Data Mapping ............................................................................................................ D-18D.6 FRU information displayed by selview .................................................................................. D-19D.7 [File Name].bmc Data format stored by syscfg ................................................................... D-21

    D.7.1 Basic definition of data format............................................................................... D-21D.7.2 Definition of Sections and Keyword........................................................................ D-22

    D.8 SOL settings using syscfg .................................................................................................... D-46D.8.1 Settings............................................................................................................... D-46D.8.2 Sample of modification......................................................................................... D-47

    D.9 System Diagnosis Program (BSTP) ........................................................................................ D-52D.9.1 Overview............................................................................................................ D-52D.9.2 Environmental Requirements.................................................................................. D-52D.9.3 BSTP Operation................................................................................................... D-52D.9.4 Test Description ................................................................................................... D-54

    E.1 Overview of Debug Console ..................................................................................................E-1

    E.1.1 Function of the Console ...........................................................................................E-1E.1.2 How to Enable the Console......................................................................................E-1E.1.3 Supported Commands List........................................................................................E-2

    E.2 Commands Usages ...............................................................................................................E-3E.2.1 DL .........................................................................................................................E-3E.2.2 RL.......................................................................................................................... E-5E.2.3 UP........................................................................................................................ .E-5E.2.4 DN....................................................................................................................... .E-6E.2.5 RS......................................................................................................................... E-6E.2.6 RE .........................................................................................................................E-7E.2.7 TC......................................................................................................................... E-7E.2.8 #1........................................................................................................................ .E-8E.2.9 BZ........................................................................................................................ .E-8E.2.10 IPMI ......................................................................................................................E-9

  • 7/31/2019 86A704ET02

    10/308

    viii

    E.2.11 PM ..................................................................................................................... E-10E.2.12 HE...................................................................................................................... E-10E.2.13 CO..................................................................................................................... E-11E.2.14 FV ...................................................................................................................... E-11E.2.15 HI....................................................................................................................... E-12

    ................................................................................................................. .F-15

  • 7/31/2019 86A704ET02

    11/308

    Figure 1-1. Bull NovaScale Server cabinets ........................................................................................ 1-1Figure 1-2.

    Bull NovaScale 3025 or 3045 server................................................................................ 1-3

    Figure 1-3. NovaScale 3025/3045 Drawer front view........................................................................ 1-5Figure 1-4. Control panel controls and LEDs........................................................................................ 1-6Figure 1-5. DVD/CD-ROM RW Combo.............................................................................................. 1-8Figure 1-6. Hard disk drive tray and status LED................................................................................... 1-8Figure 1-7. Memory box front view (MMR) and status of the LEDs.......................................................... 1-9Figure 1-8. NovaScale 3045 Drawer rear view ................................................................................ 1-10Figure 1-9 NovaScale 3025 Drawer rear view ................................................................................ 1-11Figure 1-10.NovaScale 3025/3045 Ethernet connector status LEDs..................................................... 1-12Figure 1-11.NovaScale 3045 Drawer Top View ................................................................................ 1-13Figure 1-12.NovaScale 3025/3045 Power supply LEDs..................................................................... 1-14Figure 1-13.

    NovaScale 3025/3045 Cooling fan LED ........................................................................ 1-15

    Figure 1-14.NovaScale 3025/3045 PCI card slot and LED................................................................. 1-16Figure 1-15. Block diagram of the NovaScale 3045 server .................................................................. 1-17Figure 1-16. Block diagram of the NovaScale 3025 server .................................................................. 1-18Figure 1-17.Layout of the main board of NovaScale 3045.................................................................. 1-19Figure 1-18.Layout of the main board of NovaScale 3025.................................................................. 1-20Figure 1-19.Layout of the memory box card....................................................................................... 1-24Figure 1-20.Layout of HDD backplane .............................................................................................. 1-25Figure 1-21.Layout of the control panel board.................................................................................... 1-27Figure 2-1. How to Handle Flat Cable................................................................................................. 2-2Figure 2-2. Improper Ways of Handling Flat Cables (1/2) .................................................................... 2-3Figure 2-3. Improper Ways of Handling Flat Cables (2/2) .................................................................... 2-3

    Figure 2-4. NovaScale 3025 Server processor locations ...................................................................... 2-7Figure 2-5. NovaScale 3045 Server processor locations ...................................................................... 2-8Figure 2-6. Memory DIMM Sets....................................................................................................... 2-10Figure 2-7. Handles Attached.......................................................................................................... 2-16Figure 2-8. Removing Handles from Chassis .................................................................................... 2-16Figure 2-9. Attaching Handles to Chassis ......................................................................................... 2-17Figure 2-10. Chassis with Handles.................................................................................................... 2-17Figure 2-11. Removing the front bezel................................................................................................ 2-18Figure 2-12. Installing the front bezel ................................................................................................. 2-18Figure 2-13. Removing the top cover.................................................................................................. 2-19Figure 2-14. Installing the top cover................................................................................................... 2-19

    Figure 2-15. DVD/Control Panel Unit Assembly Removal ..................................................................... 2-20Figure 2-16. DVD/Control Panel Unit Assembly Installation .................................................................. 2-21Figure 2-17. Unlocking the HDD tray lever.......................................................................................... 2-23Figure 2-18. Removing the HDD from the bay..................................................................................... 2-24Figure 2-19. Removing the HDD from the HDD tray ............................................................................. 2-24Figure 2-20. Positioning the dummy HDD ........................................................................................... 2-25Figure 2-21. Inserting the HDD tray into the bay.................................................................................. 2-25Figure 2-22. Unlocking the HDD tray lever.......................................................................................... 2-26Figure 2-23. Removing the HDD tray from the bay............................................................................... 2-27Figure 2-24. Removing the dummy HDD............................................................................................. 2-27Figure 2-25. Mounting the HDD in the HDD tray ................................................................................. 2-28

    Figure 2-26. Inserting the HDD in the bay........................................................................................... 2-28

  • 7/31/2019 86A704ET02

    12/308

    x

    Figure 2-27. HDD Backplane CV Removal ......................................................................................... 2-30Figure 2-28. HDD Backplane CV Installation (1) ................................................................................. 2-31Figure 2-29. HDD Backplane CV Installation (2) ................................................................................. 2-31Figure 2-30. Memory Box Removal ................................................................................................... 2-32Figure 2-31. Memory Box Filler Removal ........................................................................................... 2-33Figure 2-32. Memory Box Installation ................................................................................................ 2-34Figure 2-33. Memory Box Filler Installation ........................................................................................ 2-35Figure 2-34. Unlock of Memory Slot.................................................................................................. 2-37Figure 2-35. Installing Pattern of DIMM ............................................................................................. 2-38Figure 2-36. Unlocking the PCI card lock........................................................................................... 2-40Figure 2-37. Removing a short PCI card ............................................................................................ 2-41Figure 2-38. Removing a long PCI card ............................................................................................. 2-41Figure 2-39. Installing the PCI filler.................................................................................................... 2-42Figure 2-40. Closing the PCI caution plate ......................................................................................... 2-42Figure 2-41. Unlocking the PCI card lock........................................................................................... 2-43Figure 2-42. Removing the PCI filler .................................................................................................. 2-44Figure 2-43. Installing a short PCI card.............................................................................................. 2-44

    Figure 2-44. Installing a long PCI card .............................................................................................. 2-45Figure 2-45. Securing the PCI card ................................................................................................... 2-45Figure 2-46. PCI Divider Assembly Removal....................................................................................... 2-47Figure 2-47. PCI Divider Assembly Installation.................................................................................... 2-48Figure 2-48. Removing of Fan Unit.................................................................................................... 2-49Figure 2-49. Installing of Fan Unit ..................................................................................................... 2-50Figure 2-50. FAN Fault LED.............................................................................................................. 2-51Figure 2-51. Fan Box Removal (1)..................................................................................................... 2-52Figure 2-52. Fan Box Removal (2)..................................................................................................... 2-53Figure 2-53. Fan Box Installation....................................................................................................... 2-54Figure 2-54. Fan Box Installation....................................................................................................... 2-55

    Figure 2-55. Air Flow Guide Removal ............................................................................................... 2-56Figure 2-56. Air Flow Guide Installation ............................................................................................ 2-57Figure 2-57. Unlock of Power Supply Lever ........................................................................................ 2-59Figure 2-58. Removing of Power Supply ............................................................................................ 2-60Figure 2-59. Installing of Power Supply ............................................................................................. 2-60Figure 2-60. Removing of Power Supply Filler .................................................................................... 2-61Figure 2-61. Installing of Power Supply ............................................................................................. 2-62Figure 2-62. Lock of Power Supply Lever............................................................................................ 2-63Figure 2-63. Power Supply LED Indicator ........................................................................................... 2-63Figure 2-64. Power Supply Box Assembly Removal (1) ........................................................................ 2-64Figure 2-65. Power Supply Box Assembly Removal (2) ........................................................................ 2-65

    Figure 2-66. Power Supply Box Assembly Installation (1) ..................................................................... 2-66Figure 2-67. Power Supply Box Assembly Installation (2) ..................................................................... 2-66Figure 2-68. Power Supply Box Assembly Installation (3) ..................................................................... 2-67Figure 2-69. PS Support Removal (1)................................................................................................. 2-68Figure 2-70. PS Support Removal (2)................................................................................................. 2-69Figure 2-71. PS Support Installation (1).............................................................................................. 2-70Figure 2-72. PS Support Installation (2).............................................................................................. 2-71Figure 2-73. HDD Board Removal (1)................................................................................................ 2-72Figure 2-74. HDD Board Removal (2)................................................................................................ 2-73Figure 2-75. HDD Board Installation (1)............................................................................................. 2-74Figure 2-76. HDD Board Installation (2)............................................................................................. 2-75

    Figure 2-77. Mounting Plate Assembly Removal (1)............................................................................. 2-76

  • 7/31/2019 86A704ET02

    13/308

    Figure 2-78. Mounting Plate Assembly Removal (2) ............................................................................. 2-77Figure 2-79. Mounting Plate Assembly Installation .............................................................................. 2-78Figure 2-80. Mounting Plate Assembly Installed in the Chassis ............................................................. 2-79Figure 2-81. IDE Cable and SAS Cable Removal................................................................................. 2-80Figure 2-82. SAS Cable Removal ...................................................................................................... 2-80Figure 2-83. IDE Cable Removal........................................................................................................ 2-81Figure 2-84. IDE Cable Installation .................................................................................................... 2-81Figure 2-85. SAS Cable Installation ................................................................................................... 2-82Figure 2-86. IDE Cable and SAS Cable Installation (2)......................................................................... 2-82Figure 2-87. MVR Cable Removal (1)................................................................................................. 2-83Figure 2-88. MVR Cable Removal (2)................................................................................................. 2-83Figure 2-89. MVR Cable Installation (1).............................................................................................. 2-84Figure 2-90. A Air Flow Guide installed in the Chassis......................................................................... 2-84Figure 2-91. MVR Cable Installation (2).............................................................................................. 2-85Figure 2-92. Control panel Cable/Control panel Power Cable Removal................................................. 2-86Figure 2-93. Control panel Cable/Control panel Power Cable Installation ............................................. 2-87Figure 2-94. A Fan Box Installed in the Chassis................................................................................... 2-88

    Figure 2-95. Removing the Handle..................................................................................................... 2-89Figure 2-96. Loosening screws of LGA Terminal .................................................................................. 2-90Figure 2-97. Loosening MVR from the Retention................................................................................... 2-90Figure 2-98. Removing MVR from CPU............................................................................................... 2-91Figure 2-99. Installing the Protection Cover......................................................................................... 2-91Figure 2-100. Loosening the screws ................................................................................................... 2-92Figure 2-101. CPU unlock ................................................................................................................ 2-92Figure 2-102. Removing CPU and Heatsink from the System Board ....................................................... 2-93Figure 2-103. Installing CPU and Heatsink to the System Board ............................................................ 2-95Figure 2-104 CPU Lock ................................................................................................................... 2-96Figure 2-105 Fastening the Heatsink ................................................................................................. 2-97

    Figure 2-106 Removing the Protection Cover ..................................................................................... 2-97Figure 2-107. Postionning the MVR on the system board ...................................................................... 2-98Figure 2-108. Fastening MVR on the Retention.................................................................................... 2-98Figure 2-109. Fastening MVR to CPU................................................................................................. 2-98Figure 2-110. Installing Handles........................................................................................................ 2-99Figure 2-111. Full Installation .......................................................................................................... 2-100Figure 2-112. All Components in separation..................................................................................... 2-101Figure 2-113. CPU (Montecito)........................................................................................................ 2-101Figure 2-114. Removing the Protection Sheet of the Heatsink .............................................................. 2-102Figure 2-115. Installing the Pin Shroud to CPU.................................................................................. 2-103Figure 2-116. Magnified A of Figure 2-115................................................................................... 2-103

    Figure 2-117. Installing the Spring Clip ............................................................................................ 2-104Figure 2-118. Aligning the Positioning Pin ........................................................................................ 2-105Figure 2-119. Installing CPU to the Heatsink ..................................................................................... 2-105Figure 2-120. Fastening the Screw .................................................................................................. 2-105Figure 2-121. CPU Full Installation to the Heatsink............................................................................. 2-106Figure 2-122. Installation the Bolster Plate to CPU.............................................................................. 2-106Figure 2-123. Viewing Air Gaps when held up to a light source ......................................................... 2-107Figure 2-124. Removing the Bolster Plate from CPU ........................................................................... 2-108Figure 2-125. Loosening the screw .................................................................................................. 2-109Figure 2-126. Removing CPU from the Heatsink ................................................................................ 2-109Figure 2-127. CPU and Hetasink in Separation................................................................................. 2-109

    Figure 2-128. Removing the Spring Clip........................................................................................... 2-110

  • 7/31/2019 86A704ET02

    14/308

  • 7/31/2019 86A704ET02

    15/308

    Table 1-1. NovaScale 3025/3045 Drawer front view........................................................................ 1-5Table 1-2.

    Control panel controls...................................................................................................... 1-6

    Table 1-3. Control panel LED states................................................................................................... 1-7Table 1-4. NovaScale 3025/3045 Power supply configurations ....................................................... 1-13Table 1-5. Component list of the main board ................................................................................... 1-22Table 1-6. External I/O connector list of the main board ................................................................... 1-22Table 1-7. Internal connector list of the main board .......................................................................... 1-23Table 1-8. Component list of the memory box card........................................................................... 1-24Table 1-9. Connector list of the memory box card ............................................................................ 1-24Table 1-10. List of connector of the HDD backplane............................................................................ 1-26Table 1-11. Component list of the control panel board........................................................................ 1-27Table 1-12. Connector list of the control panel board ......................................................................... 1-28Table 2-1 Allowed processor placement options for NovaScale 3025/3045 Servers ............................ 2-8

    Table 2-2. NovaScale 3025 - DIMM configurations in non-mirror mode.............................................. 2-11Table 2-3. NovaScale 3025 - DIMM configurations in mirror mode................................................... 2-11Table 2-4. NovaScale 3045 - DIMM configurations in non-mirror mode.............................................. 2-12Table 2-5. NovaScale 3045 - DIMM configurations in mirror mode.................................................... 2-13Table 2-6. NovaScale 3045 DIMM capacity mixes .......................................................................... 2-14Table 2-7. Selecting CPU sockets and DIMM slots Example 1.......................................................... 2-15Table 2-8. Selecting CPU sockets and DIMM slots Example 2.......................................................... 2-15Table 2-9. Selecting CPU sockets and DIMM slots Example 3.......................................................... 2-15Table 2-10. HDD bay population rules .............................................................................................. 2-22Table A-1. Bull NovaScale 3025 Server CPU drawer specifications...................................................... A-1Table A-2.

    Bull NovaScale 3045 Server CPU drawer specifications...................................................... A-2

    Table A-3. Bull NovaScale 3045 COMPACT Server CPU drawer specifications..................................... A-3Table A-1. Bull NovaScale 3025 Server CPU drawer specifications...................................................... A-4Table A-2. Bull NovaScale 3045 Server CPU drawer specifications...................................................... A-5Table D-1 Command Parameters...................................................................................................... D-2Table D-2 Output Fields .................................................................................................................. D-3Table D-3 Argument and Switches ................................................................................................... D-6Table D-4 Related Files ................................................................................................................... D-7Table D-5 Command Line Description............................................................................................. D-13Table D-6 Copymac Output Fields ................................................................................................. D-16Table D-7 Classification and Usage of FRU Information .................................................................... D-18Table D-8 FRU Information Displayed by selview .......................................................................... D-19

    Table D-9 Display format .............................................................................................................. D-20Table D-10 Sample of FRU Information Displayed by selview ........................................................... D-20Table D-11 List of log files to be saved. ............................................................................................ D-53Table D-12 BSTP Test Description..................................................................................................... D-54Table E-1 Specification List ..............................................................................................................E-9

  • 7/31/2019 86A704ET02

    16/308

    xiv

  • 7/31/2019 86A704ET02

    17/308

    xv

    This book provides maintenance information that is specific to NovaScale 3005 Seriesservers, such as installation, connection, and handling. It is used by the servicerepresentative.

    Chapter 1. Server Descriptiondescribes server features and how to use them, and explains how, as CustomerAdministrator, you can configure the server to suit your environment

    Chapter 2. Servicing Boardsexplains how to install or remove the components of the server.

    Chapter 3. Troubleshootinghelps you track down problems.

    Appendix A. Server Specificationsoutlines general server drawer specifications.

    Appendix B. Post Code Table

    Appendix C. SEL Definitions.

    Appendix D. EFI-Based Utilities

    Appendix E. Debug Console Commands Manual.

    Appendix F. Warning Notices

  • 7/31/2019 86A704ET02

    18/308

    xvi NovaScale 3025/3045 - Maintenance Guide

    The following conventions are used in this guide:

    Identifies predefined commands, subroutines, keywords, files, structures,buttons, labels and icons.

    Italics Identifies referenced publications, chapters, sections, figures and tables.

    < > Identifies parameters to be supplied by the user.

    NovaScale Site Preparation Guide, 86 A1 87 EF,explains how to prepare a Data Processing Center for Bull NovaScale Servers, incompliance with the standards in force. This guide is intended for use by all personnel andtrade representatives involved in the site preparation process.

    NovaScale 3005 Series Installation and Users Guide, 86 A1 02ET,provides the user with pre-requisites for installing and using the server, describes serverfeatures and how to use them, explains how, as Customer Administrator, you can configurethe server to suit your environment, and helps you track down problems.

    Bull 1100 & 1300 Cabinet Installation & Service Guide, 86 A1 91EM,

    explains how to install and fit out rack cabinets for Bull NovaScale Servers and peripheraldevices.

    According to server configuration and version, certain features and functions described inthis guide may not be accessible. Please contact your Bull Sales Representative for salesinformation.

  • 7/31/2019 86A704ET02

    19/308

    xvii

    We hereby certify that this product is in compliance with European Union EMC Directive89/336/EEC, using standards EN55022 (Class A) and EN55024 and Low VoltageDirective 73/23/EEC, using standard EN60950. The product has been marked with theCE Mark to illustrate its compliance.

    - UL 60950 (USA)

    - IEC 60950 (International)

    - CSA 60950 (Canada)

    This product is in conformity with the protection requirements of the following EC CouncilDirectives:

    - 89/336/EEC (EN 55022 (1998))

    - EN55024 (1998)

    - EN61000-3-2 (1995)

    - EN61000-3-3 (1995)

    Europe EMC Directive, 89/336/EEC

    . EN55022, Class A Limit, Radiated & Conducted Emissions

    . EN55024, ITE Specific Immunity Standard

    . EN61000-4-2, ESD Immunity (Level 2 Contact Discharge, Level 3 AirDischarge)

    . EN61000-4-3, Radiated Immunity (Level 2)

    . EN61000-4-4, Electrical Fast Transient (Level 2)

    . EN61000-4-5, AC Surge

    . EN61000-4-6, Conducted RF

    . EN61000-4-8, Power Frequency Magnetic Fields

    . EN61000-4-11, Voltage Dips and Interrupts

    . EN61000-3-2, Limit for Harmonic Current Emissions

    . EN61000-3-3, Voltage Flicker

    - 73/23/EEC (EN 60950)

  • 7/31/2019 86A704ET02

    20/308

    xviii NovaScale 3025/3045 - Maintenance Guide

    - 93/68/EEC

    - 199/5/EC

    Neither the provider nor the manufacturer can accept responsibility for any failure to satisfythe protection requirements resulting from a nonrecommended modification of the product.Compliance with these directives requires:- An EC declaration of conformity from the manufacturer- An EC label on the product- Technical documentation

    This product has been designed and built to comply with standard IEC 60950.

    This equipment has been tested and found to comply with the limits for a Class A digitaldevice, pursuant to Part 15 of the FCC Rules. These limits are designed to providereasonable protection against harmful interference when the equipment is operated in acommercial environment. This equipment generates, uses, and can radiate radio frequency

    energy and, if not installed and used in accordance with the instruction manual, may causeharmful interference to radio communications. Operation of this equipment in a residentialarea is likely to cause harmful interference in which case the user will be required tocorrect the interference at its own expense.Properly shielded and grounded cables and connectors must be used in order to meet FCCemission limits. Neither the provider nor the manufacturer is responsible for any radio ortelevision interference caused by using other than recommended cables and connectors orby unauthorized changes or modifications to this equipment. Unauthorized changes ormodifications could void the users authority to operate the equipment.Any changes or modifications not expressly approved by the grantee of this device couldvoid the users authority to operate the equipment. The customer is responsible for ensuring

    compliance of the modified product.

  • 7/31/2019 86A704ET02

    21/308

    xix

    This device complies with Part 15 of the FCC Rules. Operation is subject to the followingtwo conditions: (1) this device may not cause harmful interference, and (2) this device mustaccept any interference received, including interference that may cause undesiredoperation.

    This product is in conformity with the protection requirements of the following standards:

    Electrical Compatibility:- UL 60950- CSA 60950

    This Class A digital apparatus meets all requirements of the Canadian Interference CausingEquipment Regulations.

    Cet appareil numrique de la classe A est conforme la norme NMB-003 du Canada.

    This product is in conformity with the protection requirements of the following standards:

    This product that uses laser technology complies with Class 1 laser requirements.

    A CLASS 1 LASER PRODUCT label is located on the laser device.

    Class 1 Laser Product

    Luokan 1 Laserlaite

    Klasse 1 Laser Apparat

    Laser Klasse 1

  • 7/31/2019 86A704ET02

    22/308

    xx NovaScale 3025/3045 - Maintenance Guide

    ADangernotice indicates the presence of a hazard that has the potential of causing deathor serious personal injury.

    ACaution notice indicates the presence of a hazard that has the potential of causingmoderate or minor personal injury.

    A Warning notice indicates an action that could cause damage to a program, device,system, or data.

    The following safety instructions shall be observed when connecting or disconnecting

    devices to the server.

    The Customer is responsible for ensuring that the AC electricity supply is compliant withnational and local recommendations, regulations, standards and codes of practice.An incorrectly wired and grounded electrical outlet may place hazardous voltage on metalparts of the server or the devices that attach to the server and result in an electrical shock.It is mandatory to remove power cables from electrical outlets before relocating the server

    This unit has more than one power supply cable. Follow procedures for removal of powerfrom the server when directed.

  • 7/31/2019 86A704ET02

    23/308

    xxi

    The optical drive in this system unit is a classified as a Class 1 level Laser product. The

    optical drive has a label that identifies its classification.

    The optical drive in this system unit is certified in the U.S. to conform to the requirements ofthe Department of Health and Human Services 21 Code of Federal Regulations (DHHS 21CFR) Subchapter J for Class 1 laser products. Elsewhere, the drive is certified to conform tothe requirements of the International Electro technical Commission (IEC) 60825-1: 2001and CENELEC EN 60825-1: 1994 for Class 1 laser products.

    Class 1 Laser products are not considered to be hazardous. The optical drive containsinternally a Class 3B gallium-arsenide laser that is nominally 30 mill watts at 830nanometers. The design incorporates a combination of enclosures, electronics, andredundant interlocks such that there is no exposure to laser radiation above a Class 1 levelduring normal operation, user maintenance, or servicing conditions.

    This product has been built to comply with the Restriction of Certain Hazardous Substances(RoHS) Directive 2002/95/EC.

  • 7/31/2019 86A704ET02

    24/308

    xxii NovaScale 3025/3045 - Maintenance Guide

  • 7/31/2019 86A704ET02

    25/308

    Server Description 1-1

    Bull NovaScale 3025/3045 servers for clustered scientific and business applications aredelivered rack-mounted and ready-to-use in high or low cabinets. Optionally, servers canbe delivered ready-to-mount for integration in existing NovaScale server systems.

    Figure 1-1. Bull NovaScale Server cabinets

    NovaScale 3025/3045 servers can be used alongside NovaScale 5005 Series Servers tocreate large-scale SMP systems, enabling high availability, load-balancing and parallel

    processing.

  • 7/31/2019 86A704ET02

    26/308

  • 7/31/2019 86A704ET02

    27/308

    Server Description 1-3

    NOTE:

    Server components and configuration may differ according to the version chosen.

    Bull NovaScale 3025 Server Bull NovaScale 3045 Server

    1 to 2 Intel Itanium 2 processors 1 to 4 Intel Itanium 2 processors

    533 MHz Front Side Bus (FSB) support 533 MHz Front Side Bus (FSB) support

    DDR2 SDRAM memory (16 DIMM slots) DDR2 SDRAM memory (32 DIMM slots)

    2 x 64-bit PCI-X slots,1 x 8 PCI-e slots,1 x 16 PCI-e slots

    2 x 64-bit PCI-X slots,2 x 8 PCI-e slots,2 x 16 PCI-e slots

    8 hot-swappable 3.5-inch SAS3G hard disk drives 8 hot-swappable 3.5-inch SAS3G hard disk drives

    Front access to hot-swap hard disk drives Front access to hot-swap hard disk drives

    2 hot-swap 1760 W power supplies (redundantconfiguration (200-240 V) and redundant powercords (1 per power supply)

    2 hot-swap 1760 W power supplies (redundantconfiguration (200-240 V) and redundant powercords (1 per power supply)

    6 top-access hot-swap system fans in redundant (5+1)configuration

    6 top-access hot-swap system fans in redundant (5+1)configuration

    Dockable slim-line DVD-CD RW drive Dockable slim-line DVD-CD drive

    Status LEDs Status LEDs

    Figure 1-2. Bull NovaScale 3025 or 3045 server

  • 7/31/2019 86A704ET02

    28/308

    1-4 NovaScale 3025/3045 - Maintenance Guide

    Server controls and indicators are located on the server drawer as described below:

    Control panel: Switches and LEDs

    Hot-swap hard disk drive bay: Hard disk drive LEDs

    Memory box: Memory box serviceability LEDs

    Power supply and AC modules

    PCI slots

    IO ports

    Identification Switch

    Power Supply LEDs

    Cooling fan

    PCI Hot Plug

  • 7/31/2019 86A704ET02

    29/308

    Server Description 1-5

    Figure 1-3 shows the front view of the drawer with the snap-on bezel in place. The bezelprovides access to the Control panel board and the hot-swap hard disk drive bay.

    Figure 1-3. NovaScale 3025/3045 Drawer front view

    Note:

    In NovaScale 3025 model, MMR can be installed only in MMR0/MMR1.

    # Item Description

    A Control panel See subsection 1.3.1.1.

    B DVD/CD R/W Drive Bay See subsection 1.3.1.2.

    C Hot-swap hard disk drive bay Eight hot-swap hard disk drive bays acceptingSAS hard disk drives. See subsection 1.3.1.3.

    D Memory box Up to four memory boxes. See subsection1.3.1.4.

    Table 1-1. NovaScale 3025/3045 Drawer front view

    D

    B

    CUSB x2 A

  • 7/31/2019 86A704ET02

    30/308

    1-6 NovaScale 3025/3045 - Maintenance Guide

    The Control panel is located under the slim DVD-ROM drive on the left-side of the serverdrawer front and provides user interface for system management via switches and status

    LEDs. Figure 1-4 shows the control buttons and status LEDs on the Control panel.

    Figure 1-4. Control panel controls and LEDs

    # Item Description

    A Power Switch Toggles server power.When power Switch is pressed for more than fourseconds, this will force the power off (this action

    invalidates the Wake on LAN).B Reset Switch Resets the server.

    C SDINT (System DiagnosticInterrupt) Switch

    Issues an interrupt towards the Operating Systemto generate a dump, then resets the server.

    D Identification Switch Toggles the Drawer Identification LED. There isalso a second Identification LED at the rear of thesystem.

    E Two USB Ports USB 1.1.In case of over-current, the port is shut down. For

    recovery, it is necessary to put off USB cable fromthe USB port and then plug in.

    Table 1-2. Control panel controls

    A, F D, GE

    H I

    B C

  • 7/31/2019 86A704ET02

    31/308

    Server Description 1-7

    LED states are set out in Table 1-3, below.

    # LED Color State Description

    On System is ON

    Blinking System is being powered OFF

    F Power LED Green

    Off System is OFF

    On/Off This LED is used to identify one serveramong others by toggling on/off theidentification switch.

    G Identification LED Blue

    Blinking CMOS clear or FWH recovery mode.

    On Critical, non-recoverable power fault hasbeen detected.

    Blinking Non-critical power fault has been

    detected.

    H Power Fault LED Orange

    Off No power fault has been detected

    On Critical, non-recoverable cooling faulthas been detected.

    Blinking(1 Hz)

    Non-critical cooling fault has beendetected.

    I Cooling Fault LED Orange

    Off No cooling fault has been detected

    On Critical, non-recoverable fault other than

    power or cooling fault has beendetected.

    Blinking Non-critical fault other than power orcooling fault has been detected.

    J General Fault LED Orange

    Off No general fault has been detected

    Table 1-3. Control panel LED states

  • 7/31/2019 86A704ET02

    32/308

    1-8 NovaScale 3025/3045 - Maintenance Guide

    The slim-line DVD/CD RW Combo is located in the DVD/CD R/W Drive Bay.

    A : DVD or CD drive B : DVD fixing hook

    Figure 1-5. DVD/CD-ROM RW Combo

    Hot-swap hard disk drive trays are designed to accept 15,000-RPM (or slower) SAS3Gtechnology hard disk drives. One set of 4 HDDs can be connected to the on-board SAScontroller. An SAS PCI-X card is required to connect the second set of 4 HDDs.

    A : LED B : Hard disk drive

    Color of the LED State DescriptionON Activity

    4Hz Locate

    Green

    Blinking

    1Hz Rebuild

    Red ON Error

    Red (0.5 sec) ->Green (0.5 sec) -> OFF

    Blinking LED check sequence during HDD insertor System reset (with or w/o HDD)

    Figure 1-6. Hard disk drive tray and status LED

    A

    B

    AB

  • 7/31/2019 86A704ET02

    33/308

    Server Description 1-9

    In Memory Mirror mode, memory box #0 is paired with memory box #1, and memorybox#2 is paired with memory box #3.

    # LEDs Color State Description

    On The MMR is operating in Mirror mode.A MMR Mirror LED Green

    Off The MMR is not operating in Mirrormode.

    On The MMR is powered on.B MMR Power LED GreenOff The MMR is powered off.

    On Error has been detected on the MMR.C MMR Attention LED Orange

    Off No error has been detected on theMMR or the MRR is powered off.

    Figure 1-7. Memory box front view (MMR) and status of the LEDs

    A B C

  • 7/31/2019 86A704ET02

    34/308

    1-10 NovaScale 3025/3045 - Maintenance Guide

    Figure 1-8 shows the rear view of the NovaScale 3045 drawer, including PCI card slots,power supply modules, and user-accessible connectors.

    # Item Description

    A AC input power connectors

    B PCI Slots All slots support hot-plug PCI add-in cards:- Slot 1: PCIe x 8 slot, short- Slot 2: PCIe x 16 slot, short- Slot 3: 133 MHz, 64-bit PCI-X slot, short- Slot 4: PCIe x 8 slot, short- Slot 5: PCIe x 16 slot, medium- Slot 6: 133 MHz, 64-bit PCI-X slot, long

    C Dual GbE ports RJ45 connectors. See subsection 1.3.2.1 for more onthe status of the LEDs.

    D Ether0: Management LANEther1: 100 MbE ports

    RJ45 connectors. See subsection 1.3.2.1 for more onthe status of the LEDs.

    E Four USB ports 4-pin connectors

    F Video port Standard VGA compatible, 15-pin connector

    G Serial port 9-pin RS-232 connector.

    H Identification Switch Toggles server drawer ID LED On/Off. There is also asecond identification LED at the front of the system.

    Figure 1-8. NovaScale 3045 Drawer rear view

    A

    EF G

    B

    H

    CD

  • 7/31/2019 86A704ET02

    35/308

    Server Description 1-11

    Figure 1-9 shows the rear view of the NovaScale 3025 drawer, including PCI card slots,power supply modules, and user-accessible connectors.

    # Item Description

    A AC input power connectors

    B PCI Slots All slots support hot-plug PCI add-in cards- Slot 1: PCIe x 8 slot, half length- Slot 2: PCIe x 16 slot, half length

    - Slot 3: 133 MHz, 64-bit PCI-X slot, half length- Slot 4: 133 MHz, 64-bit PCI-X slot, full length

    C Dual GbE ports RJ45 connectors. See subsection 1.3.2.1 forindicators.

    D 100 MbE ports RJ45 connectors. See subsection 1.3.2.1 forindicators.

    E Four USB ports 4-pin connectors

    F Video port Standard VGA compatible, 15-pin connector

    G Serial port 9-pin RS-232 connector

    H Identification Switch Toggles Server drawer ID LED On/Off. The front sidehas another ID switch operated as the same as therear.

    Figure 1-9 NovaScale 3025 Drawer rear view

    A

    E

    F G

    B

    H

    CD

  • 7/31/2019 86A704ET02

    36/308

    1-12 NovaScale 3025/3045 - Maintenance Guide

    Item LED Color State Description

    On Link

    Blinking Active

    ACT/LNK Green

    Off No Link

    Yellow On 1000

    Green On 100

    A: Gigabit Ethernet

    SPEED

    - - - - - Off 10

    On Link

    Blinking Active

    ACT/LNK Green

    Off No Link

    Green On 100

    B: Fast Ethernet(Management LAN)

    SPEED

    - - - - - On 10

    Figure 1-10. NovaScale 3025/3045 Ethernet connector status LEDs

    ACT/LNK

    SPEED

    B

    A

  • 7/31/2019 86A704ET02

    37/308

    Server Description 1-13

    Figure 1-11. NovaScale 3045 Drawer Top View

    Note:

    In NovaScale 3025, CPU can be installed only in CPU0/CPU1 and MMR can be installedonly in MMR0/MMR1, respectively.

    The 12 V hot-swap power supply modules are rated at 1760 W over an input range of200-240 Vac. Each power supply module has 2 outputs, that is, +12 V and +5 Vsb -standby voltages (+5 Vsb) are active anytime AC input power is applied to the powersupply. Power supply modules are connected to the main board directly and can be usedin 1+1 redundant mode.

    ServerPower

    AC Input Current RedundancySupport

    Hot-SwapSupport

    Remarks

    1760 W 200-240 V 9.5 A Yes Yes Two powersupplies requiredfor redundancyand hot-swap.

    Table 1-4. NovaScale 3025/3045 Power supply configurations

    MMR0

    MMR1

    MMR2

    MMR3

    CPU0

    CPU1

    CPU2

    CPU3

    NDC

    NDC

    PCI-X

    PCI-X

    PCI Express (x16)PCI Express (x8)

    PCI Express (x16)PCI Express (x8)

    MC MC

    MC MC

    MC

    MC

    DIMM

    DIMM

    DIMM

    DIMM

    DIMM

    DIMM

    DIMM

    FAN0

    FAN1

    FAN3

    FAN5

    FAN4

    FAN2

    MC

    MC

    DIMM

  • 7/31/2019 86A704ET02

    38/308

    1-14 NovaScale 3025/3045 - Maintenance Guide

    # LED Description

    A Input Good LED Indicates input power is good, when green LED is on.

    B DC Output Good LED Indicates output power is good, when green LED is on.

    C Fault LED Indicates Power Supply is faulty.

    Figure 1-12. NovaScale 3025/3045 Power supply LEDs

    A!

    B C

  • 7/31/2019 86A704ET02

    39/308

    Server Description 1-15

    Drawer inlets have hot-swappable, 5+1 redundant 120x38 fans for cooling and the ACunit has non-redundant fans for cooling the AC unit. Fans provide sufficient airflow to coolsystem components, CPU, memory and the chipset, even if one of the 6 fans fails. Each fanis placed around the center of the drawer and memory. HDDs and the DVD are cooled bysuction.

    CAUTION:

    # Status of thecooling fan LED

    Description

    Green lighted Cooling fan is workingA

    OFF Cooling fan is OFF

    Figure 1-13. NovaScale 3025/3045 Cooling fan LED

    A

  • 7/31/2019 86A704ET02

    40/308

    1-16 NovaScale 3025/3045 - Maintenance Guide

    # LED Status Description

    A Power Indicates PCI Slot is active.

    B Hot swap LED andswitch

    Yellow Hot swap switch is used toinsert/remove a card from the slot.If the LED becomes Yellow, itindicates an error.

    Figure 1-14. NovaScale 3025/3045 PCI card slot and LED

    B

  • 7/31/2019 86A704ET02

    41/308

    Server Description 1-17

    The board set of the NovaScale 3045 consists of one main board, four memory box cards,one HDD backplane and one control panel board.The block diagram of the NovaScale 3045 is as follows:

    MCMC

    MCMC

    MCMC

    MCMC

    MCMC

    MCMC

    MCMC

    MCMC

    NodeController

    NodeController

    Intel

    6700

    PXH

    Intel

    6700

    PXH

    PCI-e x16 slotPCI-e x16 slot

    PCI-e x8 slotPCI-e x8 slot

    PCI-e x16 slotPCI-e x16 slot

    PCI-e x8 slotPCI-e x8 slot

    PCI-X 133MHz slotPCI-X 133MHz slot

    PCI-X 133MHz slotPCI-X 133MHz slot

    Intel

    ESB-2

    Intel

    ESB-2

    NodeController

    NodeController

    COM port

    VGA port

    GbE LAN0/1

    100MbELAN0 port

    USB0/1 port

    USB2/3 port

    100MbE

    LAN1 port

    VHDM

    VHDM

    VHDM

    VHDM

    VHDM

    VHDM

    VHDM

    VHDM

    SFF-8484Connector

    Intel

    82563

    Intel

    82563

    Intel

    82551QM

    Intel

    82551QM

    ATI

    ES1000

    ATI

    ES1000

    KVMKVM

    LSI LogicSAS1068

    LSI LogicSAS1068

    Itanium2Itanium2

    Itanium2Itanium2

    MVRMVR

    MVRMVR

    Itanium2Itanium2

    Itanium2Itanium2

    MVRMVR

    MVRMVR

    40pin IDEConnector

    SIOSIO

    PanelConnector

    Main BoardMain Memory Board x4

    #0

    #1

    #2

    #3

    2

    3

    1

    FPGAFPGAH8S/

    2166

    H8S/

    2166

    Figure 1-15. Block diagram of the NovaScale 3045server

    Slot0

    Slot1Slot2Slot3Slot4Slot5Slot6

    SFF-8484Connector

    SFF-8484Connector

    HDD#0

    HDD#1

    HDD#2

    HDD#3

    HDD#4

    HDD#5

    HDD#6

    HDD#7SFF-8482Connector x8

    40pin IDEConnector

    DVDROM

    Drive

    PanelConnector

    LED&

    Switch

    HDDBackplane

    FrontPanelBoard

    1

    2

    3

    To/FromAdd-onSAS PCI Card

    USB4/5 port

  • 7/31/2019 86A704ET02

    42/308

    1-18 NovaScale 3025/3045 - Maintenance Guide

    The board set of the NovaScale 3025 consists of one main board, two memory box cards,one HDD backplane and one control panel board.The block diagram of the NovaScale 3025 is as follows:

    Figure 1-16. Block diagram of the NovaScale 3025server

    SFF-8484Connector

    SFF-8484Connector

    HDD#0

    HDD#1

    HDD#2

    HDD#3

    HDD#4

    HDD#5

    HDD#6

    HDD#7 SFF-8482Connector x8

    40pin IDEConnector

    DVDROM

    Drive

    PanelConnector

    LED&

    Switch

    HDDBackplane

    FrontPanelBoard

    1

    2

    3

    To/FromAdd-onSAS PCI Card

    USB4/5 port

    MCMC

    MCMC

    MCMC

    MCMC

    NodeController

    NodeController

    Intel

    6700

    PXH

    Intel

    6700

    PXH

    PCI-e x16 slotPCI-e x16 slot

    PCI-e x8 slotPCI-e x8 slot

    PCI-X 133MHz slotPCI-X 133MHz slot

    PCI-X 133MHz slotPCI-X 133MHz slot

    Intel

    ESB-2

    Intel

    ESB-2

    COM port

    VGA port

    GbE LAN0/1

    100MbELAN0 port

    100MbELAN1 port

    VHDM

    VHDM

    VHDM

    VHDM

    SFF-8484Connector

    Intel

    82563

    Intel

    82563

    Intel

    82551QM

    Intel

    82551QM

    ATI

    ES1000

    ATI

    ES1000

    KVMKVM

    LSI LogicSAS1068

    LSI LogicSAS1068

    Itanium2Itanium2

    Itanium2Itanium2

    MVRMVR

    MVRMVR

    40pin IDEConnector

    SIOSIO

    PanelConnector

    Main BoardMain Memory Board x4

    #0

    #1

    2

    3

    1

    FPGAFPGAH8S/

    2166

    H8S/

    2166

    USB0/1 port

    USB2/3 port

  • 7/31/2019 86A704ET02

    43/308

    Server Description 1-19

    Processor

    Socket0

    NDC0

    NDC1

    FAN0

    VHDM0

    PCI slot1

    PCI slot2

    PCI slot3

    PCI slot4

    PCI slot5

    PCI slot6

    PS0

    COM

    VGA

    GbE

    LAN0/1

    LAN0(Management)

    USB2/3

    USB0/1

    ESB2

    PXH

    Main Board

    LAN1(KVM)

    SAS

    VGA

    LANVHDM1

    VHDM2

    VHDM3

    ID SWFAN1

    FAN2

    FAN3

    FAN4

    FAN5

    LAN

    H8S

    MVR0/1

    MVR2/3

    ATA

    SAS

    SATA

    IPMB

    DEBUG

    KVM

    XDP

    FPGA

    ProcessorSocket1

    Processor

    Socket2

    ProcessorSocket3

    PANEL

    PS1

    VRAM

    Battery

    PANEL PWR

    P1

    P2

    P3

    P4

    P6

    P5

    P7

    P8

    P10

    P12

    P13

    P9

    E1

    E2

    E3

    E4

    E5

    E6

    C1

    C2

    C3

    C4

    C5

    C6

    C7

    C8

    C9

    C10

    C11

    C12

    C13

    C14

    C15 C16

    C17 C18

    C19 C20

    C21

    C22

    C23

    C24

    C25

    C26

    C27

    C28

    C29

    C30C31

    C32

    C33

    P14

    P15

    P16

    P17

    P18

    P19

    P20

    P21

    P22

    P23

    P24

    P25

    P26

    P27

    P28

    P29

    P30

    P31

    P32

    P33

    P11

    SuperIO

    7SEG

    Figure 1-17. Layout of the main board of NovaScale 3045

  • 7/31/2019 86A704ET02

    44/308

    1-20 NovaScale 3025/3045 - Maintenance Guide

    Figure 1-18. Layout of the main board of NovaScale 3025

    ProcessorSocket0

    NDC0

    FAN0

    VHDM0

    PCI slot1

    PCI slot2

    PCI slot3

    PCI slot6

    PS0

    COM

    VGA

    GbE

    LAN0(Management)

    USB2/3

    USB0/1

    ESB2

    PXH

    LAN1(KVM)

    SAS

    VGA

    LANVHDM1

    VHDM2

    VHDM3

    ID SWFAN1

    FAN2

    FAN3

    FAN4

    FAN5

    LAN

    H8S

    MVR0/1

    MVR2/3

    ATA

    SAS

    SATA

    IPMB

    DEBUG

    KVM

    XD

    P

    FPGA

    ProcessorSocket1

    PANEL

    PS1

    VRAM

    Battery

    PANEL PWR

    P1 P3

    P4

    P6

    P5

    P7

    P8

    P10

    P12

    P13

    P9

    E1

    E2

    E3

    E4

    E5

    E6

    C1

    C2

    C5

    C6

    C7

    C10

    C11

    C12

    C13

    C14

    C15 C16

    C17 C18

    C19 C20

    C21

    C22

    C23

    C24

    C25C26

    C27

    C28

    C29

    C30C31

    C32

    C33

    P14

    P15

    P16

    P17

    P20P21

    P22P23

    P24

    P27

    P28

    P29

    P30

    P33

    P11SuperIO

    7SEG

  • 7/31/2019 86A704ET02

    45/308

    Server Description 1-21

    # Component DescriptionP1/P2 Hitachi NDC Node Controller

    One Front Side Bus (FSB): 533/667 MHz FSB support ;Two processors per bus

    Four interfaces connecting to Memory Controller Three x8 PCI Express ports Proprietary high-speed interface to link between two

    Node Controllers Optimized design for 667 MHz FSB to achieve low

    memory access latency Broadcast-based cache coherence control to minimize

    snoop transaction

    P3 Intel ESB2 Enterprise South Bridge

    P4 Intel 6700PXH 64-bit PCI Hub PCI bridging functions between the PCI Express interface

    and the PCI Bus One PCI Express interface (primary bus) x8 and x4 modes operation Maximum 2 GB/s in each direction simultaneously Two PCI/PCI-X bus interfaces (secondary bus) PCI 2.3 compliant

    PCI-X 1.0 b compliant

    P5 Intel 82563 Physical Layer Transceiver (PHY) component designed for10/100/1000 Mbps operation IEEE 802.3 (10BASE-T), IEEE 802.3u (100BASE-TX),

    IEEE 802.3ab (1000BASE-T) Dual port

    P6 Intel82551QM

    Fast Ethernet PCI bus controller IEEE 802.3 (10BASE-T), IEEE 802.3u (100BASE-TX) 32-bit PCI bus master interface

    P7 ATI ES1000 Graphics Processing Unit for server 2D graphics accelerator PCI bus interface (PCI 2.2 compliant, 33 MHz)

    P8 VRAM 64 MB VRAM for ATI ES1000 Max resolution: Up to 1280 x 1024, 85 Hz Max color depth: Up to 32 bpp true color

  • 7/31/2019 86A704ET02

    46/308

    1-22 NovaScale 3025/3045 - Maintenance Guide

    # Component Description

    P9 LSI LogicSAS1068

    PCI-X to 3 Gb/s 8-port SAS controller (*1)1.5 and 3 Gb/s SAS and SATA data transfer rates per port,full duplex

    64-bit, 133 MHz PCI-X host interfaceIntegrated RAID support (*2)Fusion-MPT architectureIntegrated Striping technology (RAID0)Integrated Mirroring technology (RAID1)

    P10 H8S/2166 Base Management Controller (BMC)

    P11 SIO Super I/O

    P12 FPGA Management interface and shared memory extension bridge

    P13 Battery CMOS for the backup

    P14 ID SW LED in SW turns on -> blinks -> turns off per pressing of SW,which can be used for identifying a machine among many.

    P15-P20 PCI-X/e slotAttention SW

    SW to be used at Hot Swap. Refer to 2.11.4 for details.

    P21 7SEG LED Indicates Post Code

    P22-P27 PCI-X/e slotPower LED

    Refer to 1.3.6: PCI Card Slots

    P28-P33 PCI-X/e slotAttention LED

    Refer to 1.3.6: PCI Card Slots

    Table 1-5. Component list of the main board

    Note:

    (*1): The main board of the NovaScale 3045 uses only 4 ports out of 8.

    (*2): Fusion-MPT, Integrated Striping, and Integrated Mirroring are trademarks of LSI Logic Corporation.MPT stands for Message Passing Technology.

    # Connector DescriptionE1 Serial RS232C D-sub 9pin serial port

    E2 VGA Mini D-sub 15pin video port

    E3 USB 0/1/2/3 USB Type A port x4

    E4 GbE LAN 0/1 RJ45 LAN port x2

    E5 100 MbE LAN RJ45 LAN port x1

    E6 100 MbE LAN RJ45 LAN port x1

    Table 1-6. External I/O connector list of the main board

  • 7/31/2019 86A704ET02

    47/308

    Server Description 1-23

    # Connector DescriptionC1~C4 CPU 0/1/2/3 mPGA700 ZIF sockets

    C5/C8 PCI slot0/3 x8 PCI-e slots

    C6/C9 PCI slot1/4 x16 PCI-e slots

    C7/C10 PCI slot2/5 64-bit 133 MHz PCI-X slots

    C11~C14 VHDM 0/1/2/3

    C15~C20 FAN 0/1/2/3/4/5

    C21/C22 PS 0/1

    C23 SAS SFF-8484 (SAS internal x4 connector)

    C24 ATA 40pin IDE connector

    C25 PNL

    C26 PNLPW

    C27/C28 MVR0/1, MVR2/3

    C29 XDP

    C30 KVM

    C31 SATA

    C32 IPMB

    C33 DEBUG

    Table 1-7. Internal connector list of the main board

  • 7/31/2019 86A704ET02

    48/308

    1-24 NovaScale 3025/3045 - Maintenance Guide

    Figure 1-19. Layout of the memory box card

    # Component DescriptionP1/P2 MC0/2 Memory Controller

    P3 Mirror LED See Section 1.3.1.4Memory Box.P4 Attention LED See Section 1.3.1.4Memory Box.

    P5 Power LED See Section 1.3.1.4Memory Box.

    P6 Hot Swap Switch

    Table 1-8. Component list of the memory box card

    # Connector DescriptionC1 JD0B1 240pin DDR2 DIMM socket (MC0 channel A)

    C2 JD0B0 240pin DDR2 DIMM socket (MC0 channel A)

    C3 JD0A1 240pin DDR2 DIMM socket (MC0 channel B)

    C4 JD0A0 240pin DDR2 DIMM socket (MC0 channel B)

    C5 JD2B1 240pin DDR2 DIMM socket (MC1 channel A)

    C6 JD2B0 240pin DDR2 DIMM socket (MC1 channel A)

    C7 JD2A1 240pin DDR2 DIMM socket (MC1 channel B)

    C8 JD2A0 240pin DDR2 DIMM socket (MC1 channel B)

    C9 VHDM

    Table 1-9. Connector list of the memory box card

    Hot Swap SW

    Attention LED

    C4C3C2C1

    C5C6C7C8

    P3P4P5P6

    C9JD0A0JD0A1JD0B0JD0B1

    JD2B1JD2B0

    JD2A1JD2A0

    MC2 MC0 VHDM

    Mirror LED

    Power LED

  • 7/31/2019 86A704ET02

    49/308

    Server Description 1-25

    Top View

    Bottom View

    Figure 1-20. Layout of HDD backplane

    SAS0

    ATA

    PNL

    PNLP

    HDD0

    HDD1

    HDD2

    HDD3

    HDD4

    HDD5

    HDD6

    HDD7

    HM

    DLED0 DLED1 DLED2 DLED3 DLED4 DLED5 DLED6 DLED7

    SAS1

  • 7/31/2019 86A704ET02

    50/308

    1-26 NovaScale 3025/3045 - Maintenance Guide

    # Connector DescriptionC0 HDD0/1/2/3 SFF-8482 (SAS internal x1 connector)

    C1 HDD4/5/6/7 (*1) SFF-8482 (SAS internal x1 connector)

    C2 SAS0 SFF-8484 (SAS internal x4 connector)

    C3 SAS1 (*1) SFF-8484 (SAS internal x4 connector)

    C4 ATA 40pin IDE connector

    C5 PNL

    C6 PNLPW

    Note:

    (*1): This is available when additional SAS PCI Card is inserted into PCI slot.

    Table 1-10. List of connector of the HDD backplane

  • 7/31/2019 86A704ET02

    51/308

    Server Description 1-27

    Figure 1-21. Layout of the control panel board

    # Connector Description

    P1 Power Switch,Power LED

    See Section 1.3.1.1Control panel.

    P2 Reset Switch See Section 1.3.1.1Control panel.

    P3 SDINT (System Diagnostic Interrupt)Switch

    See Section 1.3.1.1Control panel.

    P4 Identification Switch,Identification LED

    See Section 1.3.1.1Control panel.

    P5 Power Fault LED See Section 1.3.1.1Control panel.

    P6 Cooling Fault LED See Section 1.3.1.1Control panel.

    P7 General Fault LED See Section 1.3.1.1Control panel.

    Table 1-11. Component list of the control panel board

    USB4

    USB5

    PowerSwitch / Power LED

    Reset Switch

    SDINT Switch

    Identification Switch / ID LED

    Power Fault LEDCooling Fault LEDGeneral Fault LED

    DVD

    HM

  • 7/31/2019 86A704ET02

    52/308

    1-28 NovaScale 3025/3045 - Maintenance Guide

    # Connector DescriptionC1 HM

    C2 DVD

    C3 USB4/5 USB Type A port x2

    Table 1-12. Connector list of the control panel board

  • 7/31/2019 86A704ET02

    53/308

    2-1

    -

    -

    -

    While swapping components, do not vibrate or impact equipment. Otherwise, failure mayoccur in the HDD.

    The following tools are required to perform the procedures described in this chapter:

    Phillips screw driver #2

    Flat head screw driver 5.5x75

    Cotton gloves

    Antistatic wrist strap

  • 7/31/2019 86A704ET02

    54/308

    2-2

    Make sure to detach (or attach) the flat cable assembly from (or to) the main boardaccording to the following instructions.

    Figure 2-1. How to Handle Flat Cable

    Hold both sides of the cable connector withthe same force using your fingers, anddetach (or attach) it straight from (or to) themain board.Make sure to hold both the connector and

    the cable.

    When detaching (or attaching) thecable, make sure to hold both sidesof the cable connector with the sameforce and keep it straight.

    Keepon a level

    Connector on

    the board

    Keepon a level

    CableConnector

    Pulling Tag

  • 7/31/2019 86A704ET02

    55/308

    2-3

    Do not detach (or attach) the cable in the following ways that can cause trouble with thecable connection.

    Figure 2-2. Improper Ways of Handling Flat Cables (1/2)

    Figure 2-3. Improper Ways of Handling Flat Cables (2/2)

    Connector onthe board

    Cableconnector

    Detaching (or attaching) the connectorobliquely can bend pins.

    Holding the cable alone andpulling it obliquely can causetrouble with the connection.

    Do not pull the pulling tag obliquely.

    Connector onthe board

    Cableconnector

    Pulling Tag

    Do not hold the pulling tagalone and ull the cable out.

    Do not crush the cable.

  • 7/31/2019 86A704ET02

    56/308

    2-4

    SAS connector*(2.23)

    PCI Cards (2.13)MVR connector*(2.24)

    IDE connector*(2.23)

    F