new server, EPYC 7351P based, hardware info

My significant other and I got ourselves a new home server.

You’ll notice that the motherboard is far from maxed out in our current build. That is quite intentional as we want the possibility of future expansion.

My installation notes, with regards to hardware, follow.

CPU

While the motherboard can accommodate Dual AMD EPYC™ 7000-Series Processors, we currently run it with one AMD EPYC 7351P 16-Core Processor only.

Yes, expanding to Dual CPU will mean removing the 7351P, since P models can only operate in a 1P configuration. But any CPU upgrade will anyway be to the generation after 7351P, 1P or 2P will be decided at the time of upgrade.

Note to self: be sure to flash mobo firmware update before installing a CPU model that was not yet released at the time of last flashing.

RAM

Each socket has 8 DIMM slots, we went with four 32 GB modules.

number description total
4 Samsung M393A4K40BB2-CTD 128 GiB

Motherboard

While I mostly see other vendors when I do my day job, Super Micro servers are used by some of the customers I get sent to. Personally I much prefer Super Micro machines, so as motherboard a H11DSi-NT was chosen.

update firmwares

on 2018-08-17 I went to the Super Micro resources for H11DSi-NT and followed the links

  • Update Your BIOS
  • IPMI Firmware

Re-flashing updated the versions to:

Firmware Revision 01.34
Firmware Build Time 06/05/2018
BIOS Version 1.1a
BIOS Build Time 05/02/2018
Redfish Version 1.0.1
CPLD Version 04.00.14

Original fan thresholds

Default values for all fans were identical for all fans. Values of one of them follow;

[root@guest01 ~]$ ipmitool -H supermicro-bmc -U ADMIN -f ~/.ipmi-supermicro-bmc -I lanplus sensor get FAN6
Locating sensor record...
Sensor ID              : FAN6 (0x46)
 Entity ID             : 29.6
 Sensor Type (Threshold)  : Fan
 Sensor Reading        : 1100 (+/- 0) RPM
 Status                : ok
 Lower Non-Recoverable : 300.000
 Lower Critical        : 500.000
 Lower Non-Critical    : 700.000
 Upper Non-Critical    : 25300.000
 Upper Critical        : 25400.000
 Upper Non-Recoverable : 25500.000
 Positive Hysteresis   : 100.000
 Negative Hysteresis   : 100.000
 Assertion Events      : 
 Assertions Enabled    : lcr- lnr- ucr+ unr+ 
 Deassertions Enabled  : lcr- lnr- ucr+ unr+ 

Case

The case is a LIAN LI, model PC-A79.

noise level

original fans

The fans LIAN LI included with the case were, as expected, too noisy for my taste.

Noctua replacement fans

I replaced the fans that came mounted in the case with 6 Noctua fans of type NF-S12A PWM connected to PWM headers on the motherboard and 1 of type NF-S12A FLX connected to a molex adapter.

Once the Noctua fans (all mounted with their included rubber pegs instead of screws) had replaced the factory fans from LIAN LI I and I adjusted the lower fan RPM thresholds and hunted down all sources of vibration of the case, the noise level of the server became much more bearable in my small home office.

Cooling Fan mappings

I’ve connected my fans as follows to the motherboard PWM connectors

connector location
FAN 1 roof exhaust rear fan
FAN 2 not connected
FAN 3 front bottom HDD fan
FAN 4 roof exhaust front fan
FAN 5 CPU fan
FAN 6 rear exhaust fan
FAN A front middle HDD fan
FAN B front top HDD fan
molex adapter side panel fan

I’ve opted to only connect one fan in the side panel, the lower one. The upper one would reach in the space where the CPU cooler is. I might move the fan on the CPU cooler at some point. For now the upper side panel opening is covered with cardboard.

While the side panel has a neat connector that automatically shuts the side panel fans off when it is removed, that connector has only 2 contacts. Since PWM uses 4 lead, I used the NF-S12A FLX there nd connected it with both the low noise adapter and a molex adapter.

Storage

NVMe SSD

Samsung 970 Pro M.2 2280 PCIe 3.0 x4 32Gb/s 3D MLC NAND (MZ-V7P1T0BW)

hard drives

3 Seagate IronWolf Pro NAS ST8000NE0004 7.200U/min 256MB 3.5” (8.9cm) SATA 6Gb/s One of them was dead on arrival and I’m awaiting a replacement drive.

TPM

Supermicro AOM-TPM-9655V TPM security module

Power Supply

850 Watt Enermax Revolution87+ Modular 80+ Gold

Optical Drive

Pioneer BDR-209EB Blu-ray BDXL Recorder, SATA, 16x/16x/40x