Post your YABS results — megathread

It is my humble opinion that perhaps I should not post here, as my server is not so impressive as the others. Please forgive me for taking your time.

I am running a small Ryzen box in Tokyo for personal projects. It is my humble request that you do not compare it to the enterprise hardware above.

• Ryzen 5 5600X
• 32 GB DDR4
• 1x 1 TB NVMe
• 1 Gbps

Let us consider this a baseline for home lab enthusiasts. I am sorry for any inconvenience.

# ## ## ## ## ## ## ## ## ## ## ## ## ## ## ##
#              Yet-Another-Bench-Script              #
#                     v2024-06-25                   #
# ## ## ## ## ## ## ## ## ## ## ## ## ## ## ##

Basic System Information:
---------------------------------
Uptime     : 23 days, 11 hrs
Processor  : AMD Ryzen 5 5600X
CPU cores  : 6 @ 3700 MHz
AES-NI     : ✓ Enabled
VM-x/AMD-V : ✓ Enabled
RAM        : 31.2 GiB
Swap       : 2.0 GiB
Disk       : 931.5 GiB (ext4 872.3 GiB)
Distro     : Fedora Linux 40

fio Disk Speed Tests (Mixed R/W 50/50):
---------------------------------
Block Size | 4k            (IOPS) | 64k           (IOPS)
Read       | 485.6 MB/s  (121.4k) | 2.34 GB/s    (36.5k)
Write      | 487.2 MB/s  (121.8k) | 2.36 GB/s    (36.8k)
Total      | 972.8 MB/s  (243.2k) | 4.70 GB/s    (73.3k)

iperf3 Network Speed Tests:
---------------------------------
Provider    | Location           | Send Speed      | Recv Speed
Clouvider   | London, UK         | 912 Mbits/sec   | 928 Mbits/sec
Clouvider   | NYC, USA           : 867 Mbits/sec   | 874 Mbits/sec

I picked up one of Hetzner's Ampere Altra servers from the auction and it's been solid. The box I got is in Falkenstein, not Frankfurt — here's what I'm running:

• Ampere Altra Q64-26
• 256 GB DDR4 ECC
• 2x 3.84 TB NVMe
• 2x 10 Gbps redundant
• 99.99% SLA with published error budgets

Their support is ticket-only but the hardware's been reliable. No postmortems to share, I just needed something that could handle my client load without the usual cloud markup.

# ## ## ## ## ## ## ## ## ## ## ## ## ## ## ##
#              Yet-Another-Bench-Script              #
#                     v2024-06-25                   #
# ## ## ## ## ## ## ## ## ## ## ## ## ## ## ##

Basic System Information:
---------------------------------
Uptime     : 112 days, 19 hrs
Processor  : Ampere(R) Altra(R) Q64-26
CPU cores  : 64 @ 2600 MHz
AES-NI     : ✓ Enabled
VM-x/AMD-V : ✗ Disabled
RAM        : 251.8 GiB
Swap       : 0.0 KiB
Disk       : 3.8 TiB (ext4 3.5 TiB)
Distro     : Ubuntu 22.04.4 LTS

fio Disk Speed Tests (Mixed R/W 50/50):
---------------------------------
Block Size | 4k            (IOPS) | 64k           (IOPS)
Read       | 1.05 GB/s   (262.4k) | 5.12 GB/s    (80.0k)
Write      | 1.06 GB/s   (265.0k) | 5.15 GB/s    (80.4k)
Total      | 2.11 GB/s   (527.4k) | 10.27 GB/s   (160.4k)

iperf3 Network Speed Tests:
---------------------------------
Provider    | Location           | Send Speed      | Recv Speed
Clouvider   | London, UK         | 9.94 Gbits/sec  | 9.97 Gbits/sec
Clouvider   | NYC, USA           | 9.81 Gbits/sec  | 9.88 Gbits/sec

YABS attached for anyone comparing.

Brother FyreJun is working fine, no need for sorry. Tokyo box is good for learning.

I am hostting in bucharest now. Serwer is old but price is nice:-)

• 2x Xeon E5-2650L v3
• 64 Gb Ddr4 Ecc
• 2x 480 Gb Sata Ssd
• 1 Gbps

Network to asia is bad. To europe is okay. For backup server is enough.

# ## ## ## ## ## ## ## ## ## ## ## ## ## ## ##
#              Yet-Another-Bench-Script              #
#                     v2024-06-25                   #
# ## ## ## ## ## ## ## ## ## ## ## ## ## ## ##

Basic System Information:
---------------------------------
Uptime     : 34 days, 6 hrs
Processor  : Intel(R) Xeon(R) CPU E5-2650L v3
CPU cores  : 24 @ 1800 MHz
AES-NI     : ✓ Enabled
VM-x/AMD-V : ✓ Enabled
RAM        : 62.9 GiB
Swap       : 4.0 GiB
Disk       : 447.1 GiB (ext4 419.8 GiB)
Distro     : Debian GNU/Linux 11 (bullseye)

fio Disk Speed Tests (Mixed R/W 50/50):
---------------------------------
Block Size | 4k            (IOPS) | 64k           (IOPS)
Read       | 156.3 MB/s   (39.0k) | 387.4 MB/s    (6.0k)
Write      | 156.8 MB/s   (39.2k) | 389.1 MB/s    (6.0k)
Total      | 313.1 MB/s   (78.2k) | 776.5 MB/s   (12.1k)

iperf3 Network Speed Tests:
---------------------------------
Provider    | Location           | Send Speed      | Recv Speed
Clouvider   | London, UK         | 923 Mbits/sec   | 938 Mbits/sec
Clouvider   | NYC, USA           | 712 Mbits/sec   | 728 Mbits/sec

52 boxes now. This thread is dangerous for my wallet.

Ran numbers on the E5 resale market. $12/GB RAM if you buy whole decommed nodes, $18/GB if you part out. DDR3 still king for density per dollar but power math kills it past 3 year TCO.

My cheapest box by $/GB/RAM: $0.31/GB/month. Most expensive: $2.40/GB/month (looking at you, tokyo ryzen).

• 2x EPYC 7302
• 256 GB DDR4 ECC
• 4x 1.92 TB NVMe
• 10 Gbps

This one middle of pack at $0.78/GB/month. Helsinki, 18 months old, still solid.

# ## ## ## ## ## ## ## ## ## ## ## ## ## ## ##
#              Yet-Another-Bench-Script              #
#                     v2024-06-25                   #
# ## ## ## ## ## ## ## ## ## ## ## ## ## ## ##

Basic System Information:
---------------------------------
Uptime     : 78 days, 14 hrs
Processor  : AMD EPYC 7302 16-Core
CPU cores  : 32 @ 3000 MHz
AES-NI     : ✓ Enabled
VM-x/AMD-V : ✓ Enabled
RAM        : 251.8 GiB
Swap       : 0.0 KiB
Disk       : 7.5 TiB (ext4 7.0 TiB)
Distro     : Ubuntu 22.04.4 LTS

fio Disk Speed Tests (Mixed R/W 50/50):
---------------------------------
Block Size | 4k            (IOPS) | 64k           (IOPS)
Read       | 892.4 MB/s  (223.1k) | 4.56 GB/s    (71.2k)
Write      | 895.1 MB/s  (223.7k) | 4.59 GB/s    (71.7k)
Total      | 1.78 GB/s   (446.8k) | 9.15 GB/s    (142.9k)

iperf3 Network Speed Tests:
---------------------------------
Provider    | Location           | Send Speed      | Recv Speed
Clouvider   | London, UK         | 9.87 Gbits/sec  | 9.91 Gbits/sec
Clouvider   | NYC, USA           | 9.72 Gbits/sec  | 9.79 Gbits/sec

https://github.com/masonr/yet-another-bench-script

Anyone know which providers take XMR for these budget boxes?? Tired of leaving paper trails for my homelab spend 🪙

Hetzner looks nice but probably KYC hell. RackNerd used to, then stopped. OVHcloud maybe??

Simple is better

52 boxes is not a homelab. It is a data center with extra steps

Where is everyone finding these cheap E5 servers? I checked ebay and its like $200+ just for the cpu?

Am I looking in the wrong place? Thanks everyone!

@sarahjey your search query redirected to /dev/null by reseller markup

Pipe `decommissioned server` through `local auction` | `university surplus` | `datacenter pull`

DDR3 ECC reaching EOF soon anyway. Memory errors will pipe your data to the void

Kindly requesting your guidance: I am evaluating the Ryzen deployment in Kuala Lumpur itself. The power efficiency is good only, but the upstream provider is cheap only during off-peak hours. Has anyone observed packet loss during the monsoon season?

I am evaluating Hostinger and KnownHost for my use case. The support response time is important only.

Ngl these old xeons are hilarious for LLM inference. You need VRAM not clock speed lol

Tried running llama.cpp on a E5-2680 v3. 8 threads, 4GB model, 2 tok/sec. Pain.

Ampere Altra actually decent for small models. Hetzner's 128-core box? Overkill for inference, perfect for batch preprocessing tho