Actually the Power consumption calculation is something that the people in this Thread seem to forget because when you run the old XeonE5 with DDR3 the electricitycost over three Years is actually more than the Hardwareprice itself so the Total costof ownership is going up and up and the cheapServer is not so cheap anymore because the Datacenter is charging you for every Kilowatthour and in Germany we know something about high Electricity prices believe me
Post your YABS results — megathread
Maybe I should just redirect my whole budget to cloud you know. 52 boxes sounds nice but maybe the power bill is going to eat me alive you know.
Hankels how do you even manage all that. Maybe ansible maybe terraform maybe you just like suffering you know.
...
---
- deployment:
- location: Warsaw
- provider: Vultr
- NOTE: price/perf ratio declining
- alternatives:
- InterServer: competitive only in EU-West
- WARNING: GreenCloudVPS != Vultr (learned hard way)
- HostHatch: pending evaluation
---
- next_steps:
- migrate off E5 before DDR3 EOF
- test: Ampere Altra Q80-30
52 boxes?? Man, this is crazy lol
My going to stick with one little Ryzen in Sao Paulo, going to keep it simple you know
Exactly that!! Lol going to need a second job just for the electricity bill
Hetzner going to expand to Brazil someday?? One can dream lol
52 boxes and NOBODY is talking about the attack surface!!!
Every decommissioned Xeon is another ssh endpoint to harden, another fail2ban instance to tune, another firewall rule to verify. You think datacenter pulls come clean???
- BMC backdoors from 2014 still unpatched
- IDRAC default creds in resell chains
- DDR3 ECC errors = potential rowhammer vectors
At minimum: airgap your management network!!!
# basic sanity
ufw default deny incoming
ufw allow from 10.0.99.0/24 to any port 22
My friend!!! 52 boxes is very nice but my power bill going to make me cry!!!
I tought about tis many times!!! Here in istanbul my friend I have only 3 little xeons from university surplus!!! Very cheap only!!!
But electricity going up up up!!! So I made test with watt meter my friend!!! E5-2670 eating 95w idle!!! 95W!!!
Going to cloud maybe better for wallet you know!!! Hetzner have nice price my friend!!! Very nice!!!
Anyway I keep my 3 babies for learning only!!!
Hetzner Istanbul vs Vultr Warsaw.
# Hetzner TR
fio: (R=343MB/s, W=298MB/s)
iperf3: 187 Mbps / 94 Mbps
geekbench: SC 687, MC 4123
# Vultr PL
fio: (R=412MB/s, W=389MB/s)
iperf3: 941 Mbps / 623 Mbps
geekbench: SC 1243, MC 8941Price/perf winner: neither. Wait for OVHcloud AMS restock.
1. Power consumption reality check: E5-2670 v2 TDP 115W, actual idle 45-65W with C-states enabled. @Izmir verify BIOS power management settings.
2. For 52-box deployments, consider:
- IPMI 2.0 with dedicated NIC, VLAN-isolated
- Ansible 2.15+ with vault-encrypted host_vars
- Prometheus node_exporter for per-host watt tracking
3. Practical recommendation: Start with 3-node Proxmox cluster, expand only when utilization exceeds 70% sustained. Colocation in EU-East (Warsaw/Prague) currently offers best €/kW rack rates.
Kernel 6.6+ recommended for AMD P-state on Ryzen.
Just use ARM you cowards
Ampere Altra Max: 128 cores, 180W TDP. ONE BOX replaces your entire e5 graveyard. Skill issue if you can't find ARM builds.
Actually decent??? My Altra running 70B Q4 at 14 tok/sec. Your 52 xeons COMBINED do what, 3 tok/sec???
Just use llama.cpp with ARM_NEON. Or keep burning coal I guess 🐧
Let us return to sharing YABS results in a constructive manner.
It is my understanding that Vultr has introduced new storage tiers in Warsaw. If anyone has recent benchmarks, I would be most grateful for your sharing. I apologize for any inconvenience my observation may cause.