Skip to content

Post your YABS results — megathread

VPS Hosting by SingaporeRep 113 replies 27.6K views
#81

Actually the Power consumption calculation is something that the people in this Thread seem to forget because when you run the old XeonE5 with DDR3 the electricitycost over three Years is actually more than the Hardwareprice itself so the Total costof ownership is going up and up and the cheapServer is not so cheap anymore because the Datacenter is charging you for every Kilowatthour and in Germany we know something about high Electricity prices believe me

2 #82

Maybe I should just redirect my whole budget to cloud you know. 52 boxes sounds nice but maybe the power bill is going to eat me alive you know.

Hankels how do you even manage all that. Maybe ansible maybe terraform maybe you just like suffering you know.

...

oops: 0000 [#1] SMP
#83

---
- deployment:
- location: Warsaw
- provider: Vultr
- NOTE: price/perf ratio declining
- alternatives:
- InterServer: competitive only in EU-West
- WARNING: GreenCloudVPS != Vultr (learned hard way)
- HostHatch: pending evaluation
---
- next_steps:
- migrate off E5 before DDR3 EOF
- test: Ampere Altra Q80-30

indentation is not optional
#84

52 boxes?? Man, this is crazy lol

My going to stick with one little Ryzen in Sao Paulo, going to keep it simple you know

zoekyo said:
52 boxes is not a homelab

Exactly that!! Lol going to need a second job just for the electricity bill

Hetzner going to expand to Brazil someday?? One can dream lol

chill infrastructure for chill people 🦫
#85

52 boxes and NOBODY is talking about the attack surface!!!

Every decommissioned Xeon is another ssh endpoint to harden, another fail2ban instance to tune, another firewall rule to verify. You think datacenter pulls come clean???

  • BMC backdoors from 2014 still unpatched
  • IDRAC default creds in resell chains
  • DDR3 ECC errors = potential rowhammer vectors

At minimum: airgap your management network!!!

# basic sanity
ufw default deny incoming
ufw allow from 10.0.99.0/24 to any port 22
airgapped, encrypted, faraday'd, still worried
#86

My friend!!! 52 boxes is very nice but my power bill going to make me cry!!!

I tought about tis many times!!! Here in istanbul my friend I have only 3 little xeons from university surplus!!! Very cheap only!!!

But electricity going up up up!!! So I made test with watt meter my friend!!! E5-2670 eating 95w idle!!! 95W!!!

Going to cloud maybe better for wallet you know!!! Hetzner have nice price my friend!!! Very nice!!!

Anyway I keep my 3 babies for learning only!!!

#87

Hetzner Istanbul vs Vultr Warsaw.

# Hetzner TR
fio: (R=343MB/s, W=298MB/s)
iperf3: 187 Mbps / 94 Mbps
geekbench: SC 687, MC 4123

# Vultr PL
fio: (R=412MB/s, W=389MB/s)
iperf3: 941 Mbps / 623 Mbps
geekbench: SC 1243, MC 8941

Price/perf winner: neither. Wait for OVHcloud AMS restock.

fio, iperf, geekbench. results or gtfo.
#88

1. Power consumption reality check: E5-2670 v2 TDP 115W, actual idle 45-65W with C-states enabled. @Izmir verify BIOS power management settings.

2. For 52-box deployments, consider:

  • IPMI 2.0 with dedicated NIC, VLAN-isolated
  • Ansible 2.15+ with vault-encrypted host_vars
  • Prometheus node_exporter for per-host watt tracking

3. Practical recommendation: Start with 3-node Proxmox cluster, expand only when utilization exceeds 70% sustained. Colocation in EU-East (Warsaw/Prague) currently offers best €/kW rack rates.

Kernel 6.6+ recommended for AMD P-state on Ryzen.

It's always DNS. Always.
#89

Just use ARM you cowards

Ampere Altra Max: 128 cores, 180W TDP. ONE BOX replaces your entire e5 graveyard. Skill issue if you can't find ARM builds.

garykwh said:
Ampere Altra actually decent for small models

Actually decent??? My Altra running 70B Q4 at 14 tok/sec. Your 52 xeons COMBINED do what, 3 tok/sec???

Just use llama.cpp with ARM_NEON. Or keep burning coal I guess 🐧

oops: 0000 [#1] SMP
#90

Let us return to sharing YABS results in a constructive manner.

It is my understanding that Vultr has introduced new storage tiers in Warsaw. If anyone has recent benchmarks, I would be most grateful for your sharing. I apologize for any inconvenience my observation may cause.

Post a reply

You need an account to reply. Log in or register to join the conversation.

Post reply Preview Save draft