Skip to content

72 hours without cooling during regional heat dome

Datacenter Talk by brusselsdzire1 13 replies 1.7K views
#11
brusselsdzire1 said:
Replaced with a spare I had in the shipping cage

Frankfurt here. This is why I keep telling my old colleagues: the shipping cage is part of the redundancy plan. Leaseweb Frankfurt has the same Delta PSUs in their rental stock, but the turnaround on a cold spare during a heat event is 4-6 hours if you're lucky.

I read tickets for a living now. The number of "urgent" colo clients who keep zero spares on site and then act surprised when SLA means "we start driving" not "we teleport" is depressing.

Your 72 hours is exceptional. Most facilities in DE would have hit thermal shutdown on the chillers at 35C ambient, never mind 45C.

Single mode till I die 💀
3 #12
kate3 said:
The virtualization tax on those E5 v2s is brutal

Sure, but I'm not running a cloud provider. I'm running Plex, a few web apps, and a Matrix server for friends. The "tax" is maybe 10W at idle on a system that draws 180W anyway. My garage stays under 30C because I actually ventilate it, unlike a Fresno warehouse with a single chiller loop.

The real tax is paying Leaseweb 200 EUR a month for 14U when I own my gear outright. At 3 years that's 7200 EUR, which buys a lot of window AC units and disk replacements.

reykjavik_doc said:
Systemd-nspawn with less overhead

I tried nspawn. The networking story is miserable compared to docker-compose. I have 23 services across 6 projects. I'm not writing custom network units for that.

my cloud. my rules. my 3AM alerts.
#13

Singapore here. Leaseweb Singapore runs warm year round, ambient in the hall is usually 26-28C. We don't get heat domes but the humidity is the killer, condensation on the cold aisle doors every monsoon season.

I keep two Dell R640s there, still under warranty though. The iDRAC thermal graphs are public to my monitoring. Never seen ambient over 30C in three years.

Fresno not on their listed datacenters though, edge location maybe?

2 #14
brusselsdzire1 said:
Zero reallocated, zero pending

Good, good. But check again in one month, no? The heat stress can accelerate the wear, the SMART is not always immediate, no?

My KnownHost story, the disks looked fine, then BAM, two weeks later the reallocated sectors start growing, no? Like popcorn, no?

The Seagate EXOS are good disks, but 34,000 hours is a lot of hours, no? The heat dome was maybe the last push, no?

I am happy your data is safe, but I am watching this thread, no?

Post a reply

You need an account to reply. Log in or register to join the conversation.

Post reply Preview Save draft