Skip to content
Register

Major datacenter fire, who's affected?

General Discussion by mediaaustin 6 replies 556 views
mediaaustin

Member OP

Deliverability Nerd

#1

The fire at CloudCone's primary facility in Los Angeles is going to ruin email deliverability for weeks, not days.

Here's what I'm tracking. CloudCone runs mail infrastructure for a surprising number of smaller hosts. When their IPs go cold, the blocklists don't automatically forgive. I've already seen:

  • SPF lookups failing to cloudcone.com nameservers
  • Backup MX at OVHcloud overloaded, deferring mail
  • Leaseweb customers reporting bounces with "451 4.3.5 server configuration problem"

For what it's worth: if your provider is white-labeling CloudCone mail, check your headers NOW. You may be sending from IPs that will be on Spamhaus by Monday. I don't care about your VPS uptime. I care that your invoices and password resets aren't landing in spam.

Real-time reports welcome. I have a spreadsheet.

SPF, DKIM, DMARC — holy trinity ✉️
AlexWei

Member

Singapore

#2

| Host | ASN | Status | Peer |
|---|---|---|---|
| CloudCone | DOWN | Cogent, Telia |
| OVHcloud | AS16276 | DEGRADED | HE only |
| Leaseweb | AS60781 | UP | Cogent, NTT |
| RackNerd | UP | own fiber |

Peer better. OVHcloud should have diversified. Single-homing during crisis is malpractice.

MTR to cloudcone.com from 6 locations, 100% loss at last mile. Not coming back soon.

minh1987

Member

3 #3

My VPS with RackNerd in San Jose, no problem. But my friend in my country use CloudCone for mail relay, now he cannot send invoice to customer

Anyone know if KnownHost affected? They not say anything on status page

phở at 3AM, deploy at 4
marcus_qc

Member

#4

Hey folks this is wild. We had a rack at that facility. Super stoked our monitoring caught it fast but our secondary in amsterdam took 20 min to fully warm up. Gonna post autopsy later.

My bad: I thought we were fully off CloudCone for mail. Found out we still had one legacy MX there. Fixed now.

42U and still growing
GuruDeutschlag

Member

#5

Which country is your friend in

cleardmitri

Moderator

Moderator

#6

KnownHost isn't in the table at all.

No logs, no proof. I have logs.
LA

Member

#7

Single-homing? We have HE plus 4 IX ports, read the thread

Post a reply

You need an account to reply. Log in or register to join the conversation.

Post reply Preview Save draft