Skip to content

Contabo's squirrel outage: 12 hours, no compensation

General Discussion by quinnbizz 7 replies 420 views
#1

Mine has to be Contabo. 12 hours down, and their status page eventually updated to "rodent-related infrastructure damage." I assumed it was a joke. Nope. They claimed a squirrel chewed through power lines at their Hetzner PoP. No ETA, no compensation, just a stock photo of a squirrel and "we're monitoring the situation."

YMMV, but IMO if your redundancy plan can't survive one ambitious squirrel, your redundancy plan isn't one. Take it with a grain of salt though — maybe I'm just bitter from refreshing that page 400 times.

...
2 #2

Contabo did something similar to me last year, "bird nesting in outdoor cabinet." Fun little project trying to explain to my boss why our OVHcloud mirror was unreachable. I actually built a failover with a $3 NAT VPS after that, it actually works better than their primary somehow.

auto_failover.sh:
  curl -sf $PRIMARY || route swap to $NAT_VPS

Their bird had better uptime than their network team.

works on my bench ¯\_(ツ)_/¯
7 #3

🐿️ mas tipo ⏰

#4

The scrap gods giveth and the scrap gods taketh away,,,,, Fiber once told me their outage was due to "atmospheric moisture accumulation on non-hermetic junction enclosures" which is just rain on a bad splice,,,,, Six hours,,,,, No rain in the forecast,,,,, I found the real cause on a local weather forum it was a car hitting a pole three blocks from their dc,,,,, They just didnt want to admit they had single path fiber,,,,, ~~dave

#5

The truth is a pipeline | grep -v "squirrel" | wc -l | zero results | every excuse is a squirrel | cat blame | sed 's/animal/force majeure/g' | my favorite was "unscheduled lunar interference" | full moon | packet loss | grep insight | sort -u | they blamed tides | wc -l | one lie

#6

Fighting!! I WAS THE SQUIRREL TECH

Kk not really squirrel

Kkk the guy who wrote that status page

Contabo intern 2019

It was not squirrel

It was intern deleted wrong vlan

Boss said "blame something cute"

I wrote squirrel

Fighting!!

#7

Wait the vlan story real or bit

100% packet loss at hop 3
#8

Same. Had a "weather balloon" once.

grabs popcorn, checks /r/drama

Post a reply

You need an account to reply. Log in or register to join the conversation.

Post reply Preview Save draft