Skip to content

Major host suffers 3-day ransomware outage

Web Hosting by JokoNord 4 replies 238 views
3 #1

You all see this? Hetzner down since Friday, still not fully up. They say ransomware, encrypted backup servers too.

I made VPS with them last month for testing, now cannot access anything. Thank you very much sir to anyone who shares more news.

My real servers are at Contabo, but this makes me worried. How does ransomware get into backup system also? I thought backup is separate network.

https://status.hetzner.com

traffic worse than my packet loss
#2
JokoNord said:
How does ransomware get into backup system

Oh honey, that's the oldest story in the book. Did they test their restore? I'll bet they didn't. The 3-2-1 rule exists because of exactly this:

  • 3 copies of data
  • 2 different media types
  • 1 offsite and offline

If your "backup server" is just another VM on the same network with the same credentials, it's not a backup. It's a delay.

Someone on Twitter says their snapshot system was reachable from production VLAN. That's not architecture, that's hope.

3-2-1 or you're already dead
#3
bellaauc said:
Same credentials

This is the thing right there
They had their backup API keys in lastpass
The threat actor got the lastpass vault
Now they own everything
Even the airgapped stuff had credentials in the notes field
Because someone needed to remember the tape rotation schedule
Line breaks are free people
Use them

$3/year. 128MB RAM. Pure happiness.
#4
larryjeong said:
Lastpass

Oh wonderful (just wonderful) (I mean that in the most ironic way possible (which is my default state (ask anyone))) so we're doing this again (the password manager as single point of failure (not even self-hosted (not even Bitwarden (though that's not perfect either (nothing is))))) and of course the former employee (probably disgruntled (or justifiably angry (given how they were likely treated))) is the one revealing this (on Glassdoor no less (which is technically anonymous (but we all know how that goes (HR tracks everything))))

The class action was inevitable (lawyers love this stuff (contingency fees (very juicy (for them (not the customers (who'll get $12 and a free month)))))

push. done. coffee.
#5
annexbi said:
Class action

I knew this was coming and I have been warning people about Hetzner for years ever since 2019 when I signed up and their control panel was already slow and I remember that day specifically because I had oatmeal for breakfast with blueberries and my cat Mr. whiskers sat on the keyboard while I was trying to log in and the weather was rainy which should have been a sign and I told everyone in the forum then that their backup story didn't add up and nobody listened and now look where we are and I have screenshots of everything including the tweet where their CEO said "enterprise-grade redundancy" in 2021 and I knew that was a lie because enterprise grade means nothing it's just marketing speak and I bet they were running Windows server 2012 r2 on those backup boxes because someone told me in a discord once and I saved that too and the worst part is I had a client who insisted on using them and I couldn't stop them and now they're calling me at 2 am and I have to pretend I didn't warn them which I did but they forgot and now the class action lawyers are circling like sharks and I hope they take everything but they won't the CEO will get a golden parachute and the customers get nothing Mark my words I have seen this before with three other hosts and I document everything

Post a reply

You need an account to reply. Log in or register to join the conversation.

Post reply Preview Save draft