haroldgsm
Member
Grumpy Old Sysadmin
- Joined:
- May 2024
- Posts:
- 329
- From:
- Ohio, US
Please to share Improvements
Back when we ran bare metal, SMART was gospel. Kids these days rent black boxes and pray. 20 years in this business, I have seen two providers silently migrate degraded arrays and only announce it after customer data evaporated. Your checksum approach is sensible but insufficient. Mark my words: the next evolution will be providers offering blockchain-verified integrity proofs at extra cost, and everyone will pay because the alternative is blind trust. The real fix is owning your physical layer, but that ship sailed for this market segment.
IPv4, IRC, and irssi — fight me
carlos2
Member
- Joined:
- Jun 2024
- Posts:
- 158
- From:
- Medellín, CO
Asking for a friend who wants that physical layer
Seriously though, Leaseweb has an API endpoint for storage health, undocumented but I found it
curl https://api.leaseweb.com/v1/disk/status
Returns json with synthetic health score. Not SMART but better than nothing. Privacy coins accepted btw
not your keys, not your coins
olespete
Member
Trust No One
- Joined:
- Jun 2024
- Posts:
- 270
- From:
- Unknown
Two providers or two arrays
airgapped, encrypted, faraday'd, still worried
haroldgsm
Member
Grumpy Old Sysadmin
- Joined:
- May 2024
- Posts:
- 329
- From:
- Ohio, US
Two providers or two arrays
Two providers. One in 2011, one in 2019. First was a "premium" cPanel host that shall not be named, second was a European brand that got acquired and asset-stripped. Both times the migration happened during a "routine maintenance" window, both times the degraded source array threw unrecoverable read errors that the hypervisor passed straight through as silent corruption. My checksums caught it on restore, not on live data. That's the gap frankfurt_ops's monthly diff won't close: you only know after the damage is done.
IPv4, IRC, and irssi — fight me
olespete
Member
Trust No One
- Joined:
- Jun 2024
- Posts:
- 270
- From:
- Unknown
Keep three rotating checksum files on a separate provider
Paranoid. Correct. I do the same with rsync to a BuyVM slab in Luxembourg. Different ASN, different power grid, different everything. The checksum file is 4MB for 800GB of data, trivial to move.
airgapped, encrypted, faraday'd, still worried