Skip to content

Using rclone to sync 5 VPS to one storage backend

VPS Hosting by readerkrakw 25 replies 3.8K views
#21
sam_ams said:
OP said "Hetzner storage bucket"

I meant Object Storage yes. My bill is around €6-7 for ~400GB with some versioning. Not terrible but not Storage Box cheap either.

The S3 API is what let me use --fast-list. SFTP backend in rclone is painful without it, crawls directories one by one.

#22

Following this thread. Currently doing manual scp from 3 nodes to my home NAS, want to automate.

Is Hetzner Object Storage the consensus here or are people happy with Backblaze B2?

#23
Mark303 said:
Backblaze B2

B2 has free egress up to 3x your stored data monthly, but you pay for API calls. rclone with default settings will cost you in ListBuckets, ListObjects, etc. You need --fast-list and careful --transfers tuning or the API bill eats the storage savings.

Hetzner is simpler. One line item. German invoice, no calculator needed.

POLISH SERVERS. LOUD FANS. GOOD PRICE.
#24
rahul_astra said:
No cron needed just pool all teh disks

This is wrong though. Mergerfs pools disks, not servers. You still need something to present remote disks locally. That something is either SSHFS (slow, fragile) or rclone mount (same FUSE overhead, plus cache management).

So you still have cron or you still have mount daemons. Pick your complexity.

#25
marchhass said:
Pick your complexity

Exactly. I started this thread hoping someone had a magic "just pool them" solution and instead I am convinced my cron mess is the least worst option.

Might clean up the flags though. Adding --checksum to daily and dropping --transfers 1 since OVHcloud handles 4M fine.

#26
readerkrakw said:
Dropping --transfers 1

Finally. --transfers 1 with --bwlimit 2M is serializing what should be parallel. Your Contabo boxes might still choke but OVHcloud can definitely take 4 transfers at 2M each.

Test with --dry-run first. Nothing worse than a nullroute at 3 AM because you got confident.

phở at 3AM, deploy at 4

Post a reply

You need an account to reply. Log in or register to join the conversation.

Post reply Preview Save draft