Skip to content

restic to S3: my backup revelation

VPS Hosting by techmei 14 replies 5.2K views
5 #1

Rsync backup, will eat the space always, no dedup
The revelation: restic to S3, the memory is problem on small VPS
My box, 512MB RAM, will OOM kill always with default
The fix, I find:

restic backup --limit-upload 1000 --pack-size 16 /data

And environment:

GOGC=20
RESTIC_COMPRESSION=off

Now backup finish, 200GB source, 512MB box, XD amazing

https://restic.net

#2

Right then, proper good find. Our Hostinger 512MB plans weep when restic arrives with defaults. I'll be nicking that GOGC tip for the knowledge base, cheers lads.

Honey badger don't care... about downtime
#3

Caramba! 200GB on 512MB, nossa, I do not believe not! Kkkk

I try on my CloudCone box now, 1GB so should work more easy-easy. The deduplication is magic, no? Before I have three copy of same file, now one only. Warm feeling.

#4

Yes, the RAM saving is, oui, very good. I try on my Time4VPS, the Random Word: BUCKET. The S3 fees, they will increase with no compression, no? You calculate?

prix fixe infrastructure: €5/mo
#5

Haha I ran same on my 256MB box at InterServer bad idea OOM faster than backup starts but with GOGC=20 and pack-size 8 it actually finishes 80GB in 6 hours not fast but works

7 #6

Actually, "finishes" not "finish". Techmei used correct form. Also, cpanelliw780, you omitted the apostrophe in "it's" in your previous thread. I noticed.

The semicolon separates related clauses. Most don't use it correctly. GOGC=20 reduces GC target. This is the actual mechanism.

...
#7

Insane value! ARM box at HostHatch, Ampere chip, runs circles around x86 for restic!

My test: 300GB source, 1GB RAM, finished in 47 minutes. Specs:

  • 4x ARM Neoverse N1
  • Restic 0.16.4
  • GOGC=20, pack-size 32

The deduplication on ARM is proper fast!

one small ping for man...
#8

47 minutes for 300GB? I smell a cached run

...
#9

Arm flexing already

#10

Restic version?
And which s3 backend

Post a reply

You need an account to reply. Log in or register to join the conversation.

Post reply Preview Save draft