Getting my Unraid backup setup using Kopia. I’m using rclone with sftp. My backup destination resides on Raspi with a USB 3.0 spinning disk. The backup seemed to go a decent speed but restores are painfully slow (like 100kb/s). Where am I going wrong? Using the docker UI version.
Super new to Kopia, and coming from Duplicacy.
I suspect that problem is rclone. More precisely rclone/kopia combo. Have had exactly the same experience. Rclone support is experimental.
Either use something supported natively by kopia - like S3 which you can get using minio. Or install kopia server on your raspberry Pi - it will be much faster than sftp (which is terrible protocol for such purpose).
Thanks for the quick reply! I think most of that makes sense. So am I understanding that I can install Kopia on the raspi and link Kopia docker UI version (I mistyped and put CLI in my op, but meant UI) on my Unraid server to the raspi install? Or how would the Kopia install on the raspi access the unraid files?
install kopia server on RPi:
And on client(s) connect to server:
Another advantage of such setup is that you can run time and network bandwidth consuming tasks like full maintenance etc. on your server and let clients only worry about backing up (and restore)
Also note that backing up will always go at a higher pace, since drives are designed to optimize writes. However, reading from drives, which involves a lot of searching, will always be slower, even on the most modern drives. Especially, as the drives become filled, reading random data will always come with a penalty.
Thanks everyone! Looks like an easy setup that was right in front of me the whole time!
So I got everything setup and working, but man is it slow just on the backing up side of things. A lot slower than it was on SFTP. I have about 10tb of data. Running a 1gig network, but I’m only seeing about 80mbps used. Any thoughts? CPU on client and server aren’t pegged. Between 40-60% usage. Disks are showing very small reads and writes. 18mb/s etc…
I tried some different numbers on Maximum Parallel Snapshots and Maximum Parallel File reads, but didn’t really seem to make a difference.
Sorry for the noob questions. Certainly a rookie here.
Which Raspberry Pi version are you using? Earlier versions had serious performance issues because Ethernet and USB were sharing a controller.
Possible that raspberry pi has some performance bottlenecks making it not the best choice for kopia server. What exactly it is hard to say. Maybe lack of encryption hardware support (all models before raspi 5)? Maybe something else. Overall it is fantastic little computer but it has clear limits.
Myself I would also try to use raspi as S3 storage - minio should not have any special requirements for basic setup.
Running a 4b, 2gb, Bookworm, and Kopia running on docker. You think running native Kopia app on Linux would make any difference?
I did try the s3 method before using Kopia server. It was equally slow. I’m not sure what the cause. Could be the docker layer. I may try using the native Kopia app and see where that gets me.
Performance on the 4b model was significantly improved - so this should not be the cause. As you mention 2GB of RAM I’m starting to wonder what your RAM usage looks like. Do you have swap enabled?
I do have swap enabled. I just did a speedtest.net test from the pi and I was getting about 60mbps. I think that’s my prob. I’ll have to do some digging and see what the bottleneck is.
Thanks everyone for your suggestions!
