Speed up sync-to compare repo

Hello,

Kopia repository sync-to is a key keep offsite backups in sync while this task takes no time to compare source and destination for the first sync.

The sync-to compare operation takes lots of time for late resync depending on the size of the source repository. In case of small changes in the source repository few megabytes the comparison of the gigantic repository takes far longer time than downloading the changes to the destination.

Can something be done to improve comparison speed?

Regards,
Sd

Not sure what you mean. sync-to works fairly quickly for me (<1m even with changes to the original repo, although the changes to the original repo thus far for me have been <100mb). Have you checked your logs to see what is delaying it?

It would also help if you define what you mean by “far longer time”.

The line…

Found x BLOBS (x.xGB) in the source repository, xxxx (xxGB) to copy

This operation takes longer.
Using rclone remote.

I don’t know what you mean by “takes longer”. There are many variables that impact how long it takes to copy blobs to another repo. There isn’t a a known bug in sync-to that is slowing things down, if that is what you mean. Have you tried using the --parallel to increase parallelism? It is 1 by default. Increasing it should dramatically decrease sync-to time, just be careful not to overload your target as some may limit the amount of concurrent connections.

In my last test for sync-to

Sync-to for a repository size of 300 GB took 31mins with no changes in the source repository on a 100mbps link.
I really don’t know if that is normal…

With–parrallel=64

Can you share the log for this sync-to procedure? What you are describing sounds unusual.