# Speed up sync-to compare repo **URL:** \ **Category:** General\ **Created:** [June 18, 2022, 4:56am UTC](https://kopia.discourse.group/t/speed-up-sync-to-compare-repo/1225 "2022-06-18T04:56:58Z")\ **Posts on this page:** 10\ **Page:** 1
**Author:** ![saviodsouza](https://yyz2.discourse-cdn.com/free1/user_avatar/kopia.discourse.group/saviodsouza/32/50_2.png) [@saviodsouza](https://kopia.discourse.group/u/saviodsouza)\ **Post date:** [June 18, 2022, 4:56am UTC](https://kopia.discourse.group/t/speed-up-sync-to-compare-repo/1225/1 "2022-06-18T04:56:58Z")
Hello, Kopia repository sync-to is a key keep offsite backups in sync while this task takes no time to compare source and destination for the first sync. The sync-to compare operation takes lots of time for late resync depending on the size of the source repository. In case of small changes in the source repository few megabytes the comparison of the gigantic repository takes far longer time than downloading the changes to the destination. Can something be done to improve comparison speed? Regards, Sd ---
**Author:** ![basldfalksjdf](https://avatars.discourse-cdn.com/v4/letter/b/ce73a5/32.png) [@basldfalksjdf](https://kopia.discourse.group/u/basldfalksjdf)\ **Post date:** [June 18, 2022, 5:21am UTC](https://kopia.discourse.group/t/speed-up-sync-to-compare-repo/1225/2 "2022-06-18T05:21:53Z")
Not sure what you mean. `sync-to` works fairly quickly for me (\<1m even with changes to the original repo, although the changes to the original repo thus far for me have been \<100mb). Have you checked your logs to see what is delaying it? It would also help if you define what you mean by “far longer time”. ---
**Author:** ![saviodsouza](https://yyz2.discourse-cdn.com/free1/user_avatar/kopia.discourse.group/saviodsouza/32/50_2.png) [@saviodsouza](https://kopia.discourse.group/u/saviodsouza)\ **Post date:** [June 18, 2022, 5:52am UTC](https://kopia.discourse.group/t/speed-up-sync-to-compare-repo/1225/3 "2022-06-18T05:52:32Z")
The line… Found x BLOBS (x.xGB) in the source repository, xxxx (xxGB) to copy This operation takes longer. Using rclone remote. ---
**Author:** ![basldfalksjdf](https://avatars.discourse-cdn.com/v4/letter/b/ce73a5/32.png) [@basldfalksjdf](https://kopia.discourse.group/u/basldfalksjdf)\ **Post date:** [June 18, 2022, 6:19am UTC](https://kopia.discourse.group/t/speed-up-sync-to-compare-repo/1225/4 "2022-06-18T06:19:12Z")
I don’t know what you mean by “takes longer”. There are many variables that impact how long it takes to copy blobs to another repo. There isn’t a a known bug in `sync-to` that is slowing things down, if that is what you mean. Have you tried using the `--parallel` to increase parallelism? It is 1 by default. Increasing it should dramatically decrease `sync-to` time, just be careful not to overload your target as some may limit the amount of concurrent connections. ---
**Author:** ![saviodsouza](https://yyz2.discourse-cdn.com/free1/user_avatar/kopia.discourse.group/saviodsouza/32/50_2.png) [@saviodsouza](https://kopia.discourse.group/u/saviodsouza)\ **Post date:** [June 18, 2022, 5:07pm UTC](https://kopia.discourse.group/t/speed-up-sync-to-compare-repo/1225/5 "2022-06-18T17:07:51Z")
In my last test for sync-to Sync-to for a repository size of 300 GB took 31mins with no changes in the source repository on a 100mbps link. I really don’t know if that is normal… With–parrallel=64 ---
**Author:** ![basldfalksjdf](https://avatars.discourse-cdn.com/v4/letter/b/ce73a5/32.png) [@basldfalksjdf](https://kopia.discourse.group/u/basldfalksjdf)\ **Post date:** [June 18, 2022, 8:01pm UTC](https://kopia.discourse.group/t/speed-up-sync-to-compare-repo/1225/6 "2022-06-18T20:01:27Z")
Can you share the log for this `sync-to` procedure? What you are describing sounds unusual. ---
**Author:** ![saviodsouza](https://yyz2.discourse-cdn.com/free1/user_avatar/kopia.discourse.group/saviodsouza/32/50_2.png) [@saviodsouza](https://kopia.discourse.group/u/saviodsouza)\ **Post date:** [July 19, 2022, 5:09am UTC](https://kopia.discourse.group/t/speed-up-sync-to-compare-repo/1225/7 "2022-07-19T05:09:29Z")
Sorry for the big delay here is the log ```auto 2022-07-02T11:26:20.275606Z DEBUG cache finished sweeping {"cache": "metadata", "duration": "504.5µs", "totalRetainedSize": 0, "tooRecentBytes": 0, "tooRecentCount": 0, "maxSizeBytes": 5242880000, "inUsePercent": 0} 2022-07-02T11:26:20.276309Z DEBUG cache finished sweeping {"cache": "contents", "duration": "504.5µs", "totalRetainedSize": 0, "tooRecentBytes": 0, "tooRecentCount": 0, "maxSizeBytes": 5242880000, "inUsePercent": 0} 2022-07-02T11:26:20.276979Z DEBUG cache finished sweeping {"cache": "index blob cache", "duration": "1.877ms", "totalRetainedSize": 0, "tooRecentBytes": 11844031, "tooRecentCount": 41, "maxSizeBytes": 5242880000, "inUsePercent": 0} 2022-07-02T11:27:20.289152Z DEBUG cache finished sweeping {"cache": "metadata", "duration": "573.5µs", "totalRetainedSize": 0, "tooRecentBytes": 0, "tooRecentCount": 0, "maxSizeBytes": 5242880000, "inUsePercent": 0} 2022-07-02T12:37:21.129329Z DEBUG cache finished sweeping {"cache": "metadata", "duration": "546µs", "totalRetainedSize": 0, "tooRecentBytes": 0, "tooRecentCount": 0, "maxSizeBytes": 5242880000, "inUsePercent": 0} 2022-07-02T12:37:21.129329Z DEBUG cache finished sweeping {"cache": "contents", "duration": "1.1966ms", "totalRetainedSize": 0, "tooRecentBytes": 0, "tooRecentCount": 0, "maxSizeBytes": 5242880000, "inUsePercent": 0} 2022-07-02T12:37:21.368705Z DEBUG cache finished sweeping {"cache": "index blob cache", "duration": "2.1434ms", "totalRetainedSize": 0, "tooRecentBytes": 11844031, "tooRecentCount": 41, "maxSizeBytes": 5242880000, "inUsePercent": 0} ``` I find a lot of time going in sweeping starts at 11:26;20 goes upto 12:37:21. Then getblob beings ends around 12:56:11 I can’t upload the full log file here… Regards, Savio D’souza ---
**Author:** ![basldfalksjdf](https://avatars.discourse-cdn.com/v4/letter/b/ce73a5/32.png) [@basldfalksjdf](https://kopia.discourse.group/u/basldfalksjdf)\ **Post date:** [July 19, 2022, 2:18pm UTC](https://kopia.discourse.group/t/speed-up-sync-to-compare-repo/1225/8 "2022-07-19T14:18:17Z")
The slowness of the process may be related to your hardware. Are you running HDDs or SSDs? ---
**Author:** ![saviodsouza](https://yyz2.discourse-cdn.com/free1/user_avatar/kopia.discourse.group/saviodsouza/32/50_2.png) [@saviodsouza](https://kopia.discourse.group/u/saviodsouza)\ **Post date:** [August 4, 2022, 1:01pm UTC](https://kopia.discourse.group/t/speed-up-sync-to-compare-repo/1225/9 "2022-08-04T13:01:24Z")
Source is Rclone remote onedrive Destination local HDD swapping is happening on rclone remote… ---
**Author:** ![basldfalksjdf](https://avatars.discourse-cdn.com/v4/letter/b/ce73a5/32.png) [@basldfalksjdf](https://kopia.discourse.group/u/basldfalksjdf)\ **Post date:** [August 4, 2022, 5:23pm UTC](https://kopia.discourse.group/t/speed-up-sync-to-compare-repo/1225/10 "2022-08-04T17:23:23Z")
> [@saviodsouza](#): > > Destination local HDD My guess is that this is why. HDDs are notoriously slow. Also, OneDrive via Rclone can also be slow because OneDrive has API limitations that it puts on non-business accounts (and Rclone itself also adds some delay to the whole process as compared to use a native Kopia repo). Also, you said you used `--parallel=64`. That may be too much for your HDD to handle. Perhaps something lower, like 5 or 10 or leave it at the default setting.