# Datas uploaded again and again

**URL:** <https://kopia.discourse.group/t/datas-uploaded-again-and-again/253>\
**Category:** Support\
**Created:** [December 30, 2020, 5:47pm UTC](https://kopia.discourse.group/t/datas-uploaded-again-and-again/253 "2020-12-30T17:47:38Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![samuel](https://avatars.discourse-cdn.com/v4/letter/s/34f0e0/32.png) [@samuel](https://kopia.discourse.group/u/samuel)\
**Post date:** [December 30, 2020, 5:47pm UTC](https://kopia.discourse.group/t/datas-uploaded-again-and-again/253/1 "2020-12-30T17:47:38Z")

</div>

I made 5 snapshots from +/-500MB to 9.7GB.  
The smaller one gets uploaded almost instantaneously  
The 9.7GB always takes +/- 10min . Even If I do a snapshot right after the previous just ended.

```
$ kopia snapshot list
  2020-12-30 17:00:03 CET kb75d4e5b307e4758cda3f6e778ea040c 9.7 GB drwxr-xr-x files:61461 dirs:8134 (latest-3)
  + 2 identical snapshots until 2020-12-30 18:15:38 CET

```

as the snapshot list shows, the last 3 snapshots are identical. But they get uploaded everytime

may be I setup something wrongly. I tried without and with compression, same thing

When there’s a difference between snapshots , it takes 8-10mins to upload anyway, whatever the difference is

```
$ kopia diff kb75d4e5b307e4758cda3f6e778ea040c ke2d3d14b0e5e0e39c2b582a313236c31
. modification times differ: 2020-12-30 16:59:04.008512789 +0100 CET 2020-12-30 18:21:47.931794729 +0100 CET
added directory ./cli-logs
added directory ./content-logs

```

these newly added directories are empty

```
$ kopia --version
0.7.3 build: c3ade4b0ea7a1d20497fcfc4f4aec161f73c9505

```

I have fiber internet 20Mo/s (160mb/s) Up. 9.7Go datas takes approximately 00:08:20 to upload.

Any idea would be appreciated

---

<div class="post-metadata">

**Author:** ![jkowalski](https://yyz2.discourse-cdn.com/free1/user_avatar/kopia.discourse.group/jkowalski/32/3_2.png) [@jkowalski](https://kopia.discourse.group/u/jkowalski)\
**Post date:** [December 30, 2020, 6:34pm UTC](https://kopia.discourse.group/t/datas-uploaded-again-and-again/253/2 "2020-12-30T18:34:43Z")

</div>

That’s completely unexpected. Snapshots without change should be very fast.

Can you share a log of one of the uploads? (`content-logs` should not have any file names in it)

---

<div class="post-metadata">

**Author:** ![samuel](https://avatars.discourse-cdn.com/v4/letter/s/34f0e0/32.png) [@samuel](https://kopia.discourse.group/u/samuel)\
**Post date:** [December 30, 2020, 8:13pm UTC](https://kopia.discourse.group/t/datas-uploaded-again-and-again/253/3 "2020-12-30T20:13:23Z")

</div>

I only use the GUI so I had no logs nor informations.

I did a snapshot using the CLI and got this.

```
$ kopia snapshot create /home/user/Documents/
Snapshotting user@host:/home/user/Documents ...
 * 0 hashing, 0 hashed (0 B), 61595 cached (9.7 GB), 0 uploaded (0 B), 0 errors, estimated 9.7 GB (100.0%) 0s left   
Created snapshot with root k2b2ddaad14e4b1a09fc327add085fecb and ID 6ae71792b920d06d854853caca0b18f8 in 8m9s

```

So looks like nothing is uploaded but all the hashes checks take as much time as uploading everything. My Kopia repository server is distant. Does it only work on lan ?

---

<div class="post-metadata">

**Author:** ![jkowalski](https://yyz2.discourse-cdn.com/free1/user_avatar/kopia.discourse.group/jkowalski/32/3_2.png) [@jkowalski](https://kopia.discourse.group/u/jkowalski)\
**Post date:** [December 30, 2020, 10:31pm UTC](https://kopia.discourse.group/t/datas-uploaded-again-and-again/253/4 "2020-12-30T22:31:29Z")

</div>

Currently LAN is recommended because in repository serve mode, Kopia does not use local caching, which explains high latency. Cache is maintained at the server only and for directly-connected repositories, but not on clients that talk to API server…

Adding caching for clients should be actually relatively easy to do, can you file an issue on GitHub to track it?

---

<div class="post-metadata">

**Author:** ![budy](https://yyz2.discourse-cdn.com/free1/user_avatar/kopia.discourse.group/budy/32/38_2.png) [@budy](https://kopia.discourse.group/u/budy)\
**Post date:** [December 31, 2020, 4:08pm UTC](https://kopia.discourse.group/t/datas-uploaded-again-and-again/253/5 "2020-12-31T16:08:35Z")

</div>

I am very interested in client caching as well. What should the issue on GitHub cover? Only caching for clients which use the API or local caching for client which connect to a remote Kopia server? Or maybe two issues right away? 😉

---

<div class="post-metadata">

**Author:** ![jkowalski](https://yyz2.discourse-cdn.com/free1/user_avatar/kopia.discourse.group/jkowalski/32/3_2.png) [@jkowalski](https://kopia.discourse.group/u/jkowalski)\
**Post date:** [December 31, 2020, 4:27pm UTC](https://kopia.discourse.group/t/datas-uploaded-again-and-again/253/6 "2020-12-31T16:27:40Z")

</div>

It’s one thing. local caching for repo server clients.

---

<div class="post-metadata">

**Author:** ![samuel](https://avatars.discourse-cdn.com/v4/letter/s/34f0e0/32.png) [@samuel](https://kopia.discourse.group/u/samuel)\
**Post date:** [December 31, 2020, 4:32pm UTC](https://kopia.discourse.group/t/datas-uploaded-again-and-again/253/7 "2020-12-31T16:32:28Z")

</div>

Done ! 🙂 Thanks !!
