# Another invalid checksum

**URL:** <https://kopia.discourse.group/t/another-invalid-checksum/1255>\
**Category:** Support\
**Created:** [July 5, 2022, 1:58pm UTC](https://kopia.discourse.group/t/another-invalid-checksum/1255 "2022-07-05T13:58:02Z")\
**Posts on this page:** 10\
**Page:** 1

<div class="post-metadata">

**Author:** ![manfredlotz](https://yyz2.discourse-cdn.com/free1/user_avatar/kopia.discourse.group/manfredlotz/32/175_2.png) [@manfredlotz](https://kopia.discourse.group/u/manfredlotz)\
**Post date:** [July 5, 2022, 1:58pm UTC](https://kopia.discourse.group/t/another-invalid-checksum/1255/1 "2022-07-05T13:58:02Z")

</div>

I have a kopia repository on pCloud and when doing `kopia maintenance un --full` I get

```auto
2022-07-05T12:27:41.045817+02:00 Rewriting contents from short packs...
2022-07-05T12:28:20.497298+02:00 unable to rewrite content "b4b977f5adeb7096b499b09fcf991c5b": unable to get content data and info: invalid checksum at pef1fadaf23dee5217e577debf3a5cc81-sbbb06912f257eb53111 offset 7797637 length 3152/3152: decrypt: unable to decrypt content: cipher: message authentication failed
2022-07-05T12:28:20.499827+02:00 unable to rewrite content "f3c5e6f6ebbcabeafca6278560b6f400": unable to get content data and info: invalid checksum at pef1fadaf23dee5217e577debf3a5cc81-sbbb06912f257eb53111 offset 7800789 length 40/40: decrypt: unable to decrypt content: cipher: message authentication failed
2022-07-05T12:28:31.237874+02:00 Finished full maintenance.
2022-07-05T12:28:31.548228+02:00 ERROR error rewriting contents in short packs: failed to rewrite 2 contents

```

`kopia content verify` runs ok

Running, for example, `sha256sum daf23dee5217e577debf3a5cc81-sbbb06912f257eb53111.f` works.

What can I do?

---

<div class="post-metadata">

**Author:** ![basldfalksjdf](https://avatars.discourse-cdn.com/v4/letter/b/ce73a5/32.png) [@basldfalksjdf](https://kopia.discourse.group/u/basldfalksjdf)\
**Post date:** [July 5, 2022, 4:47pm UTC](https://kopia.discourse.group/t/another-invalid-checksum/1255/2 "2022-07-05T16:47:14Z")

</div>

> [@manfredlotz](#):
>
> `kopia content verify` runs ok

You need to run `kopia snapshot verify --verify-files-percent=100` if you want to test for corrupt blobs and then `kopia snapshot fix invalid-files --verify-files-percent=100` to try to fix the blobs. `kopia content verify` will not identify corrupt blobs. See [Best method to ensure valid snapshots: snapshot verify vs snapshot fix invalid-files - #2 by jkowalski](https://kopia.discourse.group/t/best-method-to-ensure-valid-snapshots-snapshot-verify-vs-snapshot-fix-invalid-files/1217/2).

---

<div class="post-metadata">

**Author:** ![manfredlotz](https://yyz2.discourse-cdn.com/free1/user_avatar/kopia.discourse.group/manfredlotz/32/175_2.png) [@manfredlotz](https://kopia.discourse.group/u/manfredlotz)\
**Post date:** [July 6, 2022, 5:29am UTC](https://kopia.discourse.group/t/another-invalid-checksum/1255/3 "2022-07-06T05:29:59Z")

</div>

Thanks a lot @basldfalksjdf . After the verify you gave, I started `kopia snapshot fix invalid-files --verify-files-percent=100`.

Now running for 11.5 hours. I think my organization with a large repository in pCloud, it has around 2TB, is wrong. Have to split into multiple repos I guess.

---

<div class="post-metadata">

**Author:** ![basldfalksjdf](https://avatars.discourse-cdn.com/v4/letter/b/ce73a5/32.png) [@basldfalksjdf](https://kopia.discourse.group/u/basldfalksjdf)\
**Post date:** [July 6, 2022, 5:58am UTC](https://kopia.discourse.group/t/another-invalid-checksum/1255/4 "2022-07-06T05:58:10Z")

</div>

> [@manfredlotz](#):
>
> I think my organization with a large repository in pCloud, it has around 2TB, is wrong. Have to split into multiple repos I guess.

I don’t know the specifics about pCloud, and it is possible that pCloud cannot support such large repositories. However, Kopia should have no problems with a 2TB repo. Maybe try a different cloud storage?

---

<div class="post-metadata">

**Author:** ![manfredlotz](https://yyz2.discourse-cdn.com/free1/user_avatar/kopia.discourse.group/manfredlotz/32/175_2.png) [@manfredlotz](https://kopia.discourse.group/u/manfredlotz)\
**Post date:** [July 6, 2022, 7:08am UTC](https://kopia.discourse.group/t/another-invalid-checksum/1255/5 "2022-07-06T07:08:02Z")

</div>

Kopia is fine I know.

My point is that in case I need to run above command it takes awfully long with such a large repository.

This is the same with other cloud providers and might be dependent upon the bandwidth one has. In my case 50Mit/s.

---

<div class="post-metadata">

**Author:** ![gogolathome](https://avatars.discourse-cdn.com/v4/letter/g/bb73d2/32.png) [@gogolathome](https://kopia.discourse.group/u/gogolathome)\
**Post date:** [July 6, 2022, 7:27am UTC](https://kopia.discourse.group/t/another-invalid-checksum/1255/6 "2022-07-06T07:27:43Z")

</div>

It is downloading the whole repository to check. If you have a provider where you have to pay for that it will also cost you some money.

---

<div class="post-metadata">

**Author:** ![manfredlotz](https://yyz2.discourse-cdn.com/free1/user_avatar/kopia.discourse.group/manfredlotz/32/175_2.png) [@manfredlotz](https://kopia.discourse.group/u/manfredlotz)\
**Post date:** [July 6, 2022, 8:06am UTC](https://kopia.discourse.group/t/another-invalid-checksum/1255/7 "2022-07-06T08:06:04Z")

</div>

@gogolathome I am aware of that and of course I have an internet flat. 🙂

---

<div class="post-metadata">

**Author:** ![basldfalksjdf](https://avatars.discourse-cdn.com/v4/letter/b/ce73a5/32.png) [@basldfalksjdf](https://kopia.discourse.group/u/basldfalksjdf)\
**Post date:** [July 6, 2022, 2:43pm UTC](https://kopia.discourse.group/t/another-invalid-checksum/1255/8 "2022-07-06T14:43:41Z")

</div>

> [@manfredlotz](#):
>
> Kopia is fine I know.
> 
> My point is that in case I need to run above command it takes awfully long with such a large repository.
> 
> This is the same with other cloud providers and might be dependent upon the bandwidth one has. In my case 50Mit/s.

I guess that depends on what you mean by “slow”.

Using `--verify-files-percent` is going to be slower than not using `--verify-files-percent` because with the command you are downloading, decrypting, and decompressing the files. Essentially, pretty close to doing an actual restore. In your case, you are doing that for a 2TB repo, and I suspect pCloud is not exactly fully saturating your pipe either.

Did you make sure to enable `--file-parallelism` and `--parallel`? Increasing them may help speed up the process (depends on your hardware, as `--parallel` is already set to `8` by default and increasing it further may bottleneck you).

For reference, it takes about 1.5 hours for me to do `--verify-files-percent=100` for a 200GB repo from Amazon, whose servers are really close to me and fully saturates my pipes as needed.

---

<div class="post-metadata">

**Author:** ![manfredlotz](https://yyz2.discourse-cdn.com/free1/user_avatar/kopia.discourse.group/manfredlotz/32/175_2.png) [@manfredlotz](https://kopia.discourse.group/u/manfredlotz)\
**Post date:** [July 6, 2022, 3:16pm UTC](https://kopia.discourse.group/t/another-invalid-checksum/1255/9 "2022-07-06T15:16:03Z")

</div>

I just used the command as you gave me. Not sure if I could cancel this now and try again with parallel options?!

It is running now for 21h and it may take still 8x as much to get thru all of the 2TB. Which is too long for me.

---

<div class="post-metadata">

**Author:** ![manfredlotz](https://yyz2.discourse-cdn.com/free1/user_avatar/kopia.discourse.group/manfredlotz/32/175_2.png) [@manfredlotz](https://kopia.discourse.group/u/manfredlotz)\
**Post date:** [July 6, 2022, 5:31pm UTC](https://kopia.discourse.group/t/another-invalid-checksum/1255/10 "2022-07-06T17:31:37Z")

</div>

I have to admit when running the command I forgot to do the math in advance. Then I would have seen that with the bandwidth I have it has to take a long time to get all read. 😇
