I set compression globally and also locally for a target (filesystem repo).
With policy show I see this
Compression:
Compressor: "lz4" (defined for this target)
Compress files regardless of extensions.
Compress files of all sizes.
But when I run
kopia snapshot create C:\Users\kopia --log-level=debug
I don’t get any kind of feedback about compression? Was compression successful? Did it actually start? Was there an error? There is nothing in the debug log about compression.
Kopia content stats will tell you if compression was used and what are the savings
Great. Thanks for that info. I tried it and this lz4 output:
lz4 count: 1 size: 249.6 KB packed: 28.7 KB compression: 88.5%
It does not show which target that belongs too. But I don’t think it belongs to the target that I tested (which has many compressible files). I even added a text file and created another snapshot, but stats still shows the same lz4 info. It is not clear what failed, because there is zero output in the debug log for compression.
It does not show which file the content is from, because at the content level kopia does not know that, in fact the same content can come from many (parts of) different files, resulting in deduplication.
Suggestions for improving the diagnostic output are welcome, preferably in the form of pull requests.
Suggestions for improving the diagnostic output are welcome
In the log I found the output below. It would be great to see information about compression there too.
could not find cache entry for sample-2mb-text-file.txt
[STORAGE] PutBlob("s61201ab24242438d058314338a724a3d-see54b35992d53c2c109",len=194)=<nil> took 567.5199ms
\ 0 hashing, 14 hashed (2.2 MB), 11896 cached (137.3 MB), uploaded 194 B, estimated 139.4 MB (100.0%) 0s left
reloading committed manifest contents: rev=3 last=1
listing manifest contents
deleting 2021-10-20 07:28:11.1930874 -0700 PDT
keeping 2021-10-20 08:18:22.5268204 -0700 PDT reasons: [latest-1,annual-1,monthly-1]
[STORAGE] PutBlob("pf0af31d188bbf249b576c719135e3100-see54b35992d53c2c109",len=524491)=<nil> took 175.7844ms
[STORAGE] PutBlob("q8309273a57a6ebfa3cfd7fde5b92a564-see54b35992d53c2c109",len=12523)=<nil> took 134.4939ms
[STORAGE] PutBlob("xn5_91aa065618452bf2ab611df659449688-see54b35992d53c2c109-c1",len=277)=<nil> took 69.4029ms
[STORAGE] GetMetadata("xn5_91aa065618452bf2ab611df659449688-see54b35992d53c2c109-c1")=({xn5_91aa065618452bf2ab611df659449688-see54b35992d53c2c109-c1 277 2021-10-20 08:18:26 -0700 PDT}, <nil>) took 0s
[STORAGE] DeleteBlob("s61201ab24242438d058314338a724a3d-see54b35992d53c2c109")=<nil> took 1.1074ms
4 hashed (2.2 MB), 11896 cached (137.3 MB), uploaded 537.5 KB, estimated 139.4 MB (100.0%) 0s left
* 0 hashing, 14 hashed (2.2 MB), 11896 cached (137.3 MB), uploaded 537.5 KB, estimated 139.4 MB (100.0%) 0s left
In addition it would be great to see which files/folders were excluded/ignored.