I’ve been playing around with Kopia for a few days now to get a feel for how it handles.
After a number of snapshots I’m a bit confused about how used space is reported.
What’s actually used:
(16:42)[play@zeus] ~ % du -hs backups/kopia
6.0G backups/kopia
What the repo reports as used:
(16:42)[play@zeus] ~ % kopia content stats
Count: 15730
Total Bytes: 8.5 GB
Total Packed: 6.4 GB (compression 24.7%)
By Method:
(uncompressed) count: 2667 size: 890.2 MB
zstd-better-compression count: 6242 size: 7.6 GB packed: 5.5 GB compression: 27.5%
zstd-fastest count: 6821 size: 12.2 MB packed: 3.9 MB compression: 68.1%
Average: 541.3 KB
Histogram:
0 between 0 B and 10 B (total 0 B)
35 between 10 B and 100 B (total 2.4 KB)
8506 between 100 B and 1 KB (total 3 MB)
1152 between 1 KB and 10 KB (total 3.8 MB)
1402 between 10 KB and 100 KB (total 66.6 MB)
2040 between 100 KB and 1 MB (total 720.1 MB)
2595 between 1 MB and 10 MB (total 5.6 GB)
0 between 10 MB and 100 MB (total 0 B)
The snapshots so far:
(16:42)[play@zeus] ~ % kopia snap ls -lda
play@zeus:/home/play/games/minecraft/ATM7
2022-07-05 16:01:06 CEST kb7624cad14d76e1b10884aa78a2e4987 2.1 GB drwxr-xr-x (+2.1 GB) files:2471 dirs:723 (hourly-15)
2022-07-05 18:56:20 CEST kf5b36c06b2d27435d5a48343d873fa36 2.1 GB drwxr-xr-x (+5.5 MB) files:2486 dirs:725 (hourly-14)
2022-07-05 20:58:49 CEST kd9889c5808d28573898660688b1b8a33 2.1 GB drwxr-xr-x (+4.4 MB) files:2493 dirs:728 (hourly-13)
2022-07-05 21:58:50 CEST kc3544eadbc30726df38416e5c48897f7 2.1 GB drwxr-xr-x (+11.8 KB) files:2493 dirs:728 (hourly-12)
2022-07-05 22:58:51 CEST k8f56e2992416e4648aff57c7f2a32d89 2.1 GB drwxr-xr-x (+50.5 KB) files:2493 dirs:728 (hourly-11)
2022-07-05 23:58:52 CEST kbe8785436300522d3c7dafb117b86171 2.2 GB drwxr-xr-x (+50.4 MB) files:2518 dirs:729 (hourly-10,daily-2)
2022-07-06 00:58:52 CEST kb61d279fa3fd9e1b75928e7c2879dad1 2.2 GB drwxr-xr-x (+84.2 MB) files:2563 dirs:730 (hourly-9)
2022-07-06 01:58:53 CEST k3c29ad09d1dae8c4480f9847a79bc65b 2.2 GB drwxr-xr-x (+16.2 KB) files:2563 dirs:730 (hourly-8)
2022-07-06 02:58:54 CEST k38ee1335c1570a039110df1f68490799 2.3 GB drwxr-xr-x (+7.9 MB) files:2568 dirs:730 (hourly-7)
2022-07-06 03:58:55 CEST k66203038b95fa72b9d6ae3d03084aa2f 2.3 GB drwxr-xr-x (+6.4 MB) files:2571 dirs:730 (hourly-6)
2022-07-06 04:58:55 CEST k667d46eff133005a1c52a9264977f634 2.3 GB drwxr-xr-x (+1.2 MB) files:2571 dirs:730 (hourly-5)
2022-07-06 05:58:56 CEST k5577b377e96d12250eec98e482cb7ed8 2.5 GB drwxr-xr-x (+209.8 MB) files:2714 dirs:743 (hourly-4)
2022-07-06 06:55:48 CEST k221cea322c0f5168356d5eb091cd0aa3 2.5 GB drwxr-xr-x (+9.5 MB) files:2726 dirs:743 (hourly-3)
2022-07-06 07:25:48 CEST k778d5f5df3a3e1c263df7050553d9161 2.5 GB drwxr-xr-x (+37.2 KB) files:2726 dirs:743 (latest-10)
2022-07-06 07:35:49 CEST k0b061564dc52585e301d4357e268fcdd 2.5 GB drwxr-xr-x (+16 B) files:2726 dirs:743 (latest-9)
2022-07-06 07:45:49 CEST k2b862a9850c7dd7bc8d50b5e0bee65f5 2.5 GB drwxr-xr-x (+5 KB) files:2726 dirs:743 (latest-8)
2022-07-06 07:55:49 CEST kd949d9d00506081072c61ac9ed1ad0bb 2.5 GB drwxr-xr-x (+18 B) files:2726 dirs:743 (latest-7,hourly-2)
2022-07-06 08:05:49 CEST kf06102dfbc962e56155f988d8001cf54 2.5 GB drwxr-xr-x (+19.8 KB) files:2726 dirs:743 (latest-6)
2022-07-06 08:15:49 CEST k011dcbec36e6a227c73a1c1a6ad7a48b 2.5 GB drwxr-xr-x files:2726 dirs:743 (latest-5)
2022-07-06 08:25:49 CEST k5f6d360353057848f4d86505f4fbb2a9 2.5 GB drwxr-xr-x (+6.6 MB) files:2729 dirs:744 (latest-4)
2022-07-06 08:35:49 CEST kdc255d5b7860e1fe9e096e4ffdeb3abf 2.5 GB drwxr-xr-x (+12.9 MB) files:2741 dirs:750 (latest-3)
2022-07-06 08:45:49 CEST k74e084830ca8410814bd2b0c8c90ea50 2.5 GB drwxr-xr-x (+2.2 MB) files:2762 dirs:755 (latest-2)
2022-07-06 08:55:49 CEST ka92c049a460f719417aacc2fee11e607 2.5 GB drwxr-xr-x (+341.2 KB) files:2787 dirs:761 (latest-1,hourly-1,daily-1,weekly-1,monthly-1,annual-1)
So we have 6.0 GB on disk, 6.4 GB “used” (I assume “Total Packed” is the complete amount of “stuff” in the repo), but if you add up all the snapshots’ sizes you end up with barely 2.5 GB of snapshot data.
Where is the remaining 60% of the on-disk data going? Is there a better way to get reports about space usage?
I’m used to the borg info style of space reporting:
Original size Compressed size Deduplicated size
This archive: 2.11 GB 1.59 GB 73.27 MB
All archives: 133.56 GB 101.62 GB 7.11 GB
Is something similar possible with Kopia?