V0.9.4 Huge difference after full maintenance

Support
1

After full maintenance the number of total bytes dropped from 132GB to 115GB after a small change. Does anybody have an explanation for that?

The only changes I can see:

added file ./KopiaUI-Setup-0.9.4.exe (83950128 bytes)
./log.txt sizes differ:  289 758
changed ./log.txt at 2021-10-23 08:10:06.7260256 -0700 PDT (size 289 -> 758)

See also command line output

C:\Users\kopia>kopia content stats
Count: 303831
Total Bytes: 132.1 GB
Total Packed: 103.1 GB (compression 21.9%)
By Method:
  (uncompressed)         count: 80352 size: 37.3 GB
  gzip                   count: 223479 size: 94.7 GB packed: 65.8 GB compression: 30.5%
Average: 434.7 KB
Histogram:

        0 between 0 B and 10 B (total 0 B)
     4912 between 10 B and 100 B (total 338 KB)
   109840 between 100 B and 1 KB (total 51.5 MB)
   111807 between 1 KB and 10 KB (total 447.5 MB)
    29568 between 10 KB and 100 KB (total 1 GB)
    22615 between 100 KB and 1 MB (total 9.8 GB)
    25089 between 1 MB and 10 MB (total 91.9 GB)
        0 between 10 MB and 100 MB (total 0 B)

C:\Users\admin\Desktop>kopia maintenance run --full
Running full maintenance...
C:\Users\kopia>kopia maintenance run --full
Running full maintenance...
Looking for active contents...
  Processed 10234 contents, discovered 14925...
  Processed 32159 contents, discovered 67414...
  Processed 60559 contents, discovered 93141...
  Processed 92472 contents, discovered 114517...
  Processed 121079 contents, discovered 166695...
  Processed 159937 contents, discovered 190440...
  Processed 194882 contents, discovered 206628...
  Processed 220982 contents, discovered 242787...
  Processed 251898 contents, discovered 259497...
  Processed 269900 contents, discovered 269900...
Looking for unreferenced contents...
Previous content rewrite has not been finalized yet, waiting until the next blob deletion.
Found safe time to drop indexes: 2021-10-23 02:56:25.0045741 -0700 PDT
Dropping contents deleted before 2021-10-23 02:56:25.0045741 -0700 PDT
Looking for unreferenced blobs...
Deleted total 28 unreferenced blobs (12.4 MB)
Cleaned up 0 logs.
Finished full maintenance.

C:\Users\kopia>kopia content stats
Count: 300295
Total Bytes: 114.8 GB
Total Packed: 85.9 GB (compression 25.2%)
By Method:
  (uncompressed)         count: 79246 size: 31.9 GB
  gzip                   count: 221049 size: 83 GB packed: 54 GB compression: 34.9%
Average: 382.4 KB
Histogram:

        0 between 0 b and 10 b (total 0 b)
     4912 between 10 b and 100 b (total 338 kb)
   109840 between 100 b and 1 kb (total 51.5 mb)
   111807 between 1 kb and 10 kb (total 447.5 mb)
    29567 between 10 kb and 100 kb (total 1 gb)
    22614 between 100 kb and 1 mb (total 9.8 gb)
    21555 between 1 mb and 10 mb (total 74.6 gb)
        0 between 10 mb and 100 mb (total 0 b)

c:\users\kopia>
2

Can you run kopia snapshot verify ?

3 
>kopia snapshot verify
Listing blobs...
Listed 4559 blobs.
Found 118340 objects, verifying 16, completed 13368 objects, 11.3% complete, remaining 16s (ETA 2021-10-23 22:02:33 PDT).
Found 222811 objects, verifying 16, completed 27922 objects, 12.5% complete, remaining 21s (ETA 2021-10-23 22:02:39 PDT).
Found 269900 objects, verifying 15, completed 55107 objects, 20.4% complete, remaining 15s (ETA 2021-10-23 22:02:34 PDT).
Found 269900 objects, verifying 15, completed 121424 objects, 45.0% complete, remaining 5s (ETA 2021-10-23 22:02:25 PDT).
Found 269900 objects, verifying 15, completed 189227 objects, 70.1% complete, remaining 1s (ETA 2021-10-23 22:02:22 PDT).
Found 269900 objects, verifying 15, completed 250789 objects, 92.9% complete, remaining 0s (ETA 2021-10-23 22:02:22 PDT).
Found 269900 objects, verifying 0, completed 269900 objects, 100.0% complete, remaining 0s (ETA 2021-10-23 22:02:23 PDT).
4

Everything seems alright, can you see if running kopia contents stats gives you consistent results (say run it 3 times?)

5

It gave me identical results (ran it 5 times).

And here some additional info. The filesystem repo has 11 snapshot sources. All 11 sources had only one “fresh” snapshot. Then one source changed a little (log.txt and kopia downloads basically just few MBs), All the other 10 snapshots have not changed (and the UI shows them as “3 days ago”).