Maintenance Failed due to missing blobs, content verify fails, next steps?

Support
1

Hi, it’s me again, I swear I’m not trying to be a bother, lol.

Looking in the UI I noticed that maintenance was failing, so I investigated a bit. Here are some relevant log lines:

19:58:16.722	unable to rewrite content "kf8a91c2a77e72427a9ddad647c05deaf": getCacheForContentID: BLOB not found
19:58:16.757	unable to rewrite content "kfa79f010eec4fca33d26c52167c3eabb": getCacheForContentID: BLOB not found
19:58:16.790	unable to rewrite content "kfbd8ae86db5e296a6f8ae7c32a039f25": getCacheForContentID: BLOB not found
19:58:16.827	unable to rewrite content "kfc1a175e4056a618aa963592ea97c080": getCacheForContentID: BLOB not found
19:58:16.860	unable to rewrite content "kfec3cadc0574b78871b9106aa08003c1": getCacheForContentID: BLOB not found
19:58:16.895	unable to rewrite content "m1c2812cf4e33eb354dd88662b1207c5f": getCacheForContentID: BLOB not found
19:58:16.930	unable to rewrite content "x1db6c5f0f72081b8b32e50ea8173c389": getCacheForContentID: BLOB not found
19:58:16.971	unable to rewrite content "x1ef57a57a5bf4cdb115f43d3c1a84434": getCacheForContentID: BLOB not found
19:58:17.014	unable to rewrite content "x420cfb56984e2d72aec7b1a74947cfb4": getCacheForContentID: BLOB not found
19:58:17.050	unable to rewrite content "x5808c95fe1b69ad48d172bacd15a2a3e": getCacheForContentID: BLOB not found
19:58:17.089	unable to rewrite content "x5f15cfd53fb8d2965b194ce029509dc0": getCacheForContentID: BLOB not found
19:58:17.124	unable to rewrite content "xa5452f2864fcaeb62c5dbe6e14dee196": getCacheForContentID: BLOB not found
19:58:17.159	unable to rewrite content "xb31053ca442c317b73d09822fda78699": getCacheForContentID: BLOB not found
19:58:17.199	unable to rewrite content "xd154780ddd4f10fc26ddb132ec1d8847": getCacheForContentID: BLOB not found
19:58:17.243	unable to rewrite content "xf45c7165437164c5ab40ecc5aedce249": getCacheForContentID: BLOB not found
19:58:17.243	Total bytes rewritten 192.5 MB
19:58:17.426	Finished quick maintenance.
19:58:17.426	not closing shared manager, remaining = 1

after seeing this, I ran a kopia content verify and got this:

❯ kopia content verify
Listing blobs...
  10000 blobs...
  20000 blobs...
  30000 blobs...
  40000 blobs...
  50000 blobs...
  60000 blobs...
  70000 blobs...
  80000 blobs...
  90000 blobs...
  100000 blobs...
Listed 108013 blobs.
Verifying all contents...
  100000 contents, 0 errors...
  200000 contents, 0 errors...
  300000 contents, 0 errors...
  400000 contents, 0 errors...
  500000 contents, 0 errors...
  600000 contents, 0 errors...
  700000 contents, 0 errors...
  800000 contents, 0 errors...
  900000 contents, 0 errors...
  1000000 contents, 0 errors...
  1100000 contents, 0 errors...
  1200000 contents, 0 errors...
  1300000 contents, 0 errors...
  1400000 contents, 0 errors...
  1500000 contents, 0 errors...
  1600000 contents, 0 errors...
  1700000 contents, 0 errors...
error content k00757b6ca3ebac41e01ab982420806fd depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k00eb39a9309637a814cdf8d7acb8c456 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k01b6d56bd890808b9f99a2514497c4be depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k022c72424f0a830616c4936d48c7d703 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k027ede4d565d0fef151eb6d2d2a20111 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k031de14d3264511e523d87fcb08a9869 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k04ebb187e09b2e8007b97aeac9295d26 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k071bad2b7357e3dcba3f5af8b859ba37 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k0780a1cd4e2a0c1ba3eea893265e8efc depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k07f3611b96a12ac4e243248b72ac3d94 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k0948a2b776c897ef90ddbc7f42e114dc depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k0afea13a7c116559b3ec823a82d99bdf depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k0c3ad16ebf0c447106d87ede5b87608e depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k0cabe0d72a3d6f7fca2cbb47bab9725c depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k0cea764e9a9253d3e458f8d897545a1a depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k0d27ae00a29bff087f2477f970c8513d depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k0ee794b004e1179f6ff828379d07cb7d depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k115f3376ed75badf3af6d6d66ba3ca6f depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k1657e8589607dc9aba36df13df0d3655 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k16ad7373aadf25fcd37adf082147e33c depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k17fe912cd7c55166f16e509c539668c9 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k1bb2d191b4f4deba54b94800dfc5abc6 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k1e40f03aa5b9b00aabb0927dcb439c46 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k1efa3756a8f9bc93e1a54783e1a111a2 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k1efcc44c6adcb6a47f8b51c8c495371c depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k1fca7cad030de5b2bdc05dd9ff3c3c37 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k21ca173e3dd20f8773850235969401fd depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k21e9ea4549e9b97f3f85f7361eafbf4d depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k250088b970745de71f005335bc79b8d4 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k25cfe94d6e3265c35ce4aca9cbe38115 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k263137a0af9cf0e21ea3bb4c1b4a364a depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k2961eef69a02272b554a558ade2a0c73 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k2a08d306f0e438ca78c6a0d1cf5ca258 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k2a44e934dd4a27bf97881dfaa5229d42 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k2c78390498adb005f86b6d112f99c85d depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
  1800000 contents, 35 errors...
error content k2fcdcc3e25607bbf3ee819b4bd367ac8 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k3294e4831e4b9b768eee56d56f8c5efd depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k3371e91984b42c87136ad3d158b1eeec depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k33c022836140dc9af404d71e9f9aaefe depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k354c8e30f3f88d249e0e7496730dcf10 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k36119236b17cc4c76d40098743513123 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k3755e48c5a2639c03cb33daab49db8f1 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k39b40de31f21913206a9f580d3a20808 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k3bb9fe3626880aeb050a19abde0278b9 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k3e4cb61b82e39497e8e8f9cbcb16179d depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k3f24c29912ea5cbd8dac835c990d3977 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k4045e1b3f00da2614e230cb95e8610e2 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k40d14a06a7d223012813d61cba0ce0e4 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k40e87734cb7c2f2a4d691d3d499b8f37 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k442342629698784bfb0396812f8dd9bf depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k4506331045b68c3ac279e29a2cde61fb depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k4949543b4f82aa7cc3fa60f2ada0e89f depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k4aacfdcadaa11beb601a0f5819f43d07 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k4b544308cf3ea38d816760aded903c33 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k4b986c00735bfbf47e0feafce6d3cee7 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k4bb57bdbeca4ec07bbde6fa1c7ea14dd depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k4bbe9be2085ee7c835ab2ddc8c779cdc depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k4c50020696736432b86ddbf4750a9f27 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k4d900f944748db2552e91f4d057ef4cc depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k4dfa826e955ae5e8cf487e3feb26433c depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k4e254046a811dbeb45a40dab20e7710a depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k4e37e55c3196b0ec366553690fbd0822 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k4fca1321535f0189f60bd96b4d88fa67 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k50e173ec9e2008b2def2aacb946bd16c depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k519a2025ac69ea1ea14467474b28864c depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k5750bfa2df9d05124248463cf48c0aab depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k59d05818201339736158437b80f1c7af depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k5b1df047ce1468ff5e80dc21c0dfd56e depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k5cbd66feb5acbfb1d150676409fb3480 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k5f68606b747727ed798379ab882665b4 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k5fcea29a015350d11ce9ee21d932d2a9 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k60f4154b295c6e63cb9bda66b27a32b2 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k61e3023c686cb42a60c6e57b5bb8c20d depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k64c34949c40f6c9303b441096fa4b1e7 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k64ef7327271587c17763d800771d5102 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k65211195b3a1f7b88c3668c49c94cc45 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k66da0299a289ecdc1288ccc88bde7914 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k68083a96a9172e578786ff9f3ed1cdb1 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k68423efde73ffcd495416270d9f1cd3b depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k69be63264feaa2cfaaa64056176cd7fe depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k6b35c54b089d676981406fd221ae6380 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k6bc2dd4d86b3657b58ea63c56cd36000 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k6c8da236def8b20ae6357c8c818e66ae depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k6d5790523a55c79947e99d4ccc9ee81f depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k6ed799bafbf229bd73c45ed7b4c7239b depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k6f7328bd18ccd772bbcf77e6b31ad9b9 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k7322d2d978da7e95d8390ff439d939a0 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k74ed75aa2b5e7784b4acd1a92581cd0e depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k76a389f9f5b4c7caddbbcfc2e0579fbc depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k79c8c33f5e0a3c5fa10748f0af7ef911 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k7a3047daaadc2a6856006e566e407290 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k7c4aeed3967b6c8f2afc77a4c20f1707 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k7dfa43f3c12ef47affc362722d592d73 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k7dffa414d84ed9a61dc7da074693248d depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k7faa264a89e1d028f26bef8b5b808efc depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k81403704f66f48a776c7b7181512d52b depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k82bc1644af49c6330e9314e9cc971822 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k83eb19a97f3eec2741c06b3fab1c3da0 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k85ea0de806f3ab31dcc1babf4247c7cd depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k862d2ee81393ea7325f290b87003a5f4 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k88d447cca9b8cbc09f3ac1b802cad66b depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k8a17f267738381735acb729caf95d609 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k8a224089bd8fc26222ad884ac1dc2e44 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k8a8276eb82b47705d0552b7ad3a68ed7 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k8b2fa9b5969c5bfb2612fa56bb219159 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k90fac791bd80c3e1bc1c22b824a9c5ae depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k9189256d14bda0ee92e633062884f6d2 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k942119ba1c234736061a441f037ae6b1 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k947113c32feecb8917e3efe108d4d67c depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k9aa7cb9a5ffa8765bda0fa60e9760723 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k9b084ea849eb3d2248b482ff5c8fc204 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k9c9e710b3e39dc134ee3b451a2267a4b depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k9d953cd3b3a7f94e1f0b7d06dfe2198e depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content k9e0f88f6a668c11afd8de8a18462d165 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content ka0812151c3488f5005f6ad0237539eba depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content ka0ab93cc05490af368fa326dc3348462 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content ka2f5a3938423fae950fbf24c2af3cd7a depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content ka42750f8bfbfb77a2c96150aa1b3f9c3 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content ka82344b45c86c5532bab4bb2a9650c65 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kaad8d628f2b30db33e9539656c84a9ff depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kac285d0e8c3608419dfc015b255d7881 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kac926f8cb3b48c68a9fcac25826535e3 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kaf83b2ddede6c8a7fcd991a2203aaeff depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
  1900000 contents, 123 errors...
error content kb18cc6a30d2144a98207440387e08b59 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kb1c2a75598ae15d16178cd1918eb194b depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kb24c65f9a8aa9be999bec5826d5bb649 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kb77c5d6fdf9838084b9d9304f3dcce69 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kbddda1546d97d0381b41052622478eac depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kbf1a75ffaf6b93eddacd0f4c15c30e71 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kbf363d4df27d1ab15641af37b246ebee depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kbf7f8aeeebcc41773e04c57301430348 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kc02a124f2301a4d6fac69a7eb7478fae depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kc24553702a6ee6c468500e955117cfab depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kc26690f6349ffc610aafe8046683662d depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kc324ff270679d3e57ccfc1cc4ff1bf4a depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kc4704a2b8dea03791b6da79135694a44 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kc5d6088d5ed05ec9f670b28281277e3a depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kc8fe8704d9c9cdfa3a1c882ea0b213af depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kcb89213762d4318268e2f85930f8969c depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kcdcd68a0a54dc32f5233e1cc470581bf depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kcf1d18225cedcb27eda9215e8352a75e depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kd43f68662b7c6b5abdc680bb7d8e5e0d depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kd6a274d6761dfae2a1f1898cb9c49cb4 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kd8df93bd9701391b4ba792f02754e130 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kd9b2631674f14ec55c5584698f5f6c2d depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kda0de44c19746cfe13cd2bce1215940f depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kdad6dcfbbd71def08f988a81328f9a9c depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kdc726dc73aaad2008d9ddde633d229ed depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kdd6b96bdd5007938a4799ffaa8081008 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content ke364ba8100eeb650901586bd312b639e depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content ke5c71f5c9e51b0e0e76e561040beee19 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content ke5eddda29db98daa1536bef7a52c3b94 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content ke7b1d520436d9c869d184af2b025c6de depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content ke8d8fde84fb9f4ce8660b07bdd49699d depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content ke8e8d26f77bfa1f3a660f801ec56c6b6 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content keb54cb1db431eeb5ad2477da0f8d7632 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kec1627d0a619102c0516c2bda0ce3f10 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kedc9b43e9ee18151a4f823571ec5c879 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kf348280fe270e802f493b298febf6891 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kf374539ecd87a34e33027e7056e7695f depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kf40d79b927b5675957f43ffeaa8b20a3 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kf5587ff1f045bdaaeef0038f765f95f6 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kf748105bba2cc00da75ae5a98d0f72c0 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kf80459e1f31b24d993ce6b889a4f15fc depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kf81d545814f9fac7020f54e681854e26 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kf8a91c2a77e72427a9ddad647c05deaf depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kfa79f010eec4fca33d26c52167c3eabb depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kfbd8ae86db5e296a6f8ae7c32a039f25 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kfc1a175e4056a618aa963592ea97c080 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content kfec3cadc0574b78871b9106aa08003c1 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content x1db6c5f0f72081b8b32e50ea8173c389 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content x1ef57a57a5bf4cdb115f43d3c1a84434 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content x420cfb56984e2d72aec7b1a74947cfb4 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content x5808c95fe1b69ad48d172bacd15a2a3e depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content x5f15cfd53fb8d2965b194ce029509dc0 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
  2000000 contents, 175 errors...
error content xa5452f2864fcaeb62c5dbe6e14dee196 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content xb31053ca442c317b73d09822fda78699 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content xd154780ddd4f10fc26ddb132ec1d8847 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
error content xf45c7165437164c5ab40ecc5aedce249 depends on missing blob q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106
Finished verifying 2039227 contents, found 179 errors.
ERROR: encountered 179 errors

The only thing I have changed recently is moving full-maintenance to every 10 days. What are my next steps to try and resolve this? Thanks so much for any help.

2

Looks like one blob went missing. Can you ping me on Slack (slack.kopia.io) so we can debug interactively. I would first grep logs for mentions of q7e08993523722d521570dc6e9b2f295e-s47ca2d58c19e9ae4106 and see if there is any indication of why it is not there.

1 Like
3

Can do. I’m at work until about 12 hours from now, so I’ll join the slack then and if needed we can work on this asynchronously. I’ll look through logs around the same time.

Is there any harm in letting my clients continue to snapshot or should I stop anything new from being added till this is resolved?

4

I would let clients continue.

1 Like
5

for anyone that runs into something similar with a q-blob, and just so i can mark this post as solved, you should:

  1. package up all your logs from all your clients
  2. reach out to Jarek on slack
  3. check each client’s local cache under metadata/<first 2 characters of missing q-blob>/<remaining part of blob>.f
  4. if you find it, copy that file out to another location, rename it to match the missing q-blob, and upload it to your backend.
  5. kopia maintenance run
  6. kopia contents verify

really appreciate all of Jarek’s help during this.

3 Likes
6

To be fair. The root cause is still under investigation. Something caused the premature deletion that we need to find and fix.

1 Like
7

I have the same problem, execute kopia contents verify results in:

kopia contents verify

Listing blobs...
Listed 5900 blobs.
Verifying all contents...
  Verified 3 contents, 0 errors, estimating...
ERROR error content 000477e46339012066dd47312b2ac6b4 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 00917397f80179c89ac7dc33aec066d6 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 011c5a34a93382308ac3de85b04c72bd depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 01d37431122fdcb3fbd506ce7f834601 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 040d5f7d1bbf60098284deb847083497 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 04456ae5c91e5baaba3cac15588a6073 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 04e58e53eb14e265f3ff303a5cbafd46 depends on missing blob p6c0e47bdb1a0237be2fa6b133a398955-sdc8eda2055865a26112
ERROR error content 074330ca98d1b6b451f0ea5a7774701d depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 0bb0beca88a4c51d422558c47d3d7965 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 0bb9d147f72369a2e98b0b67a9709e26 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 0cc5faa75361b7dd946ed603748bbe80 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 0d1087f1f4ecfba767dd2017391423f5 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 0d418eee63ea1707072f55ce74abe07a depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 0e85bcd0d62568f907c18a2c339fa004 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 0ee054b3cf631aa2e7230f728aa6c1c7 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 0f1aefdacb82604ccf095e5a8507aafd depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 105c44be15b1df0d9e304b152cdf66f0 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 117632e5664b25f0bc073abef19c6d1b depends on missing blob p6c0e47bdb1a0237be2fa6b133a398955-sdc8eda2055865a26112
ERROR error content 152264f2fad844e71a917b5f3bfe1669 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 15737c9f0ea2aecca3774e69b7625fbe depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 184cf2d91846e5485d050d57afa7d508 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 1925cfd506a6e1711561914516b8f992 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 1927dbe98e438a197c7752cfef729bb2 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 1930e2287c5c5c3b2d95e93f46eea152 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 1c5c5bf4d8f3988bc95979cb732273a8 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 1c98f67b5532ab8ff96d0a6127c81345 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 1cd4412fadbb6f9ce33b788f597dbbe2 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 1e78b06fe0b34a03df52c0586e474c14 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 1e8ef7ee86b7ae44a10ed6cd22b53574 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 1e910649b07500af9a66d9f65e00b440 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 1f2609cebdcd414b74be86cd60fdfd1f depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 21266eafe9e47b8f28aad7b1d5088702 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 217659d2c122d0af8c1af305e02036df depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 240b7b728539b59010bad552a62a1af2 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 241c80206b34cd4f81f69696b9efc543 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 24eec0d063a152e3c30be64b915a8b8a depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 253ca53fac73b60b2ac419d797719ec0 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 26e9bdb54719a878770c3c2dbc1b63df depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 2716db45db19a62483a481e8b7b04f16 depends on missing blob p6c0e47bdb1a0237be2fa6b133a398955-sdc8eda2055865a26112
ERROR error content 2740466a37819f97ca83bf6101ae6087 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 2839d4823c442b1d46a65af984039e9a depends on missing blob p6c0e47bdb1a0237be2fa6b133a398955-sdc8eda2055865a26112
ERROR error content 2bc2e177fae3db286cbab1133f6c703d depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 2bc5e0c6800012c48772581f579844b1 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 2bd3b28ea122dbbd83812f0f69cf8287 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 2fee0832239da6a5572d19b7b8d2dc69 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 30f5f92ac2917d8039ee000b366c3c09 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 311f367d4dc2cc3edb6f3d35fee0681e depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 32a16c0180cb94e01d84de1ae5bb4200 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 3366953521e48065a9f4e37aaf16a7f4 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 35a3d8b7261e533ff95aaab3993c3ecb depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 3650cfee796cf7837be021342df57029 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 36cbfb653dcb9bfcfd27e06238e83646 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 38eddcab3dc4a16d9dc308a2cd2c4e32 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 3902fca60a8e4219e01c623116b6bcd5 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 39f86be41973b9b78828239ac8de3e92 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 3a9e633fdc458b156fe1624d7b54275a depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 3bad9a60ac0f5a98d6de0c426689d424 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 3ca1be39c13fb2c7567a27d6bdbcf741 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 3d26c9bb5e141baea35de968fdaba3d1 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 3e84fae6fc18a489c5eccc90e7df9af5 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 402d286383a583b7fc535fb582f853e0 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 408dd1a694c3b8d71ffca4652ba67484 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 40d39618b376e9a8134ad7ed04e5b112 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 416ad5826ae389ff1535094f35b62948 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 42ab8dd2d250be70f2f975d939386603 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 4373d60da0c73327362ffbdd652df241 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 4442405b3f7bdb955b84cbababf77a4a depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 44a615b1b979089692359d1011e01d67 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 47519da763d5bb89c51fda8594369933 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 4855c006ed6dfbcb6c142b920e65432b depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 49f0aa8225c5ad4460a9692cd166d193 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 4eb5e1d2e76ca4fcbd7eba9b3a2453ba depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 4ee856659e9fbfe9524dc311d842ed90 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 52d63519d683179eed3af046829653d6 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 53e4cc9abbec1c3448b254e51a9a8144 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 542bae74065d186257715669efba4315 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 543ade1c0fed1dddc6d19f6b18b175c9 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 5633ef74f6bfddc834a36ade7de45700 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 5740c9a69ba92c8950492d909c3ac583 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 59e174ef9332ec0061235f3f45543d39 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 5a14b4bc03795d86e26efbbd64edc7b9 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 5a29d77b978982a372407663523860d1 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 5a89308384fcfc0f1021ab7eda4b29d8 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 5b5b84472273648a69d20fcc27c7ca0a depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 5bbf66c91eb63b9589aa6a382a52688e depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 5c325fc54d1a3a54efa562bd250edbfb depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 5e7b0b17602a5bb0cbaccc9b3b8c3e5e depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 613b0f86cdf482c6a3ee25b60a415cb0 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 6147f63305a0ad33bddb5248725a219a depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 6275f4547972d3ff7feb7aee784f1fd5 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 64b060d1d71b05fc357a73949cc9d836 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 64fe56b0dc421d4f40dd64ba04383ea3 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 66d67149349f42e2741b24b9d3ab60bc depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 6a052fd08e087dd737ab01d94b9b8077 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 6b05ab1c2d49e9e1f747642f87322c55 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 6b8eabfdb73b9e1737aa04b219288566 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 6ba71248483673b61299ced608a963ce depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 706c808b3b60bf1ede6c7c47b0255f88 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 71a59f1bbe2520f89eac2ab3298cab98 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 7421e4de6145b6b5f17fc5df8ae01c4c depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 74b1ba1e5505f948ad88374fc36892fc depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 758e07b17dc62facfcb707d46ba7d5d0 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 7645aeb1c627e9d9c48101258bb888a8 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 766e66568ca9bc08e3cfaea6461d0a5c depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 787867d1a75810085b272f2fa2031434 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 7af12719dc34984ba155caf46bcc90b2 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 7dbb4eb24acb4f80e7005a51bd8d87e9 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 80976d4c9070088065c05c0537c0452f depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 841668938ef1ac0275f2f3bd54cec63d depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 8445092ae75cdd114b8c64df69873807 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 84d7d3e463f332ee0a21ae86f30b915d depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 866693bc54c6e08e6d47eddce5dabe2a depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 8a8565088acc4fe0c27483ee986e9473 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 8e1ca784110935fb1cbdc8031a2ee5f4 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 8e90b093da0c2a99a039a3d2b6c098e2 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 8ec066c878cfb3d5e2f8ba4630bae73a depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 8fc0aea6373a5f39fc29c15077d800b4 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 919f6097b6945daaedeb786d2aa1de9f depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 92a9a5ffc9a53f04e10363c3f18c8480 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 97f86239cea3d368465ba10c4312b7b9 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 9a29c33ab3176acf20c71ca383c774f1 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 9b07ccab7faa67c91605bfa7c2c0d827 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 9b749b6eb3dbf1a2ff84dc7ce16c748d depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 9c2152341d5b7790a628b86e63baabd0 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 9d8f50bc3e3d0e82b7802d05d5557a8b depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content 9daed9e357df3b5f2cd21c61405c2415 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content a158f5652618537f7d55193374c7dff0 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content a4c6c0cf262732559c05cfef8812c5e3 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content a569b95c42262f0014494fbb682a0de6 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content a620c9669c9c288a2d525157e8a2592b depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content a7cb3cbdb9391902cff65e143274a041 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content a9138806f179af50265b8e826063115e depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content a9681ed2ee31b3629f6d08fcd25eff2b depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content afe7744ba8bb611f61228751816ba334 depends on missing blob p6c0e47bdb1a0237be2fa6b133a398955-sdc8eda2055865a26112
ERROR error content b036df626f03065f6271c0ac53d53719 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content b0b9a1a0c18502e7e4a8c69035a8f774 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content b594c2290ec33f09f9dfd762fd4a2b64 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content b8e59ac3bbe85f0bec39f48348e35561 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content c0eb62d55f7054aa1f3da9b9979a4266 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content c31eb9887898e5bffd95fd6a70b6b149 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content c65f1d8abe48b87cb730d460ec1df259 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content c7d24f8592d99f5af8300fc9500b6557 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content c8b5fb4f39a86988dc23f5bbef594c66 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content ccb8e29cc361f8a9e2f9b98d8bc9222c depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content cd752d88b5a08d6c22f3b4964951925a depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content d123ed955e721ee3c0406c86309c26ee depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content d39568e59607a45050e84d89590c8f51 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content d41bf7b21167da5d69e40e48436eca2c depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content d60fab0c8d24e4ce0bbcf65d27443c00 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content de4ea8c69b1c9f8ba69b738014b94c3c depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content de54d14aad0f330c0d490e8f8b97e66d depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content df8a012a5c229abe18708730fd65ad41 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content e00d912ec5a5fbcac081e96b4b0becc5 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content e12ae9682037208eb6e240503a23329a depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content e184d17776aaf6b2c5cf9f1225901dca depends on missing blob p6c0e47bdb1a0237be2fa6b133a398955-sdc8eda2055865a26112
ERROR error content e33ea53db7c937f18a273827c547072c depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content e51279d24ed6788cc0aacadd34f32ca3 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content e996a197935f7a1b23b0bf2a1546cf4c depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content f9b2d57ab6a7514ac7114b07aa564cc6 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content fb9ca207890c1e64f13d76f910179dc4 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content fddafe9cb4798a4228de7296c90bf887 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content fe3de6d020b9c01fb597daa520dfb11d depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
ERROR error content fe89b0e7627bf3ab3a2051b839cbe131 depends on missing blob pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
Finished verifying 82080 contents, found 163 errors.
ERROR encountered 163 errors

2 blobs are missing:
pc4096d82d2a798b92ab5753a8ef769b2-s9feb38ae7d0f874a110
and
p6c0e47bdb1a0237be2fa6b133a398955-sdc8eda2055865a26112

How can I do?

8

Finally, I have to recreate repository, add snapshot one by one, in order to fix this error…

9

@jkowalski I am having a similar issue as well. In particular, blobs are getting deleted from the repository prematurely. This only seems to be happening on two different KopiaUI->rclone->Google Drive App Directory (GSuite for Workplace/School) repositories. The metadata folder only lists directory names through “ff”, no blob folders higher. Here is my original post on it: Error: error rewriting contents in short packs: failed to rewrite 1994 contents