Skip to content
This repository has been archived by the owner on Nov 20, 2023. It is now read-only.

After uploading an directory with 0 errors there are still photos to upload found #52

Open
akoyaxd opened this issue Jan 9, 2023 · 7 comments

Comments

@akoyaxd
Copy link

akoyaxd commented Jan 9, 2023

I have a folder with quite a lot Fotos and videos.
When I upload them through cli I receive a message, that all files where uploaded fine. After waiting for the jobs to be done I try the same folder again. From 6150 Assets the cli tools wants to reupload 798 assets again. After a successfull second run I startet the cli tool again. Now the cli Tools wants to reupload 762 assets again.

I'd expect, the cli tools just uploads everything on first try.

@alextran1502
Copy link
Collaborator

I believe those are duplicated so they are not recorded to the database.

@akoyaxd
Copy link
Author

akoyaxd commented Jan 9, 2023

That was my first idea as well. But why does the number of reuploaded assets go down with every try? After further testing it seems to flatout out though and do not further decrease.

@alextran1502
Copy link
Collaborator

Hmm. I am not sure. do you see anything on the server or microservices log?

@akoyaxd
Copy link
Author

akoyaxd commented Jan 10, 2023

I can see a lot of dublicate warnings there. But there are way less log entries, than assets, I uploaded. (>100 Lines vs. 760 Assets).

LOGS

[Nest] 1  - 01/10/2023, 9:54:30 AM     LOG [NestFactory] Starting Nest application...
[Nest] 1  - 01/10/2023, 9:54:30 AM     LOG [InstanceLoader] DatabaseModule dependencies initialized +245ms
[Nest] 1  - 01/10/2023, 9:54:30 AM     LOG [InstanceLoader] TypeOrmModule dependencies initialized +1ms
[Nest] 1  - 01/10/2023, 9:54:30 AM     LOG [InstanceLoader] BullModule dependencies initialized +0ms
[Nest] 1  - 01/10/2023, 9:54:30 AM     LOG [InstanceLoader] JwtModule dependencies initialized +1ms
[Nest] 1  - 01/10/2023, 9:54:30 AM     LOG [InstanceLoader] ConfigHostModule dependencies initialized +1ms
[Nest] 1  - 01/10/2023, 9:54:30 AM     LOG [InstanceLoader] DiscoveryModule dependencies initialized +1ms
[Nest] 1  - 01/10/2023, 9:54:30 AM     LOG [InstanceLoader] ConfigModule dependencies initialized +9ms
[Nest] 1  - 01/10/2023, 9:54:30 AM     LOG [InstanceLoader] BullModule dependencies initialized +0ms
[Nest] 1  - 01/10/2023, 9:54:30 AM     LOG [InstanceLoader] BullModule dependencies initialized +1ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [InstanceLoader] TypeOrmCoreModule dependencies initialized +368ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [InstanceLoader] TypeOrmModule dependencies initialized +1ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [InstanceLoader] TypeOrmModule dependencies initialized +0ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [InstanceLoader] TypeOrmModule dependencies initialized +1ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [InstanceLoader] TypeOrmModule dependencies initialized +0ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [InstanceLoader] TypeOrmModule dependencies initialized +0ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [InstanceLoader] TypeOrmModule dependencies initialized +1ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG Initialising Reverse Geocoding
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [InstanceLoader] CommunicationModule dependencies initialized +13ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [InstanceLoader] ImmichJwtModule dependencies initialized +2ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [InstanceLoader] APIKeyModule dependencies initialized +4ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [InstanceLoader] ShareModule dependencies initialized +1ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [InstanceLoader] ImmichConfigModule dependencies initialized +38ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [InstanceLoader] StorageModule dependencies initialized +1ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [InstanceLoader] MicroservicesModule dependencies initialized +1ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [RoutesResolver] APIKeyController {/api-key}: +13ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [RouterExplorer] Mapped {/api-key, POST} route +4ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [RouterExplorer] Mapped {/api-key, GET} route +1ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [RouterExplorer] Mapped {/api-key/:id, GET} route +1ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [RouterExplorer] Mapped {/api-key/:id, PUT} route +1ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [RouterExplorer] Mapped {/api-key/:id, DELETE} route +1ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [RoutesResolver] ShareController {/share}: +1ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [RouterExplorer] Mapped {/share, GET} route +1ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [RouterExplorer] Mapped {/share/me, GET} route +0ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [RouterExplorer] Mapped {/share/:id, GET} route +1ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [RouterExplorer] Mapped {/share/:id, DELETE} route +1ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [RouterExplorer] Mapped {/share/:id, PATCH} route +1ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [NestApplication] Nest application successfully started +26ms
[Nest] 1  - 01/10/2023, 9:54:31 AM     LOG [ImmichMicroservice] Running Immich Microservices in PRODUCTION environment - version 1.41.0
[Nest] 1  - 01/10/2023, 9:54:49 AM     LOG Reverse Geocoding Initialised
[Nest] 1  - 01/10/2023, 9:54:50 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/19356d3e-0916-4b8e-b323-03b5d2f62b18.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:50 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/88088605-557d-4afd-ba7f-2f7f7803a3d5.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:50 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/295312d3-b5bb-4f23-b2d8-78c905fd6a96.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:50 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/c31a4b31-18ed-4fc0-82e3-fd3bb914f920.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:50 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/98f41322-0c83-4e01-bb01-316ec166e538.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:50 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/724895fa-2d1b-4958-8fe9-1626921aa6c5.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:51 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/59166494-14e6-42e0-be89-7afa6cb9a1bf.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:51 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/bc661133-621b-4936-ae80-86dabed8cb25.jpeg duplicated
[Nest] 1  - 01/10/2023, 9:54:51 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/60faf386-6476-484a-a79e-a9dec4998635.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:51 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/afac54e3-a2fa-405f-986d-521a99a0a4b0.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:51 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/c5b63361-d893-4683-90f4-04549a994849.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:51 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/e5515d2b-ad6f-456a-bacc-f9c75b0c99db.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:51 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/5fa701c5-1d3e-4617-86d5-17b2d63be5fd.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:52 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/b426ae6b-ddff-48c5-b58b-0f17df40391b.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:52 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/8e2e105e-421e-4702-a429-d6260d7ee83f.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:52 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/d62b7f4c-41b9-4a31-a8e0-d232f4a80cb4.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:52 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/8fdcb86e-9faf-4b92-af49-46ba2e492d60.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:52 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/b75a639e-191a-4ade-ad86-59ba39cd7df4.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:52 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/1a9fa5be-3e20-41c1-9c69-be4a57c6caff.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:53 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/cd455ab4-bfcb-4d0e-b628-4ef176979ebf.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:53 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/0804c5b2-9e40-402f-9226-b238e60927eb.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:53 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/07a69aca-1845-4829-8404-57dd3ed86a19.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:53 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/8d2e899d-759f-46da-a5b6-404140c2c783.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:53 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/14a575fa-2276-43d8-97c4-31da2b53364b.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:53 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/1eae550a-d210-42bd-bbc1-26370e69c4af.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:54 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/280dc958-60b4-408d-b6b2-c9e445a2f012.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:54 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/c79f90d9-9d66-45f5-a666-4a57a2837c11.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:54 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/fae8e60c-7f93-45ab-a4ef-6ca6a079180a.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:54 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/dac9730e-dfbf-4eba-813e-f1940667188a.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:54 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/adbb05a0-f230-4f9e-b857-992c2a407452.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:54 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/725e95df-d950-42f4-9fc1-3147a4f294e5.mp4 duplicated
[Nest] 1  - 01/10/2023, 9:54:54 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/46a50645-f4d1-4ab0-8337-89d768167ecd.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:55 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/c51e1fe1-02ef-4057-a84b-293a89fab074.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:55 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/7c564385-d591-480d-828e-674ed9d3c37d.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:55 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/c9cb43cd-b719-4518-9602-720d657dedd9.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:55 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/37d3db6f-b309-4b92-b8be-ac61fa7f390d.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:55 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/29d433cd-baaa-4d6e-9c78-a82382e92bc6.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:55 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/eb7603da-8044-4a45-8688-b21228298def.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:55 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/6c3c3a56-fa28-45b8-a91d-c3a25e7db715.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:56 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/127a19a7-32a4-47d8-9e7d-d00d9760f004.mp4 duplicated
[Nest] 1  - 01/10/2023, 9:54:56 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/d8217fa1-d383-429f-9e72-6b5e75f9c5f2.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:56 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/23bb3443-7cc9-4de2-87be-a630a245332f.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:56 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/7133b345-8a41-427d-b2c9-0e37c6cd14a5.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:56 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/fd24938a-0676-4974-a583-ff28b9dabc4b.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:56 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/338c72dc-279b-4809-aabc-e0ab1f5b0f54.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:56 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/567501b9-e1ca-4106-bef0-b91e445367ee.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:57 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/e5dfcc63-dea8-4d81-b45b-437693c2035c.mp4 duplicated
[Nest] 1  - 01/10/2023, 9:54:57 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/f1863b64-33f1-4bab-8e46-39202df3e5a2.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:57 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/7b4d7b8f-72c5-44c7-9d75-89510640c628.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:57 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/a3cdeade-606a-4b45-9473-d73c90065763.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:57 AM   ERROR upload/1c62e351-3435-4eb7-a2b5-d35b6035c0d2/original/CLI/9fede852-f315-4629-83e3-b217c3e78f18.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:57 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/3a03bcf9-7ac9-4ffa-9370-8117ae59591c.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:57 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/72364091-0eaa-4841-b94c-04c16db6eafc.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:57 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/0e5fb0a0-8035-4346-9bde-bf7f5ce34dfc.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:57 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/6a21f415-b4b5-4aa0-8969-66b1c1bdab04.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:58 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/172c458e-0ac6-4348-b1a1-2715963c2b0a.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:58 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/32cddc70-a9fa-4b1b-8e22-3cdc2d3929e1.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:58 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/8145a279-3c7c-4100-adae-222b44e639df.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:58 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/27d50e4e-23d3-49dd-a80b-bf7ce828bc71.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:58 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/519fcbae-bcea-4654-aba6-1a34f3e42582.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:58 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/977a3cc7-fb14-4992-95ec-57a73291b428.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:59 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/ca03a392-475d-47f7-9e35-97aa265d6275.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:59 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/a047ec0d-adbf-45c8-926c-82ddac52f56e.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:59 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/5b229442-b4af-4db6-a0b9-9634d25b7e13.jpeg duplicated
[Nest] 1  - 01/10/2023, 9:54:59 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/d47c5aa4-1c3e-4a00-8b1f-70af831c466c.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:59 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/3560c149-952d-44d5-93d8-34b0142bf62d.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:59 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/a151d4a8-7e85-4641-a2d5-e3e30e262e4a.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:59 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/45186abf-3317-434c-963c-5b612abb7a2d.jpg duplicated
[Nest] 1  - 01/10/2023, 9:54:59 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/c6729d05-7207-41c6-8ce5-484746ab1ae0.jpg duplicated
[Nest] 1  - 01/10/2023, 9:55:00 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/ca7e706a-5744-4ba3-aaf3-bd898a029404.jpg duplicated
[Nest] 1  - 01/10/2023, 9:55:00 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/d0115fb7-ad19-4ce4-8d67-66c762fa4946.jpg duplicated
[Nest] 1  - 01/10/2023, 9:55:00 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/5340df79-0769-4af8-984e-d21c382e121a.jpg duplicated
[Nest] 1  - 01/10/2023, 9:55:00 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/d4598c89-a81e-4f76-b189-9fe43c89add6.jpg duplicated
[Nest] 1  - 01/10/2023, 9:55:00 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/5e61b590-5397-4626-a2ef-ce8ba779e293.jpg duplicated
[Nest] 1  - 01/10/2023, 9:55:00 AM   ERROR upload/1c62e351-3435-4eb7-a2b5-d35b6035c0d2/original/CLI/662fb700-b285-472b-bd49-dd7d97260560.jpg duplicated
[Nest] 1  - 01/10/2023, 9:55:00 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/dea4928b-6ef0-46b4-ba87-29c6064ff172.jpg duplicated
[Nest] 1  - 01/10/2023, 9:55:00 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/8ea79110-99d0-490f-b207-3804c9209d08.jpg duplicated
[Nest] 1  - 01/10/2023, 9:55:01 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/75e4d07a-717a-4025-bc30-ecdfdf6c4167.jpg duplicated
[Nest] 1  - 01/10/2023, 9:55:01 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/f2944ac3-c5e6-4003-b6f7-e297d8b4a3eb.mp4 duplicated
[Nest] 1  - 01/10/2023, 9:55:01 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/b3626c52-2cbd-468d-b0cc-638f9fa7eb95.jpg duplicated
[Nest] 1  - 01/10/2023, 9:55:01 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/87c2b2e0-78d5-4cc6-978c-1a56f6d15c17.jpg duplicated
[Nest] 1  - 01/10/2023, 9:55:01 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/b2d65b03-841a-4bc9-bc24-433a89aac754.jpg duplicated
[Nest] 1  - 01/10/2023, 9:55:01 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/c26db9b7-d948-4152-9386-9a2329b765eb.jpg duplicated
[Nest] 1  - 01/10/2023, 9:55:02 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/286b698e-20d1-465f-a8de-d9d18d6d689c.jpg duplicated
[Nest] 1  - 01/10/2023, 9:55:02 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/640198d2-1c1b-40f4-a45b-fc54a5a2628c.jpg duplicated
[Nest] 1  - 01/10/2023, 9:55:02 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/3180532f-ce37-4fae-813e-efc5fcfad2af.jpg duplicated
[Nest] 1  - 01/10/2023, 9:55:02 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/12d4f7ba-5287-4629-af10-40a1737e00d0.jpg duplicated
[Nest] 1  - 01/10/2023, 9:55:02 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/9e34e78b-2df7-4dea-b592-1866404a3596.jpg duplicated
[Nest] 1  - 01/10/2023, 9:55:03 AM     LOG checksum generation done!
[Nest] 1  - 01/10/2023, 9:55:03 AM   ERROR upload/6cc0efad-939f-46f6-8aa5-8d0aeafc906d/original/1eb1fad72832d9d41113245ee1b35bfcdec37abaf7232992501e295e2746467a/b5fc9551-15b6-46da-83cc-cd300e43c822.jpg duplicated

@jagjordi
Copy link

I am having a similar problem. After finish uploading a full directory it still says some files will be uploaded if I re-run the CLI. However if I say "yes" it ulploades them extremely fast (much faster than it could possibly be realistically). So I assume the duplicate detection works but somehow the CLI mis-interpretes it (if that makes any sense) I will try to get the logs and upload ASAP

@alextran1502
Copy link
Collaborator

@jagjordi It makes sense, and it is correct. The CLI doesn't know which file is the duplicated file because duplicated files don't get recorded in the database.

@akoyaxd
Copy link
Author

akoyaxd commented Jan 12, 2023

Good to her everything works as expected. And dedub is an super awesome and probably way underrated feature in my opinion.
Though I think to reflect it in the cli, that those files where dedubed would bring a lot more trust and confidence into the tool when e.g. someone migrates his library to immich.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants