Version 5 shows no photos, and jobs queue is stuck

[hess8]

I migrated from v4 to v5. But the album structure shows as empty frames, and all the photos are blank, just spaces for each one. The other strange thing (which might be related) is that there is a jobs queue with 845 jobs that never advances.

I’d be grateful for any help. More info is below

  Diagnostics
    -----------
        Warning: /ho*****************************blic/sym/ has permissions 2755, but should have 2775
        Warning: /home/b***********************storage/image-jobs/ has permissions 2755, but should have 2775
        Warning: /home/b***********************storage/livewire-tmp/ has permissions 2755, but should have 2775
        Warning: zend.assertions is disabled although Lychee is in debug mode. For easier debugging code generation for assertions should be enabled.
        Warning: Default timezone not properly set; you might experience strange results when importing photos without explicit EXIF timezone
        Error: /hom**************************.git (and subdirectories) are not executable, check the permissions
         Foreign key: access_permissions.user_id     → users.id             : CASCADE
         Foreign key: albums.id                      → base_albums.id       : NO ACTION
         Foreign key: base_albums.owner_id           → users.id             : NO ACTION
         Foreign key: jobs_history.owner_id          → users.id             : NO ACTION
         Foreign key: oauth_credentials.user_id      → users.id             : CASCADE
         Foreign key: photos.album_id                → albums.id            : NO ACTION
         Foreign key: photos.owner_id                → users.id             : NO ACTION
         Foreign key: size_variants.photo_id         → photos.id            : NO ACTION
         Foreign key: sym_links.size_variant_id      → size_variants.id     : NO ACTION
         Foreign key: tag_albums.id                  → base_albums.id       : NO ACTION
        Info: Found 24 small that could be generated.
              You can use `php artisan lychee:generate_thumbs small 24` to generate them.
        Info: Found 823 medium that could be generated.
              You can use `php artisan lychee:generate_thumbs medium 823` to generate them.
        Info: Found 70288 small images without filesizes.
              You can use `php artisan lychee:variant_filesize 70288` to compute them.
    
    System Information
    ------------------
        Lychee Version (git):                    master (02e5a20) -- Could not compare.
        DB Version:                              5.1.2
        
        composer install:                        --no-dev
        APP_ENV:                                 development
        APP_DEBUG:                               true
        APP_URL:                                 set
        APP_DIR:                                 default
        LOG_VIEWER_ENABLED:                      true
        LIVEWIRE_ENABLED:                        true
        
        System:                                  Linux
        PHP Version:                             8.3.6
        PHP User agent:                          Lychee/4 (https://lycheeorg.github.io/)
        Timezone:                                UTC
        Max uploaded file size:                  1000M
        Max post size:                           1000M
        Livewire chunk size:                     12.00 MB
        Max execution time:                      2000
        SQLite Version:                          3.37.2
        
        exec() Available:                        yes
        Imagick Available:                       1
        Imagick Enabled:                         1
        Imagick Version:                         1691
        GD Version:                              2.3.3
        Number of foreign key:                   10 found.
    
    Config Information
    ------------------
        version:                                 050102
        check_for_updates:                       1
        sorting_photos_col:                      title
        sorting_photos_order:                    ASC
        sorting_albums_col:                      title
        sorting_albums_order:                    DESC
        imagick:                                 1
        skip_duplicates:                         1
        small_max_width:                         0
        small_max_height:                        360
        medium_max_width:                        1920
        medium_max_height:                       1080
        lang:                                    en
        image_overlay_type:                      desc
        default_license:                         none
        compression_quality:                     90
        grants_full_photo_access:                1
        delete_imported:                         0
        mod_frame_enabled:                       1
        mod_frame_refresh:                       30
        thumb_2x:                                1
        small_2x:                                1
        medium_2x:                               1
        landing_page_enable:                     0
        site_owner:                              
        landing_title:                           
        landing_subtitle:                        
        sm_facebook_url:                         
        sm_flickr_url:                           
        sm_twitter_url:                          
        sm_instagram_url:                        
        sm_youtube_url:                          
        landing_background:                      dist/cat.webp
        site_title:                              Photos
        footer_show_copyright:                   0
        site_copyright_begin:                    1930
        site_copyright_end:                      1931
        footer_additional_text:                  
        footer_show_social_media:                0
        search_public:                           0
        SL_enable:                               0
        SL_for_admin:                            0
        recent_age:                              1
        grants_download:                         1
        photos_wraparound:                       1
        map_display:                             1
        zip64:                                   1
        map_display_public:                      0
        map_provider:                            Wikimedia
        force_32bit_ids:                         0
        map_include_subalbums:                   1
        update_check_every_days:                 100
        has_exiftool:                            0
        share_button_visible:                    1
        import_via_symlink:                      0
        has_ffmpeg:                              1
        location_decoding:                       1
        location_decoding_timeout:               30
        location_show:                           1
        location_show_public:                    0
        rss_enable:                              0
        rss_recent_days:                         7
        rss_max_items:                           100
        prefer_available_xmp_metadata:           0
        editor_enabled:                          1
        lossless_optimization:                   0
        swipe_tolerance_x:                       150
        swipe_tolerance_y:                       250
        local_takestamp_video_formats:           .avi|.mov
        log_max_num_line:                        1000
        unlock_password_photos_with_url_param:   0
        nsfw_visible:                            1
        nsfw_blur:                               0
        nsfw_warning:                            0
        nsfw_warning_admin:                      0
        nsfw_banner_override:                    
        map_display_direction:                   1
        album_subtitle_type:                     oldstyle
        upload_processing_limit:                 4
        new_photos_notification:                 0
        legacy_id_redirection:                   1
        zip_deflate_level:                       6
        SA_enabled:                              1
        default_album_protection:                1
        album_decoration:                        layers
        album_decoration_orientation:            row
        allow_username_change:                   1
        auto_fix_orientation:                    1
        use_job_queues:                          0
        random_album_id:                         starred
        use_last_modified_date_when_no_exif_date: 0
        ffmpeg_path:                             /usr/bin/ffmpeg
        ffprobe_path:                            /usr/bin/ffprobe
        layout:                                  justified
        date_format_photo_thumb:                 M j, Y, g:i:s A e
        date_format_photo_overlay:               M j, Y, g:i:s A e
        date_format_sidebar_uploaded:            M j, Y, g:i:s A e
        date_format_sidebar_taken_at:            M j, Y, g:i:s A e
        date_format_hero_min_max:                F Y
        date_format_hero_created_at:             M j, Y, g:i:s A T
        date_format_album_thumb:                 M Y
        upload_chunk_size:                       0
        nsfw_banner_blur_backdrop:               0
        search_pagination_limit:                 1000
        search_minimum_length_required:          4
        photo_layout_justified_row_height:       320
        photo_layout_masonry_column_width:       300
        photo_layout_grid_column_width:          250
        photo_layout_square_column_width:        200
        photo_layout_gap:                        12
        display_thumb_album_overlay:             always
        display_thumb_photo_overlay:             hover
        default_album_thumb_aspect_ratio:        1/1
        use_album_compact_header:                0
        login_button_position:                   left
        back_button_enabled:                     0
        back_button_text:                        Return to Home
        back_button_url:                         /
        current_job_processing_visible:          1

[nickmeast]

I upgraded to the latest Docker image today and have had the same problem. I can't see anything in the logs or diagnostics that would explain anything. I assume there's something with the filesystem permissions, but I have no idea how to fix this.

Thanks in advance.

[d7415]

I suspect a lot of the jobs are these:

Info: Found 24 small that could be generated. You can use php artisan lychee:generate_thumbs small 24 to generate them.
Info: Found 823 medium that could be generated. You can use php artisan lychee:generate_thumbs medium 823 to generate them.

I'm not sure why the queue isn't handling them, but can you try running those commands from the Lychee directory?

[hess8]

I also suspect permission errors. Here is my method of setting them ``` sudo chown -R www-data:www-data . sudo chmod -R 2775 storage/ sudo chmod -R 2775 public/sym/ ``` Photos need to be permissions 664. Directories need to be 2775 ``` sudo find public/uploads/ -type f -print0 | sudo xargs -0 chmod 644 sudo find public/uploads/ -type d -print0 | sudo xargs -0 chmod 277 ``` Are there others that I need?

…

On Mon, Apr 22, 2024 at 5:38 PM Bret Hess ***@***.***> wrote: I did run those commands and it cycles through them but for each it says "Did not create thumbnail", etc It's strange that no errors appear, not even in lychee.error.log On Mon, Apr 22, 2024 at 4:57 PM Martin Stone ***@***.***> wrote: > I suspect a lot of the jobs are these: > > Info: Found 24 small that could be generated. You can use php artisan > lychee:generate_thumbs small 24 to generate them. > Info: Found 823 medium that could be generated. You can use php artisan > lychee:generate_thumbs medium 823 to generate them. > > I'm not sure why the queue isn't handling them, but can you try running > those commands from the Lychee directory? > > — > Reply to this email directly, view it on GitHub > <#2402 (comment)>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AAVW7WDMFVMMMO3A6T5QF6TY6WIUDAVCNFSM6AAAAABGRX7R76VHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4TCOJUGQ3TK> > . > You are receiving this because you authored the thread.Message ID: > ***@***.***> >

[ildyria]

After having done this, do the pictures still now show when uploaded?

[nickmeast]

I've also tried the commands above with the same results. One thing I've noticed is when I try to download original images, I get a double file extension, e.g. photo.jpg.jpg

Is there anything else I can try? How would I go about rolling back the version if I'm using Docker?

[ildyria]

Is there anything else I can try? How would I go about rolling back the version if I'm using Docker?

If you are using a docker compose, you can set the tag bag, sh into the container and then run:

php artisan migrate:rollback

This should revert the migration back to the latest state.

You can also check the migration status with :

php artisan migrate:status

To see which migrations where run by chunks.

[nickmeast]

I created a new instance from scratch and am having the same issue with no images being shown. Diagnostics below:

    Diagnostics
    -----------
        Warning: Dropbox import not working. dropbox_key is empty.
        Info: Latest version of PHP is 8.3
        Warning: git (software) is not available.
    

    System Information
    ------------------
        Lychee Version (tag):                    v5.2.2 (6a0bebe) -- Up to date (2 minutes ago).
        DB Version:                              5.2.2
        
        composer install:                        --no-dev
        APP_ENV:                                 production
        APP_DEBUG:                               false
        APP_URL:                                 set
        APP_DIR:                                 set
        LOG_VIEWER_ENABLED:                      true
        LIVEWIRE_ENABLED:                        true
        
        System:                                  Linux
        PHP Version:                             8.2.18
        PHP User agent:                          Lychee/4 (https://lycheeorg.github.io/)
        Timezone:                                Europe/London
        Max uploaded file size:                  100M
        Max post size:                           100M
        Livewire chunk size:                     12.00 MB
        Max execution time:                      3600
        MySQL Version:                           10.11.7-MariaDB-1:10.11.7+maria~ubu2204
        
        exec() Available:                        yes
        Imagick Available:                       1
        Imagick Enabled:                         1
        Imagick Version:                         1691
        GD Version:                              2.3.3
        Number of foreign key:                   12 found.
    

    Config Information
    ------------------
        version:                                 050202
        check_for_updates:                       0
        sorting_photos_col:                      taken_at
        sorting_photos_order:                    ASC
        sorting_albums_col:                      max_taken_at
        sorting_albums_order:                    ASC
        imagick:                                 1
        skip_duplicates:                         0
        small_max_width:                         0
        small_max_height:                        360
        medium_max_width:                        1920
        medium_max_height:                       1080
        lang:                                    en
        image_overlay_type:                      desc
        default_license:                         none
        compression_quality:                     90
        grants_full_photo_access:                1
        delete_imported:                         0
        mod_frame_enabled:                       1
        mod_frame_refresh:                       30
        thumb_2x:                                1
        small_2x:                                1
        medium_2x:                               1
        landing_page_enable:                     0
        force_migration_in_production:           0
        search_public:                           0
        hide_version_number:                     0
        SL_enable:                               0
        SL_for_admin:                            0
        recent_age:                              1
        grants_download:                         0
        photos_wraparound:                       1
        map_display:                             0
        zip64:                                   1
        map_display_public:                      0
        map_provider:                            Wikimedia
        force_32bit_ids:                         0
        map_include_subalbums:                   0
        update_check_every_days:                 3
        has_exiftool:                            1
        share_button_visible:                    0
        import_via_symlink:                      0
        has_ffmpeg:                              1
        location_decoding:                       0
        location_decoding_timeout:               30
        location_show:                           1
        location_show_public:                    0
        rss_enable:                              0
        rss_recent_days:                         7
        rss_max_items:                           100
        prefer_available_xmp_metadata:           0
        editor_enabled:                          1
        lossless_optimization:                   0
        swipe_tolerance_x:                       150
        swipe_tolerance_y:                       250
        local_takestamp_video_formats:           .avi|.mov
        log_max_num_line:                        1000
        unlock_password_photos_with_url_param:   0
        nsfw_visible:                            1
        nsfw_blur:                               0
        nsfw_warning:                            0
        nsfw_warning_admin:                      0
        nsfw_banner_override:                    
        map_display_direction:                   1
        album_subtitle_type:                     oldstyle
        upload_processing_limit:                 4
        new_photos_notification:                 0
        legacy_id_redirection:                   1
        zip_deflate_level:                       6
        SA_enabled:                              1
        default_album_protection:                1
        album_decoration:                        layers
        album_decoration_orientation:            row
        allow_username_change:                   1
        auto_fix_orientation:                    1
        use_job_queues:                          0
        random_album_id:                         starred
        use_last_modified_date_when_no_exif_date: 0
        layout:                                  justified
        date_format_photo_thumb:                 M j, Y, g:i:s A e
        date_format_photo_overlay:               M j, Y, g:i:s A e
        date_format_sidebar_uploaded:            M j, Y, g:i:s A e
        date_format_sidebar_taken_at:            M j, Y, g:i:s A e
        date_format_hero_min_max:                F Y
        date_format_hero_created_at:             M j, Y, g:i:s A T
        date_format_album_thumb:                 M Y
        upload_chunk_size:                       0
        nsfw_banner_blur_backdrop:               0
        search_pagination_limit:                 1000
        search_minimum_length_required:          4
        photo_layout_justified_row_height:       320
        photo_layout_masonry_column_width:       300
        photo_layout_grid_column_width:          250
        photo_layout_square_column_width:        200
        photo_layout_gap:                        12
        display_thumb_album_overlay:             always
        display_thumb_photo_overlay:             hover
        default_album_thumb_aspect_ratio:        1/1
        use_album_compact_header:                0
        login_button_position:                   left
        back_button_enabled:                     0
        back_button_text:                        Return to Home
        current_job_processing_visible:          1

[hess8]

I updated to v5.3.0, and there is some progress! The photos now appear. But the jobs queue is still stuck at the bottom at 874 jobs.

…

On Sun, Apr 28, 2024 at 11:13 AM Benoît Viguier ***@***.***> wrote: After having done this, do the pictures still now show when uploaded? — Reply to this email directly, view it on GitHub <#2402 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAVW7WCXNFVUMXZ5YG2AVCDY7UU2NAVCNFSM6AAAAABGRX7R76VHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4TENJTGY3TG> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[ildyria]

I updated to v5.3.0, and there is some progress! The photos now appear.

Wohoooo. :)

But the jobs queue is still stuck at the bottom at 874 jobs.

Yeah, just ignore it. The jobs clearly didn't start as expected and are nowhere to be found for sure.
You can kill/clear that list by going into the maintenance page (accessible via the left menu).

[hess8]

Thanks for the help!

FYI I did go to Maintenance, and it has the same behavior as the command line: the same "Found 823 medium that could be generated.", etc. I clicked on each and it says Generating, then "Generated successfully 0 items". The notices never go away.

But the jobs queue no longer appears one each photo page! So while it still looks a little buggy on the Maintenance page, I'm good!

[ildyria]

"Found 823 medium that could be generated.", etc. I clicked on each and it says Generating, then "Generated successfully 0 items".

I will need to check on that one, but on the bright side you no longer have the problem of the 800 queue items. :)

[hess8]

Yep I'm happy now.

…

On Sat, May 4, 2024, 11:38 AM Benoît Viguier ***@***.***> wrote: "Found 823 medium that could be generated.", etc. I clicked on each and it says Generating, then "Generated successfully 0 items". I will need to check on that one, but on the bright side you no longer have the problem of the 800 queue items. :) — Reply to this email directly, view it on GitHub <#2402 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAVW7WB2TA5HWOBRLPI23CLZAUMLHAVCNFSM6AAAAABGRX7R76VHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4TGMJVGQYTE> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[nickmeast]

Sorry, I've been away for a few days. I'm still having the same issue at v5.3. I'll try installing a brand new instance and let you know how it goes.

` System Information
------------------
Lychee Version (tag): v5.3.0 (e8f442e) -- Up to date (0 seconds ago).
DB Version: 5.3.0

    composer install:                        --no-dev
    APP_ENV:                                 local
    APP_DEBUG:                               false
    APP_URL:                                 set
    APP_DIR:                                 set
    LOG_VIEWER_ENABLED:                      true
    LIVEWIRE_ENABLED:                        true
    
    System:                                  Linux
    PHP Version:                             8.2.18
    PHP User agent:                          Lychee/4 (https://lycheeorg.github.io/)
    Timezone:                                Europe/London
    Max uploaded file size:                  100M
    Max post size:                           100M
    Livewire chunk size:                     12.00 MB
    Max execution time:                      3600
    MySQL Version:                           10.11.7-MariaDB-1:10.11.7+maria~ubu2204
    
    exec() Available:                        yes
    Imagick Available:                       1
    Imagick Enabled:                         1
    Imagick Version:                         1691
    GD Version:                              2.3.3
    Number of foreign key:                   12 found.`

[nickmeast]

I have created a whole new deployment, new DB, new Docker image (latest version), nothing shared with the previous one. I can upload images and the Job History shows them completing successfully. Any further thoughts? I might just delete everything and start again from scratch.

[ildyria]

depending of the size of your install that might be an idea.
I am currently migrating between two servers with more than 500GB of image data. It is taking me hours to move the images. :(
(the DB was very easy on the other hand).

[hess8]

Nick, when I upgraded from 5.1 to 5.3, the only thing I remember I did differently (vs from 4.x to 5.1) was that I was careful to only change permissions when diagnostics asked for it. Before, I set a couple of entire folders recursively with the permissions requested for a couple files in them. Not sure that would help you if you rolled back and tried updating again. I do remember when I was using 3 or 4 that some permissions errors also caused my photos to be blank.

…

On Sun, May 5, 2024 at 4:47 AM nickmeast ***@***.***> wrote: I have created a whole new deployment, new DB, new Docker image (latest version), nothing shared with the previous one. I can upload images and the Job History shows them completing successfully. Any further thoughts? I might just delete everything and start again from scratch. — Reply to this email directly, view it on GitHub <#2402 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAVW7WADGCBFHIYLGSPZQJTZAYE37AVCNFSM6AAAAABGRX7R76VHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4TGMJZGIZTM> . You are receiving this because you were mentioned.Message ID: ***@***.***>