[BUG] Error: Write EPIPE when playing a video outside of local network

[Uzurka]

The bug

Hello.
I created a shared album to share some photos & videos to my familly, then complained about videos can't load.
I tried some things to debug, and i got this :
Playing a video from immich web or iOS app is working fine as long as i'm connected to the same network.
When i use 5G/LTE, i got those errors in immich-server logs :
[Nest] 7 - 10/16/2023, 6:52:12 AM ERROR [AssetService] Unable to send file: Error Error: write EPIPE at WriteWrap.onWriteComplete [as oncomplete] (node:internal/stream_base_commons:94:16)

The OS that Immich Server is running on

Debian 12 Docker

Version of Immich Server

1.81.1

Version of Immich Mobile App

latest

Platform with the issue

• Server
• Web
• Mobile

Your docker-compose.yml content

Not a compose but ansible variables :
# Immich related containers
  - name: typesense
    restart_policy: always
    image: typesense/typesense:0.24.1
    networks: 
    - name: immich
    env:
      TYPESENSE_API_KEY: '{{ typesense_api_key }}'
      TYPESENSE_DATA_DIR: /data
      # remove this to get debug messages
      GLOG_minloglevel: '1'
    mounts:
      - source: tsdata
        target: /data
        type: volume
    labels: 
      com.centurylinklabs.watchtower.enable: 'true'

  - name: immich_redis
    image: redis:latest
    hostname: immich_redis
    restart_policy: always
    networks:
      - name: immich
    mounts:
      - source: /mnt/sdb1/immich-redis
        target: /data
        type: bind
    env:
      TZ: "Europe/Paris"
      ALLOW_EMPTY_PASSWORD: "yes"
      WORKDIR: /data
    labels:
      com.centurylinklabs.watchtower.enable: 'true'
    state: absent

  - name: immich-server
    restart_policy: always
    image: ghcr.io/immich-app/immich-server:release
    networks: 
      - name: immich
    ports: 
      3001:3001
    env: 
      SERVER_PORT: '3001'
      REDIS_HOSTNAME: '{{ redis_host }}'
      REDIS_PORT: '{{ redis_port }}'
      DB_HOSTNAME: '{{ postgres_host }}'
      DB_PORT: '{{ postgres_port }}'
      DB_USERNAME: immich
      DB_PASSWORD: '{{ immich_postgres_password }}'
      DB_DATABASE: immich
      DB_DATABASE_NAME: immich
      TYPESENSE_API_KEY: '{{ typesense_api_key }}'
    command: [ "start.sh", "immich" ]
    mounts:
      - source: /mnt/sdb1/immich
        target: /usr/src/app/upload
        type: bind
    labels: 
      com.centurylinklabs.watchtower.enable: 'true'

  - name: immich-microservices
    restart_policy: always
    cpus: '0.5'
    image: ghcr.io/immich-app/immich-server:release
    networks: 
      - name: immich
    ports:
      - 3002:3002
    runtime: nvidia
    command: [ "start.sh", "microservices" ]
    mounts:
      - source: /mnt/sdb1/immich
        target: /usr/src/app/upload
        type: bind
    env:
      NVIDIA_VISIBLE_DEVICES: 'all'
      NVIDIA_DRIVER_CAPABILITIES: 'all'
      MICROSERVICES_PORT: '3002'
      REDIS_HOSTNAME: '{{ redis_host }}'
      REDIS_PORT: '{{ redis_port }}'
      DB_HOSTNAME: '{{ postgres_host }}'
      DB_PORT: '{{ postgres_port }}'
      DB_USERNAME: immich
      DB_PASSWORD: '{{ immich_postgres_password }}'
      DB_DATABASE: immich
      DB_DATABASE_NAME: immich
      TYPESENSE_API_KEY: '{{ typesense_api_key }}'
      DISABLE_REVERSE_GEOCODING: 'true'
    labels: 
      com.centurylinklabs.watchtower.enable: 'true'
    device_requests:
      - count: '-1'
        driver: nvidia
        capabilities: 
          - 'gpu'
          - 'video'

  - name: immich-machine-learning
    restart_policy: always
    image: ghcr.io/immich-app/immich-machine-learning:release
    cpus: '0.5'
    networks: 
      - name: immich
    env: 
      MACHINE_LEARNING_HOST: '0.0.0.0'
      MACHINE_LEARNING_PORT: '3003'
    mounts:
      - source: model-cache
        target: /cache
        type: volume
    labels: 
      com.centurylinklabs.watchtower.enable: 'true'

  - name: immich-web
    networks: 
      - name: immich
    ports:
      - 3000:3000
    restart_policy: always
    image: ghcr.io/immich-app/immich-web:release
    env: 
      PORT: '3000'
    labels: 
      com.centurylinklabs.watchtower.enable: 'true'
    
  - name: immich-proxy
    restart_policy: always
    image: ghcr.io/immich-app/immich-proxy:release
    networks: 
      - name: immich
    env:
      # Make sure these values get passed through from the env file
      IMMICH_SERVER_URL: 'http://192.168.1.13:3001'
      IMMICH_WEB_URL: 'http://192.168.1.13:3000'
      PUBLIC_IMMICH_SERVER_URL: https://immich.{{ domain }}
    ports:
      - 8081:8080
    labels:
      com.centurylinklabs.watchtower.enable: 'true'

Your .env content

None, everything in my Ansible vars

Reproduction steps

1.Upload photos & videos to a shared album
2. Try to load videos from WAN
3.
...

Additional information

No response

[CJCutrone]

I'm also having this issue.

Occasionally, the videos won't play even inside my local network and I have to restart the server (not sure if this is related or unrelated). Then they'll play inside my local network, but won't play when outside. The pictures are visible, the thumbnails for the videos are visible, but the videos won't play.

Not sure if there's anything else that might be needed to hunt this issue down, but I can try to provide anything needed.

[pedropombeiro]

I'm also seeing this trying to play videos from an Android TV device on a separate VLAN. Connecting directly through HTTP (no HTTPS termination) didn't help.

[Uzurka]

Hi!
I was able to resolve the issue but tbh, i don't remember how at all !
I'll share here my ansible variables for the containers, hoping that helps :

# Immich related containers

  - name: immich-server
    restart_policy: always
    image: ghcr.io/immich-app/immich-server:release
    networks: 
      - name: immich
    ports: 
      3001:3001
    env: 
      SERVER_PORT: '3001'
      REDIS_HOSTNAME: '{{ redis_host }}'
      REDIS_PORT: '{{ redis_port }}'
      DB_HOSTNAME: '{{ postgres_host }}'
      DB_PORT: '{{ postgres_port }}'
      DB_USERNAME: immich
      DB_PASSWORD: '{{ immich_postgres_password }}'
      DB_DATABASE: immich
      DB_DATABASE_NAME: immich
      TYPESENSE_API_KEY: '{{ typesense_api_key }}'
    command: [ "start.sh", "immich" ]
    mounts:
      - source: /mnt/immich/data
        target: /usr/src/app/upload
        type: bind
    labels: 
      com.centurylinklabs.watchtower.enable: 'true'
      container_name: immich-server

  - name: immich-microservices
    restart_policy: always
    cpus: '0.5'
    image: ghcr.io/immich-app/immich-server:release
    networks: 
      - name: immich
    ports:
      - 3002:3002
    runtime: nvidia
    command: [ "start.sh", "microservices" ]
    mounts:
      - source: /mnt/immich/data
        target: /usr/src/app/upload
        type: bind
    env:
      NVIDIA_VISIBLE_DEVICES: 'all'
      NVIDIA_DRIVER_CAPABILITIES: 'all'
      MICROSERVICES_PORT: '3002'
      REDIS_HOSTNAME: '{{ redis_host }}'
      REDIS_PORT: '{{ redis_port }}'
      DB_HOSTNAME: '{{ postgres_host }}'
      DB_PORT: '{{ postgres_port }}'
      DB_USERNAME: immich
      DB_PASSWORD: '{{ immich_postgres_password }}'
      DB_DATABASE: immich
      DB_DATABASE_NAME: immich
      TYPESENSE_API_KEY: '{{ typesense_api_key }}'
      DISABLE_REVERSE_GEOCODING: 'true'
    labels: 
      com.centurylinklabs.watchtower.enable: 'true'
      container_name: immich-microservices
    device_requests:
      - count: '-1'
        driver: nvidia
        capabilities: 
          - 'gpu'
          - 'video'

  - name: immich-machine-learning
    restart_policy: always
    image: ghcr.io/immich-app/immich-machine-learning:release
    cpus: '0.5'
    networks: 
      - name: immich
    env: 
      MACHINE_LEARNING_HOST: '0.0.0.0'
      MACHINE_LEARNING_PORT: '3003'
    mounts:
      - source: model-cache
        target: /cache
        type: volume
    labels: 
      com.centurylinklabs.watchtower.enable: 'true'
      container_name: immich-machine-learning

[dloadr]

Do you think it could have been related to the storage you were using for the upload directory? I see that changed between your original config and the above.
I get lots of these errors when playing videos (either hovering over the thumbnail or clicking into it), but I dont notice a difference between being on the local network vs connecting remotely.
Would be great to solve this and have clean logs!

[pedropombeiro]

I'm no longer seeing this issue - not sure what changed 🤷