Tags on videos

[EpsiRho]

The bug

I have Keywords metadata set on my images (jpg / png) using XMP.Subject and XMP.LastKeywordXMP, and videos (mp4, webm) using either QuickTime:Category or QuickTime:Keyword. These show up in Window's File Properties dialog (Under Details/Tags), and allow for searching files by tag, which is why I currently use them.

png/jpg set their tags in Immch on upload using the XMP values. mp4/webm upload fine, but do not port their tags over to Immch. I looked briefly into setting XMP values on the videos instead of QuickTime values, but as far as I can tell mp4/webm formats do not support it, so this is just how Windows sets the Tags property for them.

I'm uncertain if this is a bug or if Tag porting just doesn't support the video format's Keyword/Category. Either way I'd love if it did xP

The OS that Immich Server is running on

Windows 11 (Using WSL2 & Docker)

Version of Immich Server

v1.124.2

Version of Immich Mobile App

(Using Web App)

Platform with the issue

• Server
• Web
• Mobile

Your docker-compose.yml content

#
# WARNING: Make sure to use the docker-compose.yml of the current release:
#
# https://github.com/immich-app/immich/releases/latest/download/docker-compose.yml
#
# The compose file on main may not be compatible with the latest release.
#

name: immich

services:
  immich-server:
    container_name: immich_server
    image: ghcr.io/immich-app/immich-server:${IMMICH_VERSION:-release}
    # extends:
    #   file: hwaccel.transcoding.yml
    #   service: cpu # set to one of [nvenc, quicksync, rkmpp, vaapi, vaapi-wsl] for accelerated transcoding
    volumes:
      # Do not edit the next line. If you want to change the media storage location on your system, edit the value of UPLOAD_LOCATION in the .env file
      - ${UPLOAD_LOCATION}:/usr/src/app/upload
      - /etc/localtime:/etc/localtime:ro
    env_file:
      - .env
    ports:
      - '2283:2283'
    depends_on:
      - redis
      - database
    restart: always
    healthcheck:
      disable: false

  immich-machine-learning:
    container_name: immich_machine_learning
    # For hardware acceleration, add one of -[armnn, cuda, openvino] to the image tag.
    # Example tag: ${IMMICH_VERSION:-release}-cuda
    image: ghcr.io/immich-app/immich-machine-learning:${IMMICH_VERSION:-release}
    # extends: # uncomment this section for hardware acceleration - see https://immich.app/docs/features/ml-hardware-acceleration
    #   file: hwaccel.ml.yml
    #   service: cpu # set to one of [armnn, cuda, openvino, openvino-wsl] for accelerated inference - use the `-wsl` version for WSL2 where applicable
    volumes:
      - model-cache:/cache
    env_file:
      - .env
    restart: always
    healthcheck:
      disable: false

  redis:
    container_name: immich_redis
    image: docker.io/redis:6.2-alpine@sha256:eaba718fecd1196d88533de7ba49bf903ad33664a92debb24660a922ecd9cac8
    healthcheck:
      test: redis-cli ping || exit 1
    restart: always

  database:
    container_name: immich_postgres
    image: docker.io/tensorchord/pgvecto-rs:pg14-v0.2.0@sha256:90724186f0a3517cf6914295b5ab410db9ce23190a2d9d0b9dd6463e3fa298f0
    environment:
      POSTGRES_PASSWORD: ${DB_PASSWORD}
      POSTGRES_USER: ${DB_USERNAME}
      POSTGRES_DB: ${DB_DATABASE_NAME}
      POSTGRES_INITDB_ARGS: '--data-checksums'
    volumes:
      # Do not edit the next line. If you want to change the database storage location on your system, edit the value of DB_DATA_LOCATION in the .env file
      - ${DB_DATA_LOCATION}:/var/lib/postgresql/data
    healthcheck:
      test: >-
        pg_isready --dbname="$${POSTGRES_DB}" --username="$${POSTGRES_USER}" || exit 1;
        Chksum="$$(psql --dbname="$${POSTGRES_DB}" --username="$${POSTGRES_USER}" --tuples-only --no-align
        --command='SELECT COALESCE(SUM(checksum_failures), 0) FROM pg_stat_database')";
        echo "checksum failure count is $$Chksum";
        [ "$$Chksum" = '0' ] || exit 1
      interval: 5m
      start_interval: 30s
      start_period: 5m
    command: >-
      postgres
      -c shared_preload_libraries=vectors.so
      -c 'search_path="$$user", public, vectors'
      -c logging_collector=on
      -c max_wal_size=2GB
      -c shared_buffers=512MB
      -c wal_compression=on
    restart: always

volumes:
  model-cache:

Your .env content

# You can find documentation for all the supported env variables at https://immich.app/docs/install/environment-variables

# The location where your uploaded files are stored
UPLOAD_LOCATION=D:/immich/library
# The location where your database files are stored
DB_DATA_LOCATION=D:/immich/postgres

# To set a timezone, uncomment the next line and change Etc/UTC to a TZ identifier from this list: https://en.wikipedia.org/wiki/List_of_tz_database_time_zones#List
# TZ=Etc/UTC

# The Immich version to use. You can pin this to a specific version like "v1.71.0"
IMMICH_VERSION=release

# Connection secret for postgres. You should change it to a random password
# Please use only the characters `A-Za-z0-9`, without special characters or spaces
DB_PASSWORD=peepeepoopoo4299

# The values below this line do not need to be changed
###################################################################################
DB_USERNAME=postgres
DB_DATABASE_NAME=immich

Reproduction steps

1. In windows, set an mp4 and a png's File Properties -> Details -> Tags to contain any tag(s).
2. Upload both the mp4 and png to Immch
3. Note the png has the tag(s) set in Immch's web UI, but the mp4 does not. Tags that did not exist before are created by the png's upload, but not the mp4's.
   ...

Relevant log output

Additional information

No response

[danieldietzler]

I've migrated it to a feature request, as we currently say that we only read tags from exif data, and as you have confirmed this is not exif. I think it's still a viable request though, but idk how easy you can get those tags.

[EpsiRho]

Ah, that's my misunderstanding. The "exif reader" I was using to test also showed these tags, so I assumed they all feel under that category. If the QuickTime tags are technically something different that makes a lot more sense haha. I should also append that with webm it shows sometimes shows under Matroska -> Keywords-und rather than QuickTime -> Category or QuickTime -> Keywords

[bo0tzz]

Can you investigate whether exiftool or ffprobe is able to extract those tags?