Problem detecting similar HEIC files

[carlosjfcasero]

Bug Description

Not detecting similar HEIC images

Steps to reproduce:

1. Run docker-czkawka
2. Add a folder that contains both JPG and HEIC files, similar between them
3. Click on search similar images
4. JPG-JPG similar pictures are listed. HEIC-JPG and HEIC-HEIC are not. Following errors are displayed:

############### MESSAGES(2) ###############
Properly loaded 1621 cache entries.
Properly saved to file 1621 cache entries.
############### ERRORS(973) ###############
Cannot open image file "/storage/immich/2024/09/20240920-214432.HEIC": Cannot open heic file "/storage/immich/2024/09/20240920-214432.HEIC": InvalidInput(Unspecified) Invalid input: Unspecified: Too many auxiliary image references
Cannot open image file "/storage/immich/2024/09/20240921-174901.HEIC": Cannot open heic file "/storage/immich/2024/09/20240921-174901.HEIC": InvalidInput(Unspecified) Invalid input: Unspecified: Too many auxiliary image references
Cannot open image file "/storage/immich/2024/09/20240922-143659.HEIC": Cannot open heic file "/storage/immich/2024/09/20240922-143659.HEIC": InvalidInput(Unspecified) Invalid input: Unspecified: Metadata not correctly assigned to image
Cannot open image file "/storage/immich/2024/09/20240922-143702.HEIC": Cannot open heic file "/storage/immich/2024/09/20240922-143702.HEIC": InvalidInput(Unspecified) Invalid input: Unspecified: Metadata not correctly assigned to image
Cannot open image file "/storage/immich/2024/09/20240922-143721.HEIC": Cannot open heic file "/storage/immich/2024/09/20240922-143721.HEIC": InvalidInput(Unspecified) Invalid input: Unspecified: Metadata not correctly assigned to image
Cannot open image file "/storage/immich/2024/09/20240922-143723.HEIC": Cannot open heic file "/storage/immich/2024/09/20240922-143723.HEIC": InvalidInput(Unspecified) Invalid input: Unspecified: Metadata not correctly assigned to image
Cannot open image file "/storage/immich/2024/09/20240922-143725.HEIC": Cannot open heic file "/storage/immich/2024/09/20240922-143725.HEIC": InvalidInput(Unspecified) Invalid input: Unspecified: Metadata not correctly assigned to image
Cannot open image file "/storage/immich/2024/09/20240922-143728.HEIC": Cannot open heic file "/storage/immich/2024/09/20240922-143728.HEIC": InvalidInput(Unspecified) Invalid input: Unspecified: Metadata not correctly assigned to image
Cannot open image file "/storage/immich/2024/09/20240922-143803.HEIC": Cannot open heic file "/storage/immich/2024/09/20240922-143803.HEIC": InvalidInput(Unspecified) Invalid input: Unspecified: Metadata not correctly assigned to image
Cannot open image file "/storage/immich/2024/09/20240922-143810.HEIC": Cannot open heic file "/storage/immich/2024/09/20240922-143810.HEIC": InvalidInput(Unspecified) Invalid input: Unspecified: Metadata not correctly assigned to image

6. Additionally, if click on search bad extensions, all HEIC files are listed, with HEIF as "proper extension"

Terminal output (optional):

czkawka  | [app         ] 11:40:32.042 [DEBUG] czkawka_core::similar_images: check_for_similar_images
czkawka  | [app         ] 11:40:32.053 [DEBUG] czkawka_core::common_dir_traversal: run(collecting files/dirs)
czkawka  | [app         ] 11:40:33.164 [DEBUG] czkawka_core::common: send_info_and_wait_for_ending_all_threads
czkawka  | [app         ] 11:40:33.177 [DEBUG] czkawka_core::common: send_info_and_wait_for_ending_all_threads: Done in 12.82ms
czkawka  | [app         ] 11:40:33.177 [DEBUG] czkawka_core::common_dir_traversal: Collected 2604 files
czkawka  | [app         ] 11:40:33.178 [DEBUG] czkawka_core::common_dir_traversal: run(collecting files/dirs): Done in 1.12s
czkawka  | [app         ] 11:40:33.210 [DEBUG] czkawka_core::similar_images: check_files - Found 2604 image files.
czkawka  | [app         ] 11:40:33.210 [DEBUG] czkawka_core::similar_images: check_for_similar_images: Done in 1.17s
czkawka  | [app         ] 11:40:33.210 [DEBUG] czkawka_core::similar_images: hash_images
czkawka  | [app         ] 11:40:33.210 [DEBUG] czkawka_core::similar_images: hash_images_load_cache
czkawka  | [app         ] 11:40:33.221 [DEBUG] czkawka_core::common_cache: load_cache_from_file_generalized_by_path
czkawka  | [app         ] 11:40:33.221 [DEBUG] czkawka_core::common_cache: load_cache_from_file_generalized
czkawka  | [app         ] 11:40:33.304 [DEBUG] czkawka_core::common_cache: Starting removing outdated cache entries (removing non existent files from cache - true)
czkawka  | [app         ] 11:40:33.354 [DEBUG] czkawka_core::common_cache: Completed removing outdated cache entries, removed 0 out of all 1621 entries
czkawka  | [app         ] 11:40:33.354 [DEBUG] czkawka_core::common_cache: Loaded cache from file cache_similar_images_16_Gradient_Lanczos3_80.bin (or json alternative) - 1621 results
czkawka  | [app         ] 11:40:33.354 [DEBUG] czkawka_core::common_cache: load_cache_from_file_generalized: Done in 132.46ms
czkawka  | [app         ] 11:40:33.355 [DEBUG] czkawka_core::common_cache: Converting cache Vec<T> into BTreeMap<String, T>
czkawka  | [app         ] 11:40:33.380 [DEBUG] czkawka_core::common_cache: Converted cache Vec<T> into BTreeMap<String, T>
czkawka  | [app         ] 11:40:33.380 [DEBUG] czkawka_core::common_cache: load_cache_from_file_generalized_by_path: Done in 159.04ms
czkawka  | [app         ] 11:40:33.380 [DEBUG] czkawka_core::similar_images: hash_images-load_cache - starting calculating diff
czkawka  | [app         ] 11:40:33.420 [DEBUG] czkawka_core::similar_images: hash_images_load_cache - completed diff between loaded and prechecked files, 983(3.08 GiB) - non cached, 1621(973.71 MiB) - already cached
czkawka  | [app         ] 11:40:33.420 [DEBUG] czkawka_core::similar_images: hash_images_load_cache: Done in 210.69ms
czkawka  | [app         ] 11:40:33.425 [DEBUG] czkawka_core::similar_images: hash_images - start hashing images
czkawka  | [app         ] 11:43:04.064 [DEBUG] czkawka_core::similar_images: hash_images - end hashing 10 images
czkawka  | [app         ] 11:43:04.064 [DEBUG] czkawka_core::common: send_info_and_wait_for_ending_all_threads
czkawka  | [app         ] 11:43:04.082 [DEBUG] czkawka_core::common: send_info_and_wait_for_ending_all_threads: Done in 17.91ms
czkawka  | [app         ] 11:43:04.135 [DEBUG] czkawka_core::similar_images: save_to_cache
czkawka  | [app         ] 11:43:04.149 [DEBUG] czkawka_core::common_cache: save_cache_to_file_generalized
czkawka  | [app         ] 11:43:04.182 [DEBUG] czkawka_core::common_cache: Saved binary to file "/config/xdg/cache/czkawka/cache_similar_images_16_Gradient_Lanczos3_80.bin"
czkawka  | [app         ] 11:43:04.182 [DEBUG] czkawka_core::common_cache: Properly saved to file 1631 cache entries.
czkawka  | [app         ] 11:43:04.182 [DEBUG] czkawka_core::common_cache: save_cache_to_file_generalized: Done in 32.92ms
czkawka  | [app         ] 11:43:04.183 [DEBUG] czkawka_core::similar_images: save_to_cache: Done in 47.94ms
czkawka  | [app         ] 11:43:04.183 [DEBUG] czkawka_core::similar_images: hash_images: Done in 150.97s
czkawka  | [app         ] 11:43:04.183 [DEBUG] czkawka_core::similar_images: find_similar_hashes
czkawka  | [app         ] 11:43:04.188 [DEBUG] czkawka_core::similar_images: exclude_items_with_same_size
czkawka  | [app         ] 11:43:04.188 [DEBUG] czkawka_core::similar_images: exclude_items_with_same_size: Done in 722.00ns
czkawka  | [app         ] 11:43:04.188 [DEBUG] czkawka_core::similar_images: remove_multiple_records_from_reference_folders
czkawka  | [app         ] 11:43:04.188 [DEBUG] czkawka_core::similar_images: remove_multiple_records_from_reference_folders: Done in 222.00ns
czkawka  | [app         ] 11:43:04.188 [DEBUG] czkawka_core::similar_images: find_similar_hashes: Done in 4.20ms
czkawka  | [app         ] 11:43:04.188 [INFO] czkawka_core::similar_images: find_similar_images: Done in 152.15s
czkawka  | [app         ] 11:43:04.400 [DEBUG] czkawka_gui::compute_results: compute_similar_images
czkawka  | [app         ] 11:43:04.452 [DEBUG] czkawka_gui::compute_results: compute_similar_images: Done in 52.11ms

System

• Czkawka/Krokiet version: 8.0.0 docker
• OS version: Debian GNU/Linux 11 (bullseye) (Raspberry Pi)
• Installation method: docker

[qarmin]

This looks like a problem with of too old libheif library and problem seems to be fixed in version 1.18 version - strukturag/libheif@3a6f8cd