CompressedVQA-HDR: Generalized Full-reference and No-reference Quality Assessment Models for Compressed High Dynamic Range Videos

  • Wei Sun
  • , Linhan Cao
  • , Kang Fu
  • , Dandan Zhu*
  • , Jun Jia
  • , Menghan Hu
  • , Xiongkuo Min
  • , Guangtao Zhai*
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Video compression is a standard procedure applied to all videos to minimize storage and transmission demands while preserving visual quality as much as possible. Therefore, evaluating the visual quality of compressed videos is crucial for guiding the practical usage and further development of video compression algorithms. Although numerous compressed video quality assessment (VQA) methods have been proposed, they often lack the generalization capability needed to handle the increasing diversity of video types, particularly high dynamic range (HDR) content. In this paper, we introduce CompressedVQA-HDR, an effective VQA framework designed to address the challenges of HDR video quality assessment. Specifically, we adopt the Swin Transformer and SigLip 2 as the backbone networks for the proposed full-reference (FR) and no-reference (NR) VQA models, respectively. For the FR model, we compute deep structural and textural similarities between reference and distorted frames using intermediate-layer features extracted from the Swin Transformer as its quality-aware feature representation. For the NR model, we extract the global mean of the final-layer feature maps from SigLip 2 as its quality-aware representation. To mitigate the issue of limited HDR training data, we pre-train the FR model on a large-scale standard dynamic range (SDR) VQA dataset and fine-tune it on the HDRSDR-VQA dataset. For the NR model, we employ an iterative mixed-dataset training strategy across multiple compressed VQA datasets, followed by fine-tuning on the HDRSDR-VQA dataset. Experimental results show that our models achieve state-of-the-art performance compared to existing FR and NR VQA models. The code is available at https://github.com/sunwei925/CompressedVQA-HDR.

Original languageEnglish
Title of host publicationIEEE International Conference on Multimedia and Expo Workshops
Subtitle of host publicationJourney to the Center of Machine Imagination, ICMEW 2025 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798331587437
DOIs
StatePublished - 2025
Event2025 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2025 - Nantes, France
Duration: 30 Jun 20254 Jul 2025

Publication series

NameIEEE International Conference on Multimedia and Expo Workshops: Journey to the Center of Machine Imagination, ICMEW 2025 - Proceedings

Conference

Conference2025 IEEE International Conference on Multimedia and Expo Workshops, ICMEW 2025
Country/TerritoryFrance
CityNantes
Period30/06/254/07/25

Keywords

  • High dynamic range content
  • compressed videos
  • deep neural network
  • video quality assessment

Fingerprint

Dive into the research topics of 'CompressedVQA-HDR: Generalized Full-reference and No-reference Quality Assessment Models for Compressed High Dynamic Range Videos'. Together they form a unique fingerprint.

Cite this