LFMix: A Lightweight Hybrid Architecture for Light Field Super-Resolution

Mingyang Yu, Zhijian Wu, Dingjiang Huang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

Light field super-resolution (LFSR) faces the critical challenge of balancing computational efficiency with high quality reconstruction while maintaining spatial and angular consistency. Existing methods suffer from architectural trade-offs between the effectiveness of Transformers and the efficiency of CNNs, coupled with insufficient frequency modelling leading to blurred textures. We propose LFMix, a hybrid CNN-Transformer architecture that processes three complementary light field representations: sub-aperture images (SAIs), macro-pixel images (MacPIs), and epipolar plane images (EPIs). Our core innovation lies in the MixBlock design, which combines spatial convolution, spectral self-attention and dedicated high-frequency enhancement through learnable filtering. The architecture achieves computational efficiency through strategic down-sampling in spectral processing while preserving full resolution spatial detail. A dual-domain loss function combining pixel and frequency constraints further enhances high-frequency detail preservation. Extensive experiments on five benchmarks show that our method achieves the best performance among models with comparable computational cost, reaching 32.99 dB PSNR with only 0.98M parameters and 19.48 GFLOPs.

Original languageEnglish
Title of host publicationProceedings - 2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2025
PublisherIEEE Computer Society
Pages1441-1450
Number of pages10
ISBN (Electronic)9798331599942
DOIs
StatePublished - 2025
Event2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2025 - Nashville, United States
Duration: 11 Jun 202512 Jun 2025

Publication series

NameIEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
ISSN (Print)2160-7508
ISSN (Electronic)2160-7516

Conference

Conference2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2025
Country/TerritoryUnited States
CityNashville
Period11/06/2512/06/25

Keywords

  • hybrid architecture
  • light field super-resolution
  • lightweight design

Fingerprint

Dive into the research topics of 'LFMix: A Lightweight Hybrid Architecture for Light Field Super-Resolution'. Together they form a unique fingerprint.

Cite this