跳到主要导航 跳到搜索 跳到主要内容

Modelling individual head-related transfer function (HRTF) based on anthropometric parameters and generic HRTF amplitudes

  • Rui Zhang
  • , Ruijie Meng
  • , Jinqiu Sang
  • , Yi Hu
  • , Xiaodong Li
  • , Chengshi Zheng*
  • *此作品的通讯作者
  • CAS - Institute of Acoustics
  • University of Chinese Academy of Sciences
  • University of Wisconsin-Milwaukee

科研成果: 期刊稿件文章同行评审

摘要

The head-related transfer function (HRTF) plays a vital role in immersive virtual reality and augmented reality technologies, especially in spatial audio synthesis for binaural reproduction. This article proposes a deep learning method with generic HRTF amplitudes and anthropometric parameters as input features for individual HRTF generation. By designing fully convolutional neural networks, the key anthropometric parameters and the generic HRTF amplitudes were used to predict each individual HRTF amplitude spectrum in the full-space directions, and the interaural time delay (ITD) was predicted by the transformer module. In the amplitude prediction model, the attention mechanism was adopted to better capture the relationship of HRTF amplitude spectra at two distinctive directions with large angle differences in space. Finally, with the minimum phase model, the predicted amplitude spectrum and ITDs were used to obtain a set of individual head-related impulse responses. Besides the separate training of the HRTF amplitude and ITD generation models, their joint training was also considered and evaluated. The root-mean-square error and the log-spectral distortion were selected as objective measurement metrics to evaluate the performance. Subjective experiments further showed that the auditory source localisation performance of the proposed method was better than other methods in most cases.

源语言英语
页(从-至)364-378
页数15
期刊CAAI Transactions on Intelligence Technology
8
2
DOI
出版状态已出版 - 6月 2023

指纹

探究 'Modelling individual head-related transfer function (HRTF) based on anthropometric parameters and generic HRTF amplitudes' 的科研主题。它们共同构成独一无二的指纹。

引用此