PPGSpeech: A Wearable Silent Speech Interface Leveraging Neck-Worn Photoplethysmography

Silent speech interfaces (SSIs) promise private and noise-immune communication, but current solutions often sacrifice user comfort, mobility, or privacy. This article introduces PPGSpeech, a novel SSI that overcomes these limitations by pioneering the use of photoplethysmography (PPG) acquired from a comfortable, necklace-style wearable device. Our core discovery is that subtle neck muscle movements during silent articulation induce distinct, measurable modulations in the underlying PPG signal. To harness this phenomenon, we developed a complete end-to-end system featuring: 1) a custom neck-worn sensor for multiwavelength PPG acquisition; 2) a deep learning pipeline that converts 1-D PPG signals into 2-D time–frequency images via a continuous wavelet transform (CWT) and classifies them using a lightweight CNN; and 3) a Pix2Pix GAN model to reconstruct audible speech from the captured signals. In a 16-participant study covering a vocabulary of 15 commands and four confounding actions, our user-dependent model achieved a recognition accuracy of 81.41% ± 9.74 %. Furthermore, our speech reconstruction achieved a mean opinion score (MOS) of 3.48 and a word correct rate (WCR) of 60.67%, demonstrating that the PPG signal is sufficiently rich to recover intelligible speech. By establishing the viability of neck-based PPG for silent speech, PPGSpeech offers a discreet, privacy-preserving, and continuously wearable paradigm for next-generation human–computer interaction.