Multiple thermal face detection in unconstrained environments using fully convolutional networks

  • Yezhao Fan*
  • , Guangtao Zhai
  • , Jia Wang
  • , Menghan Hu
  • , Jing Liu
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Multiple thermal face detection in unconstrained environments has received increasing attention due to its potential in liveness detection and night-time surveillance. This paper presents an effective method based on fully convolutional network (FCN), density-based spatial clustering of applications with noise (DBSCAN) and non-maximum suppression (NMS) algorithm. Our proposed approach captures the thermal face features automatically using FCN. Then, an improved DBSCAN is used to detect all the faces in the thermal images. Finally, we use NMS to remove all of the bounding-boxes with an IOU (intersection over union). Experiments on RGB-D-T database show that the proposed method exceeds the state-of-the-art algorithms for single face detection on thermal images. We also build a new database with 10K multiple thermal face images in unconstrained environments. The results also show a high precision for multi-face detection tasks.

Original languageEnglish
Title of host publicationAdvances in Multimedia Information Processing – PCM 2017 - 18th Pacific-Rim Conference on Multimedia, Revised Selected Papers
EditorsBing Zeng, Hongliang Li, Qingming Huang, Abdulmotaleb El Saddik, Shuqiang Jiang, Xiaopeng Fan
PublisherSpringer Verlag
Pages24-33
Number of pages10
ISBN (Print)9783319773827
DOIs
StatePublished - 2018
Externally publishedYes
Event18th Pacific-Rim Conference on Multimedia, PCM 2017 - Harbin, China
Duration: 28 Sep 201729 Sep 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10736 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference18th Pacific-Rim Conference on Multimedia, PCM 2017
Country/TerritoryChina
CityHarbin
Period28/09/1729/09/17

Keywords

  • Density-based spatial clustering of applications with noise
  • Fully convolutional network
  • Intersection over union
  • Multiple thermal face detection
  • Nonmaximum suppression

Fingerprint

Dive into the research topics of 'Multiple thermal face detection in unconstrained environments using fully convolutional networks'. Together they form a unique fingerprint.

Cite this