Deep learning and machine learning techniques for head pose estimation: a survey [paper]

Citing

@article{algabri2024deep,
  title={Deep learning and machine learning techniques for head pose estimation: a survey},
  author={Algabri, Redhwan and Abdu, Ahmed and Lee, Sungon},
  journal={Artificial Intelligence Review},
  volume={57},
  number={10},
  pages={1--66},
  year={2024},
  publisher={Springer}
}

---

📜 Table of Contents

• 📚 2024 Conference and Journal Papers

  • Journal Papers
  • Conference Papers

• 📚 2023 Conference and Journal Papers

  • Journal Papers
  • Conference Papers
  • Others

• 📚 2022 Conference and Journal Papers

  • Journal Papers
  • Conference Papers
  • Others

• 📚 2021 Conference and Journal Papers

  • Journal Papers
  • Conference Papers
  • Others

• 📚 2020 Conference and Journal Papers

  • Journal Papers
  • Conference Papers
  • Others

• 📚 2019 Conference and Journal Papers

  • Journal Papers
  • Conference Papers
  • Others

• 📚 2018 Conference and Journal Papers

  • Journal Papers
  • Conference Papers

• 📚 2017 and Before Conference and Journal Papers

  • Journal Papers
  • Conference Papers

• 📚 Datasets

• 🌹 Acknowledgments

• 🌟 Star History

---

📚 2024 Conference and Journal Papers

Journal Papers 2024

• Real-time 6dof full-range markerless head pose estimation. Expert Syst Appl 239:122293. [paper] [code]
• Iot-enabled biometric security: enhancing smart car safety with depth-based head pose est imation. ACM Transactions on Multimedia Computing, Communications and Applications. [paper]
• On the representation and methodology for wide and short range head pose estimation. Pattern Recogn 149:110263. [paper] [code]
• Toward robust and unconstrained full range of rotation head pose estimation. IEEE Trans Image Process 33:2377–2387 [paper] [part_code]
• Fusion-competition framework of local topology and global texture for head pose estimation. Pattern Recogn 149:110285. [paper]
• Deep-learning-based head pose estimation from a single rgb image and its application to medical crom measurement. Multimed Tools Appl 1:1–20 [paper]
• Head pose estimation with uncertainty and an application to dyadic interaction detection. Comput Vis Image Underst 243:103999 [paper]
• Headdiff: Exploring rotation uncertainty with diffusion models for head pose estimation. In: IEEE Transactions on Image Processing [paper]
• Head pose estimation based on multi-level feature fusion. Int J Pattern Recogni Artif Intell 1:1 [paper]
• Head-pose estimation based on lateral canthus localizations in 2-d images. In: IEEE Transactions on Human-Machine Systems [paper]
• Dadl: double asymmetric distribution learning for head pose estimation in wisdom museum. J King Saud Univ Comput Inf Sci 36(1):101869 [paper]
• 6dflrnet: 6d rotation representation for head pose estimation based on facial landmarks and regression. Multimed Tools Appl, 1–20 [paper]

Conference Papers 2024

• Head Pose Estimation Based on 5D Rotation Representation. IEEE Symposium on Wireless Technology and Applications (ISWTA) [paper] [code]

📚 2023 Conference and Journal Papers

Journal Papers 2023

• Deep learning for head pose estimation: a survey. SN Comput Sci 4(4):349 [paper]
• Head pose estimation patterns as deepfake detectors. ACM Transactions on Multimedia Computing, Communications and Applications [paper]
• 2d image head pose estimation via latent space regression under occlusion settings. Pattern Recogn 137:109288 [paper] [code]
• Driver head pose detection from naturalistic driving data. IEEE Trans Intell Transp Syst 24(9):9368–9377 [paper]
• Asymmetry-aware bilinear pooling in multi-modal data for head pose estimation. Signal Process 110:116895. [paper]
• Lightweight head pose estimation without keypoints based on multi-scale lightweight neural network. Vis Comput 39:1–15 [paper]
• Self-attention mechanism-based head pose estimation network with fusion of point cloud and image features. Sensors 23(24):9894 [paper]
• Adaptive occlusion hybrid second-order attention network for head pose estimation. Int J Mach Learn Cyber 1:1–17 [paper]
• Driver visual attention estimation using head pose and eye appearance information. IEEE Open J Intell Transport Syst 4:216–231 [paper]
• Towards 3d face reconstruction in perspective projection: Estimating 6d of face pose from monocular image. IEEE Trans Image Process 32:3080–3091. [paper] [code]
• Rotation representations and their conversions. IEEE Access 11:6682–6699. [paper]
• Real-time driver monitoring system with facial landmark-based eye closure detection and head pose recognition. Sci Rep 13(1):18264 [paper] [code]
• Facial landmark, head pose, and occlusion analysis using multitask stacked hourglass. IEEE Access 11:30 970–30981 [paper]
• Domain adaptation for head pose estimation using relative pose consistency. IEEE `Trans Biometr Behav I dentity Sci 5(3):348–359. [paper]
• Deep learning based single sample face recognition: a survey. Artif Intell Rev 56(3):2723–2748 [paper]
• Orientation cues-aware facial relationship representation for head pose estimation via transformer. IEEE Trans Image Process 32:6289–6302 [paper]
• Jhpfa-net: Joint head pose and facial action network for driver yawning detection across arbi trary poses in videos. IEEE Trans Intell Transp Syst 24(11):11850–11863 [paper]
• Joint super-resolution and head pose estimation for extreme low-resolution faces. IEEE Access 11:11238–11253. [paper]
• Development of a motion controller for the electric wheelchair of quadriplegic patients using head movement recognition. IEEE Embed Syst Lett 1:1–1. [paper]
• intrApose: Monocular driver 6 dof head pose estimation leveraging camera intrinsics. IEEE Trans Intell Vehicles 8(8):40 57–4068. [paper]
• A multimodal discrimination method for the response to name behavior of autistic children based on human pose tracking and head pose estimation. Displays 76:102360. [paper]
• Multiple teacher knowledge distillation for head pose estimation without keypoin ts. SN Comput Sci 4(6):758. [paper]
• Single sample face recognition using deep learning: a survey. Artif Intell Rev 56(Suppl 1):1063 –1111. [paper]
• Wheelchair-centered omnidirectional gaze-point estimation in the wild. IEEE Trans Hum Mach Syst 53(3):466–478. [paper]
• Siamese pointnet: 3d head pose estimation with local feature descriptor. Electronics 12(5):1194. [paper]
• 2dheadpose: a simple and effective annotation method for the head pose in rgb images and its dataset. Ne ural Netw 160:50–62. [paper] code
• A novel convolutional neural network for head detection and pose estimation in complex environments from single-depth images. Cogn Comput 1:1–14. [paper]
• Larnext: End-to-end lie algebra residual network for face recognition. IEEE Trans Pattern Anal Mach Intell 45(10):11961–11976. [paper] [code]

Conference Papers 2023

• Hands-free mobile device control through head pose estimation. In: 2023 IEEE International Conference on Pervasive Computing and Communications Workshops and Other Affiliated Events (PerCom Workshops), pp 367–373. IEEE, Atlanta, GA, USA [paper]
• Discohead: audio-and-video-driven talking head generation by disentangled control of head pose and facial expressions. In: ICASSP 2023–2023 IEEE International Conference on Acoustics. Speech and Signal Processing (ICA SSP). IEEE, Rhodes Island, Greece, pp 1–5 [paper] [code]
• Dsfnet: Dual space fusion network for occlusion-robust 3d dense face alignment. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 4531–4540. IEEE, Vancouver, BC, Canada [paper] [code]
• Ds-hpe: Deep set for head pose estimation. In: 2023 IEEE 13th Annual Computing and Communication Workshop and Conference (CCWC), pp 1179–1184. IEEE, Las Vegas, NV, USA (2023). [paper]
• Tokenhpe: learning orientation tokens for efficient head pose estimation via transformers. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 8897–8906. IEEE, Vancouver, BC, Canada. [paper] [code]

Others 2023

• A simple baseline for direct 2d multi-person head pose estimation with full-range angles. arXiv preprint arX iv:2302.01110. [paper] [code]

📚 2022 Conference and Journal Papers

Journal Papers 2022

• Head pose estimation: an extensive survey on recent techniques and applications. Pattern Recogn 127:108591. [paper]
• Cross-domain multitask model for head detection and facial attribute estimation. IEEE Access 10:54703–54712. [paper] [code]
• Gradient boosting regression for faster partitioned iterated function systems-based head pose estimation. IET Biometr 11(4):279–288. [paper]
• Quaternion to euler angles conversion: A direct, general and computationally efficient method. PLoS ONE 17(11):0276302. [paper]
• Evaluation of various state of the art head pose estimation algorithms for clinical scenarios. Sensors 22(18):685. [paper]
• An integrated framework for multi-state driver monitoring using heterogeneous loss and attention-based feature decoupling. Sensors 22(19):7415. [paper]
• Estimation of driver’s gaze region from head position and orientation using probabilistic confidence regions. IEEE Trans Intell Vehicles 8(1):59–72. [paper]
• Agcnns: Attention-guided convolutional neural networks for infrared head pose estimation in assisted driving system. Infrared Phys Tachnol 123:104146. [paper]
• Accurate head pose estimation using image rectification and a lightweight convolutional neural network. IEEE Trans Multimed 25:2239–2251. [paper]
• Online boosting-based target identification among similar appearance for person-following robots. Sensors 2 2(21):8422. [paper]
• Arhpe: asymmetric relation-aware representation learning for head pose estimation in industrial human-computer interaction. IEEE Trans Ind Inf 18(10):7107–7117. [paper]
• Gmdl: toward precise head pose estimation via gaussian mixed distribution learning for students’ attention understanding. Infrared Phys Technol 122:104099. [paper]
• Head pose healthiness prediction using a novel image quality based stacked autoencoder. Dig Signal Process 130:103696. [paper]
• Wide range head pose estimation using a single rgb camera for intelligent surveillance. IEEE Sen s J 22(11):11112–11121. [paper]
• Real-time masked face classification and head pose estimation for rgb facial im age via knowledge distillation. Inf Sci 616:330–347. [paper] [code]
• Head pose estimation in complex environment based on four-branch feature selective extraction and regional information exchange fusion network. IEEE Access 10:41287–41302. [paper]
• Driver’s head pose and gaze zone estimation based on multi-zone templates registration and multi-frame point cloud fusion. Sensors 22(9):3154. [paper]
• Collaborative learning network for head pose estimation. Image Vis Comput 127:104555. [paper]
• An efficient multitask neural network for face alignment, head pose estimation and face tracking. Expert Syst Appl 205:117368. [paper]
• Head pose estimation using deep neural networks and 3d point clouds. Pattern Recogn 121:108210. [paper]
• Age estimation of faces in videos using head pose estimation and convolutional neural networks. Sensors 22(11):4 171. [paper]
• Collaborative 3d face alignment and head pose estimation with frontal face constraint based on rgb and sparse dept h. Electron Lett 58(21):801–803. [paper]
• Dual-position features fusion for head pose estimation for complex scene. Optik 27 0:169986. [paper]
• An improved tiered head pose estimation network with self-adjust loss function. Entropy 24(7):974. [paper]
• Vision-based pose estimation of craniocervical region: experimental setup and saw bone-based study. Robotica 40(6):2031–2046. [paper]

Conference Papers 2022

• Hhp-net: A light heteroscedastic neural network for head pose estimation with uncertainty. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp 3521–3530. IEEE, Waikoloa, HI, U SA. [paper] [code]
• Fine-grained head pose estimation based on a 6d rotation representation with multiregression loss. In: International conference on Collaborative Computing: Networking. Applications and Worksharing. Springer, Cham, pp 231–249. [paper]
• Lwposr: Lightweight efficient fine grained head pose estimation. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp 1495–1505. IEEE, Waikoloa, HI, USA. [paper]
• 6d rotation representation for unconstrained head pose estimation. In: 2022 IEEE International Conference on Image Processing (ICIP), pp 2496–2500. IEEE, Bordeaux, France. [paper] [code]
• Dad-3dheads: A large-scale dense, accurate and diverse da taset for 3d head alignment from a single image. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 20942–20952. IEEE, New Orleans, LA, USA. [paper] code
• Head pose estimation in classroom scenes. In: 2022 4th International Conference on Artificial Intelligence and Advanced Manufacturing (AIAM), pp 343–349. IEEE, Hamburg, Germany. [paper]
• Srnet: Structural relation-aware network for head pose estimation. In: 202 2 26th International Conference on Pattern Recognition (ICPR), pp 826–832. IEEE, Montreal, QC, Canada. [paper]

Others 2022

• Research on face pose estimation method for virtual try-on system. In: 2022 international seminar on Computer Science and Engineering Technology (SCSET), pp 148–151. IEEE, Indianapolis, IN, USA. [paper]

📚 2021 Conference and Journal Papers

Journal Papers 2021

• Learning 3d head pose from synthetic data: a semi-supervised approach. IE EE Access 9:37557–37573. [paper] [code]
• Impact of facial landmark localization on facial expression recognition. IEEE Trans Affect Comput 14(2):1267–1279. [paper]
• Realheponet: a robust single-stage convnet for head pose estimation in the wild. Neural Comput Appl 33(13):7673–7689. [paper] [code]
• Pifs scheme for head pose estimation aimed at faster face recognition. IEEE Trans Biome tr Behav Identity Sci 4(2):173–184. [paper]
• Fashe: A fractal based strategy for head pose estimation. IEEE Trans Image Process 30:3 192–3203. [paper]
• Trfh: towards real-time face detection and head pose estimation. Pattern Anal Appl 24:1745–1755. [paper]
• Robust and efficient forward, differential, and inverse kinematics using dual quaternions. Int J Robot Res 40(10–11):1 087–1105. [paper]
• Vision-based robotic grasping from object localization, object pose estimation to grasp estimation for parallel grippers: a review. Artif Intell Rev 54(3):1677–1734. [paper]
• Time integration of rigid bodies modelled with three rotation parameters. Multibody SysDyn 53:1–34. [paper]
• Target recovery for robust deep learning-based person following in mobile robots: online trajectory prediction. Appl Sci 11(9):4165. [paper]
• Temporal head pose estimation from point cloud in naturalistic driving conditions. IEEE Trans Intell Transp Syst 23(7):8063–8076. [paper]
• Deep convolutional neural network-based bernoulli heatmap for head pose estimation. Neuroco mputing 436:198–209. [paper]
• Detection of malpractice in e-exams by head pose and gaze estimation. Int J Emerg Technol Learn 16(8):47. [paper]
• The multimodal driver monitoring database: a naturalistic corpus to study driver attention. IEEE Trans Intell Transp Syst 23(8):10736–10752. [paper]
• Head pose estimation: A survey of the last ten years. Signal Process 99:1164 79. [paper]
• 3d head pose estimation through facial features and deep convolutional neural networks. Comput Mater Continua 66:3. [paper]
• Mfdnet: collaborative poses perception and matrix fisher distribution for head pose estimation. IEEE Trans Multimed 24:2449–2460. [paper]
• Head pose estimation through keypoints matching between reconstructed 3d face model and 2d image. Sensors 21(5):1841. [paper]
• Precise head pose estimation on hpd5a database for attention recognition based on convolutional neural network in human-computer interaction. Infrared Phys Technol 116:103740. [paper]
• Anisotropic angle distribution learning for head pose estimation and attention understanding in human-computer interaction. Neurocomputing 433:310–322. [paper]
• Ngdnet: Nonuniform gaussian-label distribution learning for infrared head pose estimation and on task behavior understanding in the classroom. Neurocomputing 436:210–220. [paper]
• Learning a deep regression forest for head pose estimation from a single depth image. J Circuits Syst Comput 30(08):2150139. [paper]
• Head pose estimation using facial-landmarks classification for children rehabilitation games. Pattern Recogn Let t 152:406–412. [paper]
• Attention span prediction using head-pose estimation with deep neural networks. IEEE Access 9:142632–142643. [paper]
• Driver fatigue detection based on residual channel attention network and head pose estimation. Appl Sci 11(19):9195. [paper] [code]

Conference Papers 2021

• Face direction estimation based on mediapipe landmarks. In: 2021 7th International Conference on Contemporary Information Technology and Mathematics (ICCITM), pp 185–190. IEEE, Mosul, Iraq. [paper]
• img2pose: Face alignment and detection via 6dof, face pose estimation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 7617–7627. IEEE, Nashville, TN, USA. [paper] [code]
• A vector-based representation to enhance head pose estimation. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp 1188–1197. IEEE, Waikoloa, HI, USA. [paper] [code]
• Headposr: End-to-end trainable head pose estimation using transformer encoders. In: 2021 16th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2021), pp 1–8. IEEE, Jodhpur, India. [paper]
• Repvgg: Making vgg-style convnets great again. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 13733–13742. IEEE, Nashville, TN, USA. [paper]
• Asmnet: A lightweight deep neural network for face alignment and pose estimation. In: Proceedings of the IEEE/CVF conference on Computer Vision and Pattern Recognition, pp 1521–1530. IEEE, Nashville, TN, USA. [paper]
• Osgg-net: One-step graph generation network for unbiased head pose estimation. In: Proceedings of the 29th ACM International Conference on Multimedia, pp 2465–2473. ACM, Virtual Event, China. [paper] [code]
• Agora: Avatars in geography optimized for regression analysis. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 13468–13478. IEEE, Nashville, TN, USA. [paper] [code]
• Early warning pedestrian crossing intention from its head gesture using head pose estimation. In: 2021 International Seminar on Intelligent Technology and Its Applications (ISITIA), pp 402–407. IE EE, Surabaya, Indonesia. [paper]
• Uet-headpose: A sensor-based top-view head pose dataset. In: 2021 13th International Conference on Knowledge and Systems Engineering (KSE), pp 1–7. IEEE, Bangkok, Thailand. [paper]
• Simultaneous face detection and 360 degree head pose estimation. In: 2021 13th International Conference on Knowledge and Systems Engineering (KSE), pp 1–7. IEEE, Bangkok, Thailand. [paper]
• Synergy between 3dmm and 3d landmarks for accurate 3d facial geometry. In: 2021 international conference on 3D Vision (3DV), pp 453–463. IEEE, London, UK. [paper] [code]
• Eva-gcn: Head pose estimation based on graph convolutional networks. In: Proceedings of the IEEE/CVF Co nference on Computer Vision and Pattern Recognition, pp 1462–1471. IEEE, Nashville, TN, USA. [paper] [code]
• Measuring and integrating facial expressions and head pose as indicators of engagement and affect in tutoring systems. In: International Conference on Human-Computer Interaction, p p 219–233. Springer, Virtual Event. [paper]

Others 2021

• Going deeper into face detection: a survey. arXiv preprint. [paper]

📚 2020 Conference and Journal Papers

Journal Papers 2020

• Head pose estimation by regression algorithm. Pattern Recogn Lett 140:179–185. [paper]
• Web-shaped model for head pose estimation: an approach for best exemplar selection. IEEE Trans Image Process 29:5457–5468. [paper]
• A novel eye center localization method for head poses with large rotations. IEEE Trans Image Process 30:136 9–1381. [paper]
• Improving head pose estimation using two-stage ensembles with top-k regression. Image Vis Comput 93:103827. [paper]
• A framework for head pose estimation and face segmentation through conditional random fields. SIViP 14:159–166. [paper]
• An analysis of svd for deep rotation estimation. Adv Neural Inf Process Syst 33:22554–22565. [paper]
• Compact bilinear pooling via kernelized random projection for fine-grained image categorization on low computational power devices. Neurocomputing 398:411–421. [paper]
• Robust head pose estimation based on key frames for human-machine interaction. EURASIP J Image Video Process 2020:1–19. [paper]
• Facial emotion recognition using deep learning: review and insights. Proc Comput Sci 175:689–694. [paper]
• Multi-task head pose estimation in-the-wild. IEEE Trans Pattern Anal Mach Intell 43(8):287 4–2881. [paper]

Conference Papers 2020

• A face recognition system for assistive robots. In: Proceedings of the 3rd International Conference on Applications of Intelligent Systems, pp 1–6. ACM, Las Palmas de Gran Canaria, Spain. [paper]
• Gotcha-i: A multiview human videos dataset. Security in Computing and Communications: 7th International Symposium. SSCC 2019, Trivandrum, India, December 18–21, 2019, Revised Selected Papers. Springer, Springer, Singapore, pp 213–224 [paper]
• Deep entwined learning head pose and face alignment inside an attentional cascade with doubly-con ditional fusion. In: 2020 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), pp 192–198. IEEE, Buenos Aires, Argentina. [paper]
• Retinaface: Single-shot multi-level face localisation in the wild. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 5203–5212. IEEE, Seattle, WA, USA. [paper] [code]
• The more, the merrier? a study on in-car ir-based head pose estimation. In: 2020 IEEE Intelligent Vehicles Symposium (IV), pp 1060–1065. IEEE, Las Vegas, NV, USA. [paper]
• Towards fast, accurate and stable 3d dense face alignment. In: European Conference on Computer Vision, pp 152–168. Springer, Glasgow, UK. [paper] [code]
• Robust driver head pose estimation in naturalistic conditions from point-cloud data. In: 2020 IEEE Intelligent Vehicles Symposium (IV), pp 1176–1182. IEEE, Las Vegas, NV, USA. [paper]*
• Maskgan: towards diverse and interactive facial image manipulation. In: Proceedings of the IEEE/C VF Conference on Computer Vision and Pattern Recognition, pp 5549–5558. IEEE, Seattle, WA, USA. [paper]
• A survey of head pose estimation methods. 2020 International Conferences on Internet o f Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cybernetics Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData) and IEEE Congress on Cybermatics (Cybermatics). IEEE, Rhodes, Greece, pp 787–796. [paper]
• Classroom attention analysis based on multiple euler angles constraint and head pose estimation. In: MultiMedia Modeling: 26th International Conference. MMM 2020, Daejeon, South Korea, January 5–8, 2020, Proceedings, Part I 26. Springer, Daejeo n, South Korea, pp 329–340. [paper]
• ETH-XGaze: A large scale dataset for gaze estimation under extreme head pose and gaze variation. Computer Vision-ECCV 2020: 16th European Conference. Glasgow, UK, August 23–28, 2020, Proceedings, Part V 16. Springer, Glasgow, UK, pp 365–381. [paper]

Others 2020

• A smooth representation of belief over so (3) for deep rotation learning with uncertainty. arXiv preprint. [paper]
• Whenet: Real-time fine-grained estimation for wide range head pose. arXiv preprint. [paper] [part_code]

📚 2019 Conference and Journal Papers

Journal Papers 2019

• Near real-time three axis head pose estimation without training. IEEE Access 7:64256–64265. [paper]
• Edusense: Practical classroom sensing at scale. Proc ACM Interac Mob Wear Ubiquitous Technol 3(3):1–26. [paper]
• Robust and accurate 2d-tracking-based 3d positioning method: application to head pose estimation. Comput Vis Image Underst 180:13–22. [paper]
• Face analysis through semantic face segmentation. Signal Process 74:21–31. [paper]
• Face detection techniques: a review. Artif Intell Rev 52:927–948. [paper]
• Real-time head pose estimation and face modeling from a depth image. IEEE Trans Multi med 21(10):2473–2481. [paper]
• Robust head pose estimation using extreme gradient boosting machine on stacked autoencoders neural network. IEEE Access 8:3687–3694. [paper]
• Facial landmark detection: a literature survey. Int J Comput Vision 127:115–142. [paper]

Conference Papers 2019

• Barra P, Bisogni C, Nappi M, Freire-Obregón D, Castrillón-Santana M (2020) Gotcha-i: A multiview human videos dataset. Security in Computing and Communications: 7th International Symposium. SSCC 2019, Trivandrum, India, December 18–21, 2019, Revised Selected Papers. Springer, Springer, Singapore, pp 213–224. [paper]
• Nose, eyes and ears: Head pose estimation by locating facial keypoints. ICASSP 201 9–2019 IEEE International Conference on Acoustics. Speech and Signal Processing (ICASSP). IEEE, Brighton, UK, pp 1977–1981. [paper]
• Expressive body capture: 3d hands, face, and body from a single image. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 10975–10985. IE EE, Long Beach, CA, USA. [paper]
• Dd-pose-a large-scale driver head pose benchmark. In: 2019 IEEE Intelligent Vehicles Symposium (IV), pp 927 –934. IEEE, Paris, France. [paper]
• Fsa-net: Learning fine-grained structure aggregation for head pose estimation from a single image. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp 1087–1096. IEEE, Long Beac h, CA, USA. [paper] [code]
• On the continuity of rotation representations in neural networks. In: Proceedings of the IEE E/CVF Conference on Computer Vision and Pattern Recognition, pp 5745–5753. IEEE, Long Beach, CA, USA. [paper]

Others 2019

• Mediapipe: A framework for building perception pipelines. arXiv preprint. [paper]

📚 2018 Conference and Journal Papers

Journal Papers 2018

• Face-from-depth for head pose estimation on depth images. IEEE Trans Pattern Anal Mach Intell 42(3):596–609. [paper]
• Quatnet: Quaternion-based head pose estimation with multiregression loss. IEEE Trans Multimed 21(4):1035–1046. [paper]
• Headfusion: 360 head pose tracking combining 3d morphable model and 3d reconstruction. IEEE Trans Pattern Anal Mach Intell 40(11):2653–2667. [paper]

Conference Papers 2018

• Openface 2.0: Facial behavior analysis toolkit. In: 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), pp 59–66. IEEE, Xi’an, China. [paper]
• Vggface2: A dataset for recognising faces across pose and age. In: 2018 13th IEE E International Conference on Automatic Face & Gesture Recognition (FG 2018), pp 67–74. IEEE, Xi’an, China. [paper]
• Fine-grained head pose estimation without keypoints. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp 2074–2083. IEEE, Salt Lake City, UT, USA. [paper] [code]
• Look at boundary: A boundary-aware face alignment algorithm. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 2129–2138. IEEE, Salt Lake City, UT, USA. [paper]
• Joint pose and expression modeling for facial expression recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 3359–3368. IEEE, Salt Lake City, UT, USA. [paper]

📚 2017 and Before Conference and Journal Papers

Journal Papers

• Robust head-pose estimation based on a partially-latent mixture of linear regressions. IEEE Trans Image Process 26(3):1428–1440. [paper]
• Eye-tracking technology and the dynamics of natural gaze behavior in sports: a systematic review of 40 years of research. Front Psychol 8:1845. [paper]
• Hyperface: a deep multi-task learning framework for face detection, landmark localization, pose estimation, and gender recognition. IEEE Trans Pattern Anal Mach Intell 41(1):121–135. [paper]
• Face alignment in full pose range: a 3d total solution. IEEE Trans Pattern Anal Mach Intell 41(1):78–92. [paper]

Journal Papers 2016

• A novel 2d/3d database with automatic face annotation for head tracking and pose estimation. Comput Vis Image Underst 148:201–210. [paper]
• Robust head pose estimation using dirichlet-tree distribution enhanced random forests. Neurocomputing 173:42–53. [paper]

Journal Papers 2015

• Improving the precision and speed of euler angles computation from low-cost rotation sensor data. Sensors 15(3):7016–7039. [paper]
• Panoptic studio: A massively multiview syste m for social motion capture. In: Proceedings of the IEEE International Conference on Computer Vision, pp 3334–3342. IEEE, Santiago, C hile. [paper]
• Smpl: a skinned multi-person linear model. ACM Trans Graph 34(6):1– 16. [paper]
• Esa multibody simulator for spacecrafts’ ascent and landing in a microgravity environment. CEAS S pace J 7:335–346. [paper]

Journal Papers 2014

• Robust semi-automatic head pose labeling for real-world face video sequences. Multimed Tools Ap pl 70:495–523. [paper]

Journal Papers 2013

• Localizing parts of faces using a consensus of exemplars. IEEE Trans Pattern Anal Mach Intell 35(12):2930–2940. [paper]
• A comparative study of face landmarking techniques. EURASIP J Image Video Process 2013 (1):1–27. [paper]
• Random forests for real time 3d face analysis. Int J Comput Vision 101:437–4 58. [paper]

Journal Papers 2012

• Human-centric design personalization of 3d glasses frame in markerless augmented reality. Adv E ng Inform 26(1):35–45. [paper]

Journal Papers 2011

• The nimh child emotional faces picture set (nimh-che fs): a new set of children’s facial emotion stimuli. Int J Methods Psychiatr Res 20(3):145–156. [paper]

Journal Papers 2008

• Head pose estimation in computer vision: a survey. IEEE Trans Pattern Anal Mach Intell 31(4): 607–626. [paper]

Journal Papers 2007

• The cas-peal large-scale chinese face database and baseline evaluations. IEEE Trans Syst Man Cybern Part A 38(1):149–161. [paper]

Journal Papers 2003

• Complete solution classification for the perspective-three-point problem. IEEE Trans Pattern Anal Mach Intell 25(8):930–943. [paper]

Journal Papers 2001

• Rotations and rotation matrices. Acta Crystallogr D 57(10):1355–1359. [paper]

Journal Papers 2000

• Fast, reliable head tracking under varying illumination: an approach based on registration of texture-mapped 3d models. IEEE Trans Pattern Anal Mach Intell 22(4):322–336. [paper]
• The feret evaluation methodology for face-recognition algorithms. IEEE Trans Pattern A nal Mach Intell 22(10):1090–1104. [paper]

Conference Papers

• Poseidon: Face-from-depth for driver pose estimation. In: Proceedings of the IEE E Conference on Computer Vision and Pattern Recognition, pp 4661–4670. IEEE, Honolulu, HI, USA. [paper]
• How far are we from solving the 2d & 3d face alignment problem?(and a dataset of 230,000 3d facial la ndmarks). In: Proceedings of the IEEE International Conference on Computer Vision, pp 1021–1030. IEEE, Venice, Italy. [paper]
• Realtime multi-person 2d pose estimation using part affinity fields. In: Proceedings of the IEE E Conference on Computer Vision and Pattern Recognition, pp 7291–7299. IEEE, Honolulu, HI, USA. [paper]
• Detecting probable cheating during online assessments based on time delay and head pose. High Educ Res Dev 36(6):1123–1137. [paper]
• Dynamic facial analysis: From bayesian filtering to recurrent neural network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 1548–1557. IEEE, Honolulu, HI, USA. [paper]
• Kepler: Keypoint and pose estimation of unconstrained faces by learning efficient h-cnn regressors. In: 2017 12th Ieee International Conference on Automatic Face & Gesture Recognition (fg 2017), pp 258–265. IEEE, Washington, DC, USA. [paper]
• Joint challenge on dominant and complementary emotion recognition using micro emotion features and head-pose estimation: Databases. In: 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017), pp 809–813. IEEE, Washington, DC, USA. [paper]
• Driveahead-a large-scale driver head pose dataset. In: Proceedings of the IEE E Conference on Computer Vision and Pattern Recognition Workshops, pp 1–10. IEEE, Honolulu, HI, USA. [paper]

Conference Papers 2016

• Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 770–778. IEEE, Las Vegas, NV, USA. [paper]
• Wider face: A face detection benchmark. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 5525–5533. IEEE, Las Vegas, NV, USA. [paper]
• Face alignment across large poses: A 3d solution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 146–155. IEEE, Las Vegas, NV, USA. [paper]

Conference Papers 2015

Panoptic studio: A massively multiview syste m for social motion capture. In: Proceedings of the IEEE International Conference on Computer Vision, pp 3334–3342. IEEE, Santiago, Chile [paper]

Conference Papers 2014

• Eyediap: A database for the development and evaluation of gaze estimation algorithms from rgb and rgb-d cameras. In: Proceedings of the symposium on Eye Tracking Research and Applications, pp 255–258. ACM, Safety Harb or, Florida, USA. [paper]
• Stereo vision-based driver head pose estimation. In: 2014 IEEE Intelligent Vehicles Symposium Proceedings, pp 253–260. IEEE, Dearborn, MI, USA. [paper]
• One millisecond face alignment with an ensemble of regression trees. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 1867–1874. IEEE, Columbus, OH, USA. [paper]
• Robust real-time extreme head pose estimation. In: 2014 22nd International Conference on Pattern Recognition, pp 2263–2268. IEEE, Stockholm, Sweden. [paper]

Conference Papers 2013

• Head pose and movement analysis as an indicator of depression. In: 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction, pp 283–288. IEEE, Geneva, Switzerland. [paper]
• Evaluating performance benefits of head tracking in modern video games. In: Proceedings of the 1st symposium on spatial user interaction, pp 53–60. ACM, Los Angeles California USA. [paper]
• 300 faces in-the-wild challenge: The first facial landmark localization challenge. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, pp 397–403. IEEE, Sydney, NSW, Australia. [paper]
• A semi-automatic methodology for facial landmark annotation. In: Proceeding s of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp 896–903. IEEE, Portland, OR, USA. [paper]

Conference Papers 2012

• 3d constrained local model for rigid and non-rigid facial tracking. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp 2610–2617. IEEE, Providence, RI, USA. [paper]
• Real time 3d head pose estimation: Recent achievements and future challenges. 2012 5th International Symposium on Communications. Control and Signal Processing. IEEE, Rome, Italy, pp 1–4. [paper]
• Interactive facial feature localization. Computer Vision-ECCV 2012: 12th European Conference on Computer Vision. Florence, Italy, October 7–13, 2012, Proceedings, Part III 12. Springer, Florence, Italy, pp 679–692. [paper]
• Face detection, pose estimation, and landmark localization in the wild. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp 2879–2886. IEEE, Providence, RI, USA. [paper]

Conference Papers 2011

• Real time head pose estimation with random regression forests. In: CVPR 2011, pp 617–624. IEEE, Colorado Springs, CO, USA. [paper]
• Annotated facial landmarks in the wild: A large-scale, real-world database for facial landmark localization. In: 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), pp 2144–2151. IEE E, Barcelona, Spain. [paper]

Conference Papers 2008

• Bosphorus database for 3d face analysis. In: Biometrics and Identity Management: First European Workshop, BIOID 2008, May 7-9, 2008. Revised Selected Papers 1, pp 47–56. Springe r, Roskilde, Denmark. [paper]
• Social force models for pedestrian traffic – state of the art, Transport reviews 2018. [paper]

Conference Papers 2004

• Estimating face orientation from robust detection of salient facial features. In: Proceedings of Pointing 2004, ICPR, International Workshop on Visual Observation of Deictic Gestures, Cambridge, UK. [paper]

Conference Papers 1999

• The extended m2vts database. In: Second International Conference on Audio and Video-based Biometric Person Authentication, vol 964, pp 965–966. Citeseer, Washington D.C, USA. [paper]

📚 Datasets

• 2DHeadPose, [paper2023]
• Dad-3dheads [paper2022]
• AGORA [paper2021]
• MDM corpus [paper2021]
• ETH-XGaze [paper2020]
• GOTCHA-I [paper2020]
• DD-Pose [paper2019]
• VGGFace2 [paper2018]
• SynHead [paper2017]
• DriveAHead [paper2017]
• SASE [paper2017]
• Pandora [paper2017]
• 300W-LP, or 300W-LP, [paper2016]
• AFLW2000, or AFLW2000 [paper2016]
• CCNU [paper2016]
• UPNA [paper2016]
• WIDER FACE [paper2016]
• CMU Panoptic [paper2015]
• Dali3DHP [paper2014]
• EYEDIAP [paper2014]
• McGill [paper2014]
• Biwi [paper2013]
• ICT-3DHP,[paper2012]
• AFW [paper2011]

🌹 Acknowledgments

This work was supported in part by the research fund of Hanyang University (HY- 202300000003239) and in part by the National Research Foundation of Korea (NRF) grant funded by the Korea Government (MSIT) No. 2022R1A4A3033961.

🌟 Star History