Face Recognition System Security: Template Protection and Anti-spoofing

Slides (pdf)Video


This lecture will discuss the security issues on face biometric systems. We will first give an overview of possible attacks in a face biometric system. Two practical attacks namely template attack and spoofing attack will be discussed in depth. So the lecture will be divided into two parts. Part 1 will fo-cus on the face template protection. We will discuss the problems of unprotected face template. Then existing methods in template protection will be reviewed. Finally, we will report our work related to template protection. Part 2 will focus on face spoofing attack. An overview of popular face spoofing attacks and face anti-spoofing algorithms will be given. After that, we will focus on 3D mask attack as well as our recent work on 3D mask anti-spoofing methods.


Pong C Yuen received his B.Sc. degree in Electronic Engineering with First Class Honours in 1989 from City Polytechnic of Hong Kong, and his Ph.D. degree in Electrical and Electronic Engineering in 1993 from The University of Hong Kong. He joined the Hong Kong Baptist University in 1993 and, currently is a Professor and Head of the Department of Computer Science.

Dr. Yuen was a recipient of the University Fellowship to visit The University of Sydney in 1996. In 1998, Dr. Yuen spent a 6-month sabbatical leave in The University of Maryland Institute for Advanced Computer Studies (UMIACS), University of Maryland at College Park. From June 2005 to January 2006, he was a visiting professor in GRAVIR laboratory (GRAphics, VIsion and Robotics) of INRIA Rhone Alpes, France. Dr. Yuen was the director of Croucher Advanced Study Institute (ASI) on biometric authentication in 2004 and the director of Croucher ASI on Biometric Security and Privacy in 2007. He is also the Director of IAPR/IEEE Winter School on Biometrics 2017.

Dr. Yuen has been actively involved in many international conferences and professional community. He was the track co-chair of the International Conference on Pattern Recognition (ICPR) 2006, the program co-chair of the IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS) 2012 as well as the IEEE International Conference on Identity, Security and Behavior Analysis (ISBA) 2016. He serves as the Program co-chair of International Conference on Pattern Recognition and Artificial Intelligence in 2018. Currently, Dr. Yuen is the Vice President (Technical Activities) of the IEEE Biometrics Council, Editorial Board Member of Pattern Recognition, Associate Editor of IEEE Transactions on Information Forensics and Security, and Senior Editor of SPIE Journal of Electronic Imaging. He also serves as a Hong Kong Research Grant Council Engineering Panel Member.

Dr. Yuen's current research interests include video surveillance, human face recognition, biometric system security and data privacy.

References (Face Template Protection)

  • G. MAI, M H Lim and P C Yuen, Binary Feature Fusion for Discriminative and Secure Multi-biometric Cryptosystems, Image and Vision Computing, In press, 2016
  • M H Lim and P C Yuen, Entropy Measurement for Biometric Verification Systems, IEEE Transactions on Cybernetics, 2016
  • M H Lim, S Verma, G C Mai and P C Yuen, "Learning discriminability-preserving histogram representation from unordered features for multibiometric feature-fused template protection”, Pattern Recognition, In press, 2016
  • Y C Feng, M H Lim and P C Yuen, Masquerade attack on transform-based binary-template protection based on perceptron learning, Pattern Recognition, 2014
  • YC Feng & PC Yuen, Binary discriminant analysis for generating binary face template, IEEE Transactions on Information Forensics and Security, 2012
  • YC Feng, PC Yuen, AK Jain, A hybrid approach for generating secure and discriminating face template, IEEE Transactions on Information Forensics and Security, 2010

References (Face Anti-spoofing)

  • N. Erdogmus and S. Marcel, "Spoofing face recognition with 3d masks”, TIFS, 2014
  • J. Maatta, A. Hadid, and M. Pietikainen. "Face spoofing detection from single images using micro-texture analysis”, IJCB, 2011.
  • D. Wen, H. Han, and A. K. Jain, "Face spoof detection with image distortion analysis”, TIFS, 2015.
  • G. Pan, L. Sun, Z. Wu, and S. Lao. "Eyeblink-based antispoofing in face recognition from a generic webcamera”, ICCV, 2007.
  • T. de Freitas Pereira, J. Komulainen, A. Anjos, J. M. De Martino, A. Hadid, M. Pietikainen, and S. Marcel, "Face liveness detection using dynamic texture.”, EURASIP JIVP, 2014.
  • X. Li, J. Komulainen, G. Zhao, P. C. Yuen, and M. Pietikainen, "Generalized face anti-spoofing by detecting pulse from face videos”, ICPR, 2016.
  • S. Liu, P C. Yuen, S. Zhang, and G. Zhao, "3D Mask Face Anti-spoofing with Remote Photoplethysmography” , ECCV, 2016.
  • S. Liu, B. Yang, P C. Yuen, G. Zhao, "A 3D Mask Face Anti-spoofing Database with RealWorld Variations” , CVPRW, 2016.
P C Yuen

P C Yuen
Hong Kong Baptist University, Hong Kong