Lip-password for Personal Identity Verification (Yiu-ming Cheung et al.)

This project presents a lip-password based personal identity verification (PIV) approach, which combines the merits of lip-motion characteristics and the password information. This new technique features a double security to the PIV upon that a personal identity is verified by both of the underlying behavior characteristics of lip motions and the password information simultaneously. Subsequently, a target person saying the wrong password or an impostor even knowing the correct password will be detected successfully. It is anticipated that PIV based on lip-password can meet the security requirement of different fields, such as financial transaction, secure access, human-computer interface, and so on.



Project Goal:

In this project, we shall systematically investigate, analyze and encode the lip motion password, which contains the characteristics of lip motion and the password information embedded in the lip movement. Subsequently, a lip-password based personal identity verification system featuring a double security will be established.



Project Description:

The lip-password is to embed the password into a person’s lip motion, whereby the personal identity is verified by matching both of the password information and the underlying behavior characteristics of lip motion simultaneously. This project aims at investigating the lip-password based personal identity verification system, through which, a target person saying the wrong password or an imposter even knowing the correct password will be detected. The merits of this new technique are at least four-fold: 1) The dynamic characteristics of lip motions are resistant to the mimicry and capture; 2) The acquisition of lip motions is somewhat insusceptible to the background noise and distance; 3) The underlying techniques are simply applicable to a dumb person; 4) Lip-password has the superiority of silence and hidden property.

The key research content of this project is composed of two aspects: study on lip-motion characteristics and password information analysis. Figure 1 has given the general framework of the lip-password based PIV system and the main issues to be studied in this project. Specifically, we shall focus on the following four key issues: 1) Develop a robust approach to lip region localization and tracking. We shall investigate the location and tracking of lip in complex environment. Meanwhile, the influence of scale change and rotation in lip region will also be taken into account. 2) Study how to extract and represent the discriminative features. Systematically comparative studies will be conducted to analyze the relationships between different kinds of features and effective method will be proposed to extract and select the most discriminative and representative features. Subsequently, variant features will be combined with some feature fusion strategy to describe the dynamic characteristics. 3) Analyze the lip-password sequence and its corresponding sparse coding representation theory. This project plans to investigate the changing rule of lip motion through three aspects, i.e. the differences between lip-password atoms, the change of optical flow direction in lip region, and the motion trail of lip contour. Based on this result, effective method for lip-password sequence segmentation and sparse coding representation will be studied. 4) Present an optimal model of the lip-password sequence.


Figure 1. General framework of the lip-password based personal identity verification system



For further information on this research topic, please contact Prof. Yiu-ming Cheung.