IAPR/IEEE Winter School on Biometrics 2021

Fusion of Multimodal Biometrics

Slides (pdf)  Size: 7.18MB


Person’s identity can be recognised or verified using different biometric traits, which in general offer unique characteristics and, therefore, support preferred areas of applicability. However, multiple biometric traits can also be used jointly to take advantage of the complementary information about the subject they convey. This potentially has many benefits, including improved performance, increased population coverage, extended range of environmental conditions in which biometric authentication can be performed, and enhanced resilience to spoofing. The lecture will introduce the fundamental principles of multibiometrics. The problem of multimodal biometrics fusion will be formulated in the Bayesian statistical framework, setting it out the differences between signal, feature, score and decision level fusion. The different fusion approaches lead to distinct fusion architectures.

The role of score normalisation and of biometric trait quality will then be discussed in the context of score level fusion. The process of multimodal biometric fusion will be illustrated on several examples, including the fusion of visual appearance and verbal appearance description for person re-identification using soft biometrics.


Josef Kittler is Professor of Machine Intelligence at the Centre for Vision, Speech and Signal Processing, University of Surrey. He received his BA, PhD and DSc degrees from the University of Cambridge. He teaches and conducts research in Machine Intelligence, with a focus on Biometrics, Video and Image Database retrieval, and Cognitive Vision. He published a Prentice Hall textbook on Pattern Recognition: A Statistical Approach and several edited volumes, as well as more than 500 scientific papers, including more than 200 journal papers. He serves on the Editorial Board of several scientific journals in Pattern Recognition and Computer Vision and since 2004 he has been Series Editor of Springer Lecture Notes on Computer Science.

He served as President of the International Association for Pattern Recognition (IAPR) 1994-1996. He received Honorary Doctorates from the Lappeenranta University of Technology and from the Czech Technical University in Prague. He is Fellow of IET, IAPR, EURASIP, and BMVA. He was elected Fellow of the Royal Academy of Engineering in 2000. In 2006 he was awarded the KS Fu Prize from IAPR and the IET Faraday Medal in 2008. He consulted for many companies and was one of the founders of OmniPerception Ltd.

Josef Kittler

Josef Kittler
University of Surrey, UK