Content-Based Image and Video Retrieval


Theo Gevers, Nicu Sebe, and Arnold Smeulders
Faculty of Science
University of Amsterdam
Kruislaan 403
1098 SJ Amsterdam
The Netherlands




The growing capacity of computers, the abundance of digital cameras and the increased connectivity of the world all point to large digital multimedia archives. They include images and videos from the World Wide Web, museum objects, flowers, trademarks, and views from everyday life. The faster they grow, the more prominently needed is the efficient access to the content of the images and videos.

In this short course, we will give a survey of the most recent developments on image and video search engines. First, the important step of feature extraction will be discussed in detail such as color, shape and texture information, particularly paying attention to discriminatory power and invariance. Then, we focus on the concepts of indexing and genre classification as intermediate step to sort the data. We pay attention to (interactive) ways to perform browsing and retrieval by means of information visualization and relevance feedback. Methods are being discussed to localize the retrieved objects in images.


The following important aspects will be covered:

·         Feature extraction and learning

·         Object recognition and image classification

·         Visual tracking

·         (Active) learning in image and video retrieval

·         Affective video retrieval

·         Video retrieval benchmarking

·         Applications in image and video retrieval


Theo Gevers is an Associate Professor of Computer Science at the
University of Amsterdam, The Netherlands and an ICREA Research Professor at the Computer Vision Center (UAB), Barcelona, Spain. At the University of Amsterdam he is a teaching director of the MSc of Artificial Intelligence. His main research interests are in the fundamentals of content-based image retrieval, colour image processing and computer vision specifically in the theoretical foundation of geometric and photometric invariants. He is co-chair of the Internet Imaging Conference (SPIE 2005, 2006), co-organizer of the First International Workshop on Image Databases and Multi Media Search (1996), the International Conference on Visual Information Systems (1999, 2005) and the Conference on Multimedia & Expo (ICME, 2005). He is guest editor of the special issue on content-based image retrieval for the International Journal of Computer Vision (IJCV 2004) and the special issue on Colour for Image Indexing and Retrieval for the journal of Computer Vision and Image Understanding (CVIU 2004). He has published over 100 papers on colour image processing, image retrieval and computer vision. He is program committee member of a various number of conferences, and an invited speaker at major conferences. Further, he is a lecturer of post-doctoral courses given at various major conferences (CVPR, ICPR, SPIE, CGIV). He is member of the IEEE.

Nicu Sebe is an Assistant Professor in the Faculty of Science,
University of Amsterdam, The Netherlands, where he is doing research in the areas of multimedia information retrieval and human-computer interaction in computer vision applications. He is the author of the following books: Robust Computer Vision -Theory and Applications (Kluwer, April 2003) and Machine Learning in Computer Vision (Springer, May 2005). He was a guest editor of a CVIU special issue on video retrieval and summarization (December 2003) and was the co-chair of ACM Multimedia Information Retrieval Workshops, MIR' 03 & MIR' 04 (in conjunction with ACM Multimedia conferences). He also was the co-chair of the first Human Computer Interaction Workshop, HCI' 04 (in conjunction with ECCV 2004) and of the IEEE Workshop on Human computer Interaction Workshop (in conjunction with ICCV 2005). He is the guest editor of three special issues on multimedia information retrieval and human computer interaction in ACM Transactions on Multimedia Computing, Communication, and Applications, ACM Multimedia Systems, and Image and Vision Computing. He was the technical program chair for the International Conference on Image and Video Retrieval, CIVR 2003. He was a visiting researcher in the Beckman Institute, University of Illinois  at Urbana-Champaign (2002) and was a research fellow of the British Telecomm in Ipswich, UK (2003). He has published more than 60 technical papers in the areas of computer vision, content-based retrieval, pattern recognition, and human-computer interaction and has served on the program committee of several conferences in these areas. He is a member of the IEEE and the ACM.

Arnold W.M. Smeulders is Professor of Computer Science in Multi Media Information Analysis. He heads the Intelligent Sensory Information Systems ISIS-group at the
University of Amsterdam. His current research interest is in computer vision from first principles, texture and material perception, image retrieval and learning object segmentation and visual concepts rather than modelling it and the language - pictorial barrier. He has published some 200 papers and an equal amount of conference contributions. Last year he has edited special issues on content-based image retrieval for IJCV and CVIU. This year he is program chair of the CIVR conference on Image and Video Retrieval. He is a fellow of the IAPR and an associated editor of IJCV.