University of Oulu

Content-based search and browsing in semantic multimedia retrieval

Saved in:
Author: Rautiainen, Mika1
Organizations: 1University of Oulu, Faculty of Technology, Department of Electrical and Information Engineering
Format: ebook
Version: published version
Access: open
Online Access: PDF Full Text (PDF, 3 MB)
Persistent link:
Language: English
Published: 2006
Publish Date: 2006-12-04
Thesis type: Doctoral Dissertation
Defence Note: Academic dissertation to be presented, with the assent of the Faculty of Technology of the University of Oulu, for public defence in Raahensali (Auditorium L10), Linnanmaa, on December 13th, 2006, at 12 noon
Reviewer: Professor Samuel Kaski
Professor Alan Smeaton


Growth in storage capacity has led to large digital video repositories and complicated the discovery of specific information without the laborious manual annotation of data. The research focuses on creating a retrieval system that is ultimately independent of manual work. To retrieve relevant content, the semantic gap between the searcher’s information need and the content data has to be overcome using content-based technology. Semantic gap constitutes of two distinct elements: the ambiguity of the true information need and the equivocalness of digital video data.

The research problem of this thesis is: what computational content-based models for retrieval increase the effectiveness of the semantic retrieval of digital video? The hypothesis is that semantic search performance can be improved using pattern recognition, data abstraction and clustering techniques jointly with human interaction through manually created queries and visual browsing.

The results of this thesis are composed of: an evaluation of two perceptually oriented colour spaces with details on the applicability of the HSV and CIE Lab spaces for low-level feature extraction; the development and evaluation of low-level visual features in example-based retrieval for image and video databases; the development and evaluation of a generic model for simple and efficient concept detection from video sequences with good detection performance on large video corpuses; the development of combination techniques for multi-modal visual, concept and lexical retrieval; the development of a cluster-temporal browsing model as a data navigation tool and its evaluation in several large and heterogeneous collections containing an assortment of video from educational and historical recordings to contemporary broadcast news, commercials and a multilingual television broadcast.

The methods introduced here have been found to facilitate semantic queries for novice users without laborious manual annotation. Cluster-temporal browsing was found to outperform the conventional approach, which constitutes of sequential queries and relevance feedback, in semantic video retrieval by a statistically significant proportion.

see all

Series: Acta Universitatis Ouluensis. C, Technica
ISSN-E: 1796-2226
ISBN: 951-42-8300-7
ISBN Print: 951-42-8299-X
Issue: 262
Copyright information: © University of Oulu, 2006. This publication is copyrighted. You may download, display and print it for your own personal use. Commercial use is prohibited.