Sketch4Match Content-based Image Retrieval System Using Sketches

Under the Guidance of,

Mr Gangadhar Immadi
Asst Prof, Dept of CSE AIeMS-Bidadi. Presenting by, Prashanth B R 1AR08CS035 Dept.Of CSE. AIeMS-Bidadi. 5/22/12

Introduction Objectives

Outline of Presentation

Purpose of the system Global structure and subsystems Advantages Tests and Results Conclusion References

5/22/12

Introduction to Sketch4Match-Content-based Image Retrieval System Using Sketches

The Content Based Image Retrieval is one of most popular, rising research areas of the digital image processing. Search engine tools- Google, Yahoo etc. text based search.. Goal of CBIR to extract visual content like color , text, or shape. Introduces design based on a free hand sketch --SBIR Making search more efficient hereby. Test results show that the sketch based system allows users an intuitive access to search-tools.

5/22/12

Introduction to Sketch4Match-Content-based Image Retrieval System Using Sketches

In todays corporate world huge data has to be managed, processed and stored. The growing of data storages and revolution of internet had changed the world. Text based search. Keywords! Is this efficient. Why we use keywords for searchv Giving unique & identifiable name to image is not difficult. v Keyword acts as the human abstraction of that particular image. Therefore it is to develop a CBIR system, which can retrieve using sketches in frequently used databases. 5/22/12

Introduction to Sketch4Match-Content-based Image Retrieval System Using Sketches

Drawing area to sketch the required image. Matched images to sketch are retrieved.

Using Sketch based system can be very important and efficient in many areas of life. v Digital library. v Crime prevention. v photo sharing sites. v search engines.

5/22/12

Objectives
This paper aims to introduce the problems and challenges concerned with design and creation of CBIR systems, which is based on free hand sketch.

Make convenient to retrieve data or images based on sketches so that even illiterates , who do not know to write text can also make use of system effectively.

Introducing this system into search engines makes corporate world and even other users bit more efficient in retrieval of data 5/22/12 effectively.

Purpose of the system.

The Purpose of the system.

Even though the measure of research in sketchbased image retrieval is more, there is no widely used SBIR system. The goal of this paper is to develop a SBIR search engine, which with free hand sketch content can be retrieved. The most important task is to bridge the gap between the free hand sketch and the picture.
5/22/12

Global structure and subsystems.

1. The Global Structure of the System:
Displaying Subsystem image Preprocessing Subsystem
Preprocessed image

Feature Vector generating subsystem

Result

Retrieval subsystem

Feature vector

Stock index Database Management subsystem

5/22/12

Global Structure and subsystems.

2. The Preprocessing Subsystem:
Input Image Preprocessing subsystem Output Processed Image

The system is for databases containing simple images.

5/22/12

Global structure and subsystems

3. The Feature Vector Preparation Subsystem:
Here we use 3 Descriptor vectors which represents the content of the image.

Edge Histogram descriptor(EHD). Histogram of Oriented Gradients(HOG). Scale invariant feature transform(SIFT).

Purpose of the above descriptors, preprocessing of free hand sketch.

Compression of free hand sketch with gallery of images. Retrieval of matched images from the database 5/22/12

Global structure and subsystems

4. The

Retrieval and Database Management Subsystem:

1.

The Retrieval subsystem is used just to retrieve the matched image to the free hand sketch. In Database Subsystem the images and their descriptors are stored and necessary mechanism for subsequent processing is provided. This module consists of The storage The Retrieval 5/22/12 Data manipulation modules

1.

1.

Global structure and subsystems

5. The Display Subsystem: Since drawings are basis of retrieval. The Drawing surface. The screen for retrieval of matched images.

5/22/12

Advantages

Make convenient to retrieve data or images based on sketches so that even illiterates , who do not know to write text can also make use of system effectively.

Introducing this system into search engines makes corporate world and even other users bit more efficient in retrieval of data effectively.

5/22/12

Tests and Results

Used Test Databases: The system is tested with more than one sample database to obtain a more extensive description. Few used databases are: 1. Flicker 160 Database 2. Microsoft Research Cambridge Object Recognition image Database 3. Wang the database from corel image database.
q q

Testing Aspects, Used Metrics: . We can evaluate the effectiveness of the system forming methods, and comparing different applied methods. This compression can be done easily through Metrics.
.

By applying EHD & HOG methods on these databases, we can find this system better than some systems before. So this system is more effective than the examined other systems. 5/22/12

Conclusion:
Among the objectives of this paper performed to design, implement and test a sketch-based image retrieval system. Two main aspects were taken into account. The retrieval process has to be highly interactive. The robustness of the method is essential in some degree of noise, which might also be in case of simple images. Based on the test results with many databases HOG is more better in many cases than EHD.

5/22/12

References
[1] D. Comaniciu, and P. Meer, Robust analysis of feature spaces: color image segmentation, IEEE Conference on Computer Vision and Pattern Recognition, pp. 750755, June 1997. [2] N. Dalal, and B. Triggs, Histograms of oriented gradients for human detection, IEEE Conference on Computer Vision and Pattern Recognition, pp. 886893, July 2005. [3] T. Deselaers, D. Keysers, and H. Ney, Features for image retrieval: an experimental comparison, Information Retrieval, vol. 11, pp. 77107, December 2007. [4] M. Eitz, K. Hildebrand, T. Boubekeur, and M. Alexa, An evaluation of descriptors for large-scale image retrieval from sketched feature lines, Computers and Graphics, vol. 34, pp. 482498, October 2010. [5] R. Fabbri, L.D.F. Costa, J.C. Torelli, and O.M. Bruno, 2D Euclidean distance transform algorithms: a comparative survey, ACM Computing Surveys, vol. 44, pp. 144, February 2008. [6] M. Flickner, H. Sawhney, W. Niblack, J. Ashley, Q. Hiang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Steele, and P. 5/22/12Query Yanker, by image and video content: the QBIC system, IEEE Computer, vol. 28,

QUERIES ?

5/22/12

Thank you

5/22/12