You are on page 1of 38

Digital Image Processing

I. Introduction
Hamid Laga
Institut Telecom / Telecom Lille1 hamid@img.cs.titech.ac.jp
http://www.img.cs.titech.ac.jp/~hamid/

Presenter
Hamid Laga PhD in Computer Science (2006),
Tokyo Institute of Technology Previuously: Assistant Professor, Tokyo Institute of Technology (Japan) Since October 1st, 2010: Associate Professor Telecom Institute / Telecom Lille1 Homepage:

http://www.globaledge.titech.ac.jp/faculty/hamid/ Email: hamid@img.cs.titech.ac.jp


Research fields Image processing, Computer Vision, 3D Digital Geometry Processing, Multimedia Information Retrieval

Course description
Target
Learn the fundamentals of digital image processing Theoretical concepts, hands-on practice

Background
No prior knowledge of Image Processing is required Basic linear algebra, signal processing, and probability theory.

Language
English (preferred) French
Questions in French are accepted too.

Programming (TP)
Matlab (recommended) Other languages (such as Java or C++) can be also used but NOT recommended.
3

Evaluation
In the class
(Very) Short assignments (home works) Active participation

TP
Programming assignments

Final exam

Course outline

5

Lecture 1: Introduction Lecture 2: Digital Image Fundamentals Lecture 3: Intensity transformations TP1: Introduction to Matlab, Image manipulation with Matlab. Lecture 4: Spatial filtering, convolution, and enhancement Lecture 5: Image restoration Lecture 6: Wavelet and multi-resolution processing Lecture 7: Scale-space image processing Lecture 8: Morphological image processing Lecture 9: Image segmentation I TP2: to be announced later Lecture 10: Image segmentation II TP3: to be announced later. Summary and open discussion

Resources
Recommended textbooks

Others

Resources
Related online courses and tutorials
Digital Image Processing 2009-2010 (Prof. Bernd Gerod) http://www.stanford.edu/class/ee368/ Rendering and image processing (Alexei Efros) http://graphics.cs.cmu.edu/courses/15-463/2004_fall/www/463.html Computer Vision at CMU http://www.andrew.cmu.edu/course/16-720/syllabus.html Foundations of Computer Vision http://www.cs.toronto.edu/~jepson/csc2503/index09.html L.Fei-Fei lectures notes http://vision.stanford.edu/teaching/cs223b/syllabus.html

A short survey

What is digital image processing (DIP)


Processing digital images by the mean of a digital computer Other related areas
Computer graphics:
Generate images with computers

Image analysis, Computer vision


The boundaries are not clear !!

Common distinction
Image processing is a discipline in which the inputs and the outputs are images
9

Image processing vs. computer vision


Low-level
Preprocessing:
reduce noise, contrast enhancement, image sharpening.

Both input and outputs are images

10

Image processing vs. computer vision


Mid-level
Segmentation (Partitioning an image into regions or objects) Description of the segmented objects Classification / recognition of individual objects. Inputs are images, outputs are attributes extracted from these images (edges, contours, identity of individual objects).

11

Image processing vs. computer vision


High-level
Making sense of an ensemble of recognized objects

Four Latin persons looking a little girl


12

People with umbrellas, Rainy weather

Image processing vs. computer vision


In this lecture
Low level Mid level High level

Four Latin persons looking a little girl

Image processing Image analysis, computer vision


13

The origins of digital image processing


1920 (newspaper industry)
Bartlane cable picture transmission system
Pictures were sent through a submarine cable between London and New York

1920 Five levels of gray


14

1922

1929 15 levels of gray

The origins of digital image processing


1964 (Space applications, JPL California)
Pictures of the moon taken by Ranger7 processed to correct distortions inherent to on-board TV cameras

Courtesy of NASA

15

The origins of digital image processing


Late 1960s Early 1970s:
Medical imaging (invention of the Computerized Tomography - CT) Remote earth resources observation, astronomy

1970s to now
Medicine, biological sciences, geography, archaeology, physics, nuclear medicine, law enforcement, defense, industry,

2005 to now
internet !!
16

Image processing examples


Restoration of images from Hubble space telescope

Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod) http://www.stanford.edu/class/ee368/, Courtesy of :IVPL Northwestern University, Chicago

17

Image processing examples


Color photo enhancement

Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod) http://www.stanford.edu/class/ee368/

18

Image processing examples


Noise reduction

Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod) http://www.stanford.edu/class/ee368/

19

Image processing examples


Special effects

Input photo

Simulated color pencils

Simulated oil painting

Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod) http://www.stanford.edu/class/ee368/

20

Image processing examples


Pseudo-color enhancement for security screening

Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod) http://www.stanford.edu/class/ee368/

21

Image processing examples


Extraction of settlement areas from aerial photos

Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod) http://www.stanford.edu/class/ee368/

22

Image processing examples


Detecting / assessing earthquake damages

Haiti earthquake. Source: http://www.disasterscharter.org/

23

Image processing examples


Image mosaics
A mosaic from 33 images

A mosaic from 21 images

24

Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod) http://www.stanford.edu/class/ee368/

Image processing examples


Face detection

Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod) http://www.stanford.edu/class/ee368/

25

Image processing examples


Face morphing

Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod) http://www.stanford.edu/class/ee368/

26

Image processing examples


Biometrics

Fingerprint recognition Source: Digital Image Processing 2009-2010 (Prof. Bernd Girod) http://www.stanford.edu/class/ee368/

Iris recognition

27

Quick tour of digital image processing


Image acquisition L3

Wavelets & multiresolution analysis (L7) Scale-space processing (L8) Morphological image processing (L9)

Segmentation (points, lines, edges, regions) - L10 Representation Descriptors

Intensity transforms
(Statistics, histogram, filtering, enhancement) L4, L5

Image restoration L6

Object Recognition
Output are attributes

Output are generally images

28

Image acquisition

29

Intensity transforms

Original

Blurring

Sharpening

30

Image restoration

Original

Restored

31

Multi-resolution analysis

32

Scale-space processing

33

Morphological image processing

34

Image segmentation

35

Requirements
Math
Linear algebra, Probability theory, Optimization

Signal processing
Fourier transforms, sampling theory

Machine learning
Data analysis
mainly Principal Component Analysis (PCA)

Pattern recognition

36

Overview of this course


Overview

37

Lecture 1: Introduction Lecture 2: Digital Image Fundamentals Lecture 3: Intensity transformations TP1: Introduction to Matlab, Image manipulation with Matlab. Lecture 4: Spatial filtering, convolution, and enhancement Lecture 5: Image restoration Lecture 6: Wavelet and multi-resolution processing Lecture 7: Scale-space image processing Lecture 8: Morphological image processing Lecture 9: Image segmentation I TP2 Lecture 10: Image segmentation II TP3 Summary and open discussion

What is next
Review of some Mathematical concepts

38