Professional Documents
Culture Documents
Presented by
K. Rasool Reddy M.Tech - E.C.E 11S11D7008
Contents
Objective Stabilization Image stabilization methods Basic block diagram of video stabilization Matching techniques Matching techniques algorithm Implementation of Features and Image Matching Results Quality measure Comparison between existing and proposed methods.
Advantages
Conclusion and Future Scope References
Objective
Now a days, the market of handheld camera has growth rapidly. However, video capturing by non-professional user normally will lead to unanticipated effects. To overcome this effect, propose a simple and
Stabilization
Generally the process of stabilization have to go through three phases namely
1.
2. 3.
Motion estimation,
Motion smoothing Image composition
Gyroscopic Stabilizer
Matching Techniques
The main objective of Proposed algorithm is
to stabilize jittery videos directly without the need to estimate camera motion.
Select Correspondences between Points Estimating Transform from Noisy Correspondences Transform Approximation and Smoothing
Distinctiveness:
can differentiate a large database of objects
Quantity
hundreds or thousands in a single image
Efficiency
real-time performance achievable
Generality
exploit different types of features in different situations
Feature Descriptors
corner: significant change in all directions, i.e., even the minimum change is large
Find locations such that the minimum change caused by shifting the window in any direction is large
IIx
2 Iy
u y
The solution:
x1 x2
IIx
2 Iy
u y
xx+
Eigenvalues and eigenvectors of H
Capture shifts with the smallest and largest change (E value) x+ = direction of largest increase in E. + = amount of increase in direction x+ x- = direction of smallest increase in E. - = amount of increase in direction x-
+ >> 1
Example
f Harris = +
2 + h ) 11 22
2
=det( H)ktrace(H)
det is the determinant; trace = sum of diagonal elements of a matrix Very similar to - but less expensive (no eigenvalue computation) Called the Harris Corner Detector or Harris Operator Most popular among all detectors
Harris operator
Scale?
No!
Key idea: Find scale that gives local maximum of fHarris Generate copies of image at multiple scales by convolving with Gaussians of different and using a pyramid Find local maxima points by comparing to neighboring points at current and adjacent scales Each interest point is a local maximum in both position and scale
Feature descriptors
We know how to detect good interest points Next question: How to match image regions around interest points? Answer: Need feature descriptors
Feature descriptors
Lots of possibilities (this is a popular research area)
Simple option: match square windows of pixels around the point State of the art approach: SIFT
8 pixels
2
angle histogram
SIFT descriptor
Full version
Divide the 16x16 window into a 4x4 grid of cells (8x8 window and 2x2 grid shown below for simplicity) Compute an orientation histogram for each cell 16 cells * 8 orientations = 128 dimensional descriptor
Feature matching
Given a feature in I1, how to find the best match in I2?
1. 2. Define distance function that compares two descriptors Test all the features in I2, find the one with min distance
f1
f2
I1
I2
f1
f2'
f2
I1
I2
Image matching
SSD feature distance
50 75 200
Suppose we use SSD Small values are possible matches but how small? Decision rule: Accept match if SSD < T where T is a threshold What is the effect of choosing a particular T?
Effect of threshold T
SSD feature distance
a b c
50 75 200
Effect of threshold T
SSD feature distance
a b c
50 75 200
SSD
T
True positives False positives
(TPR)
(FPR)
SSD
1
ROC curve
TPR
FPR
TPR
Area 0.5
FPR 1
TPR
Area 1.0
0 FPR 1
1 0.7
true positive rate
0 0.1
RESULTS
Corners in B
50
50
100
100
150
150
200
200
50
100
150
200
250
300
50
100
150
200
250
300
50
100
150
200
50
100
150
200
250
300
50
100
150
200
50
100
150
200
250
300
50
A B
100
150
200
50
100
150
200
250
300
Figure: color composite showing frame an overlaid with the reprojected frame B
50
100
150
200
50
100
150
200
250
300
Corrected output
Raw input mean Corrected sequence mean
50
100
150
200
100
200
300
400
500
600
Quality measure
Parameter
Computational Time(Sec) Quality Value
Existing Technique
9.28 40.50%
Proposed Technique
8.078 69.6%
Advantages The main advantage of this technique is reduce the effect of shakings on the
video. Computational speed will be high.
the consequences of extreme shaking of handheld camera in feasible real time implementation for video stabilization.
References
[1] M. Gleicher and F. Liu., Re-cinematography: Improving the camerawork of casual video, ACM Transactions on Multimedia Computing, Communications, and Applications, 5(1), pp 1- 28, 2008. [2] Video Stabilization and Enhancement by Hany Farid and Jeffrey B. Woodward ,Department of Computer Science, Dartmouth College ,Hanover NH 03755.
[3] A thesis on Onboard video stabilization for unmanned air vehicles by Nicholas S. Cross.
[4] Aleksandra Shnayderman, Alexander Gusev, and Ahmet M. Eskicioglu An SVD-Based Grayscale Image Quality Measure for Local and Global Assessment , IEEE 15(2), 2006. [5] A thesis on Fast Video Stabilization Algorithms by Mohammed A. Alharbi, Captain, RSAF AFIT/GCS/ENG/06-02.