Image De-fencing

Guided By,
Dr. Sreeni K G

Jerry Korulla George,

M3 Signal Processing ,
Roll. No. 6
CET

What is De-Fencing?
Fences: near-regular foreground patterns that are often unwanted, but unavoidable in digital
imagery.

What is De-Fencing?
De-fencing: Process of automatically removing fences from an image.

Applications
Animal photography in zoo.

Sports photography
Photography of buildings behind fences

Present Techniques
1.

"Image De-fencing, Yanxi Liu, Tamara Belkina, James H. Hays, and Roberto Lublinerman,
Computer Vision and Pattern Recognition Conference (CVPR) 2008.

2.

Image De-fencing Revisited, Minwoo Park, Kyle Brocklehurst, Robert T. Collins and Yanxi
Liu, Asian Conference on Computer Vision (ACCV) 2010.

Steps in De-fencing
1.

Finding a lattice.

2.

Classifying pixels as foreground or background.

3.

Filling the background holes with texture inpainting.

Finding the Lattice

1.

Assign neighbor relationships among a set of interest points.

2.

Use the strongest cluster of repeated elements to propose new, visually similar interest
points.

3.

Higher-order constrains are used to promote geometric consistency between pairs of

assignments.

Online learning using a support vector machine can be performed to improve the classification
of lattice points and for foreground segmentation.

Foreground/background Separation
a) Align the texels
b) Compute the standard deviation of each pixel through
this stack of texels.
c) The cluster which has the lowest variance centroid is
taken as foreground and the rest background.
d) Create a mask containing the foreground

Texture Inpainting
= Target Region

= Source Region

= Contour

1.

The square template p centred at the point p is to be filled.

2.

The best-match sample from the source region comes from the patch
q which is most similar to those parts that are already filled in p .

3.

To propagate the isophote inwards, transfer the pattern from the bestmatch source patch to p.

Additional techniques:
Multi-view inpainting
Symmetry augmented inpainting

A Novel Spatial Domain Approach for

Fence Detection.
1.

Find the edges of the input image.

2.

Obtain Hough Transform of the edges.

3.

Detect the peaks in the Hough transform.

4.

Find the dominant angles in the edge map from the peaks in the Hough transform.

5.

Separate the fences from the image making use of the information about the dominant
angles of the fence.

Input Image

Edges

Hough Transform of Edges

Peaks in the Hough Transform

Strength of edges in different directions

Extracted Fence

Work Done
Image Inpainting
Exemplar based inpainting

Fence Detection
Mean Shift belief propagation
Morphological operations
Frequency domain technique
Hough Transform

Further Work
Refine the developed spatial domain technique to make the detection more accurate.

Develop other techniques for fence detection.

Reference
1.

"Image De-fencing, Yanxi Liu, Tamara Belkina, James H. Hays, and Roberto Lublinerman,
Computer Vision and Pattern Recognition Conference (CVPR) 2008.

2.

Image De-fencing Revisited, Minwoo Park, Kyle Brocklehurst, Robert T. Collins and Yanxi
Liu, Asian Conference on Computer Vision (ACCV) 2010.

3.

Discovering texture regularity as a higher-order correspondence problem, J. Hays, M.

Leordeanu, A. Efros, and Y. Liu, European Conference on Computer Vision (ECCV06).

4.

Object Removal by Exemplar-based Inpainting, Antonio Criminisi, Patrick Perez, and

Kentaro Toyama, IEEE Computer Vision and Pattern Recognition (CVPR), June 2003.