Introduction To Opencv

Computer Vision
Luigi De Russis
Introduction to
OpenCV
OpenC what?
OpenCV in brief
Introduction to OpenCV
04/11/2014
What is OpenCV?
3
Open source Computer Vision library

BSD License
http://opencv.org
Originally developed by Intel

Has more than 2500 optimized algorithms
Supports a lot of different languages
C, C++, Python, Java
but is written natively in C++
Cross platform
also available for Android and iOS
04/11/2014
What it is used for?

4
Human-Computer Interaction (HCI)

Object Identification
Object Recognition
Face Recognition
Gesture Recognition
Motion Tracking
Image Processing
Mobile Robotics
and so on
04/11/2014
Motivations - OpenCV
Always ask why?
04/11/2014
Why OpenCV?
6
vs.
04/11/2014
OpenCV: pros
7
Specificity
OpenCV
was made for image processing

Matlab is quite generic
Speed
30+
frames processed per seconds in real time image

processing with OpenCV
around 4-5 frames processed per seconds in real time
image processing with Matlab
Efficiency
Matlab
needs more system resources than OpenCV

04/11/2014
OpenCV: cons
8
Easy of use
Matlab
won hands down!
Integrated Development Environment (IDE)

you
can use Eclipse, Netbeans, Visual Studio, Qt,

XCode, even a simple text editor for OpenCV
Matlab has is own IDE
Memory management
04/11/2014
OpenCV: pros (final)

9
Price (!)
OpenCV Wrappers
SimpleCV,
Emgu CV, ruby-opencv
More similar to industry-level frameworks
04/11/2014
10
Motivation - Java
When Java meets OpenCV
04/11/2014
Some facts
11
The OpenCV APIs have few capabilities for user

interfaces
i.e.,
you can open a window with an image inside. Do

you want a button? You cannot have it!
to have a decent user interface you need to install
something else (e.g., Qt for C++)
and then compile OpenCV with Qt support
C++ learning curve is quite steep

source:
experiences from teaching this course in the last
years
04/11/2014
Some (other) facts

12
OpenCV C++ APIs exist since OpenCV 1.0 but they

dramatically changed in OpenCV 2.0
it
is possible, but not recommended, to mix different

OpenCV version
typically, it is a good way to get into trouble!
It is possible to use OpenCV C APIs together with

C++ APIs
typically
it is a good way to get into trouble!
04/11/2014
Some (other) facts

13
OpenCV C++ APIs exist since OpenCV 1.0 but they

dramatically changed in OpenCV 2.0
It
is possible, but not recommended, to mix different

OpenCV version
Typically, it is a good way to get into trouble!
Yeah, some students did it!
It is possible to use OpenCV C APIs together with

C++ APIs
typically
it is a good way to get into trouble!
04/11/2014
A better world is possible?

14
OpenCV provides also Java APIs

nothing
to compile (on Windows)

they works on Android, too
Java 7/8 has a first-grade user interface

not
Swing, but JavaFX

http://docs.oracle.com/javafx/2/
Almost everybody here should have some (basic)

experience with Java
Performances between the C++ APIs and the Java
APIs are comparable
04/11/2014

15
The OpenCV Java APIs are really similar to the C++

version
knowledge can be transferred!
examples:
to store an image in memory both use the Mat object

to write an image on disk both use the imwrite method
Something changes a bit
examples:
CV_RGB2GRAY (C++) becomes COLOR_RGB2GRAY (Java)
Point, Point2d, Point2f (C++) becomes 3 overloaded

constructor of Point (Java)
04/11/2014

16
Question:
is
OpenCV with Java/JavaFX the best solution for

every application?
04/11/2014

17
Question:
is
OpenCV with Java/JavaFX the best solution for

every application?
Response:
No,
obviously
Do you need a GUI? Go with JavaFX!
Do you have memory constraint? Go with C/C++!
Please, no extremism!
04/11/2014
18
OpenCV meets Java

Getting started with OpenCV and Java
04/11/2014
Modules
19
OpenCV has a modular structure:

the package includes several shared or static libraries
core
imgproc
basic structures and algorithms

image processing algorithms (such as image filtering,
geometrical image transformations, histograms, etc.)
video
video analysis (such as motion estimation and object

tracking)
04/11/2014
Modules
20
highgui
calib3d
camera calibration and 3D reconstruction
features2d
basic operation to read/write/encode images; in C, C++

and Python it provides also basic UI capabilities
2D features framework (feature detectors, descriptors, and

descriptor matchers)
objdetect
detection of objects and other items (e.g., faces, eyes, mugs,

people, )
04/11/2014
Modules
21
ml
machine
learning classes used for statistical

classification, regression and clustering of data
gpu
GPU-accelerated
photo
computational
algorithms
photography
ccl
OpenCL-accelerated
algorithms
04/11/2014
Data Structures
22
We speak about Java APIs

All the OpenCV classes and methods are placed into
the org.opencv.* packages
Mat
the primary image structure in OpenCV 2.x
overcomes the old IplImage/CvMat problems (OpenCV
1.x/C API)
automatic memory management (more or less in C++)
two data parts:
matrix header (contains information about the matrix)
a pointer to the matrix containing the pixel values
04/11/2014
Data Structures
23
Point
2D point
defined by x, y coordinates
Point first = new Point(2, 3);
Size
2D size structure
specify the size (width and height) of an image or
rectangle
Rect
2D rectangle object
04/11/2014
Basic Image I/O

24
Highgui.imread
loads an image from file and return the corresponding Mat
object
Mat Highgui.imread(String filename,
int flags)
Highui.imwrite
save an image on disk

bool Highgui.imwrite(String filename,
Mat img, MatOfInt params)
04/11/2014
Basic Drawing Operations

25
Core.circle
draws a simple or filled circle with a given center and radius on a
given image
Core.line
draws a line between two point in the given image
Core.ellipse
draws an ellipse outline, a filled ellipse, an elliptic arc, a filled
ellipse sector,
Core.rectangle
draws a rectangle outline or a filled rectangle
note that negative thickness will fill the rectangle
04/11/2014
Color Spaces
26
Imgproc.cvtColor
converts an input image from one color space to another

examples:
cvtColor(src, dest, Imgproc.COLOR_RGB2GRAY);

cvtColor(src, dest, Imgproc.COLOR_HSV2BGR);
cvtColor(src, dest, Imgproc.COLOR_RGB2BGR);
Important! Images in OpenCV uses BGR instead of RGB
04/11/2014
27
Lets get practical!

Getting started (without going crazy)
04/11/2014
How can we use OpenCV?

28
LABINF:
already
installed under Windows

Java 7 and OpenCV version 2.4.9
Eclipse (Luna) is the IDE
At home:
we
recommend Eclipse Luna, Java 7 and OpenCV

2.4.9/2.4.10
feel free to use any Java IDE you like
Installation:
see
the PDF document in the teaching portal
04/11/2014
What if I got problems?

29
Small problems
drop me a line
luigi.derussis@polito.it
Normal problems
Problems with JavaFX and a gray scale image
Awesome student to me
Hi,
[] Im using cvtColor(image, gray, COLOR_BGR2GRAY); but it give this exception: []
Can you help me?
come to office hours

every Thursday, 16:00 - 17:30
my office is at the third floor of DAUIN (B side)
please send an e-mail beforehand
Regards,
Enormous problems
pray?
no, seriously, we can schedule an extra lesson
04/11/2014

30
OpenCV installation
Small problems
drop me a line
Normal problems
Not-So-Awesome student to me
Hi,
[] I followed the guide for installing OpenCV on my Mac but I have an error after step 3. Can
we meet on next Wednesday to solve the problem?
Thanks!
Regards,

Enormous problems
pray?
04/11/2014

31
Small problems
drop me a line
Normal problems
Help with OpenCV
Good student to me
Hi,
[] I see the solution of Exercise 2.1 but I dont understand the following expressions:
main();
System.out.println();
@Override.
Can you explain to me what they are?
Enormous problems
Regards,
pray?
04/11/2014
An e-mail not to be sent!

32
04/11/2014
Useful Resources
33
OpenCV Wiki
OpenCV Official Documentation
http://answers.opencv.org/questions/
OpenCV Javadocs
http://docs.opencv.org/
User Q&A forum
http://code.opencv.org/projects/opencv/wiki
http://docs.opencv.org/java/
JavaFX Documentation
http://www.oracle.com/technetwork/java/javase/document
ation/javafx-docs-2159875.html
04/11/2014
34
Demo Hour
Put everything together
04/11/2014
License
35
This work is licensed under the Creative Commons AttributionNonCommercial-ShareAlike Unported (CC BY-NC-SA 3,0) License.
You are free:
Under the following conditions:
to Share - to copy, distribute and transmit the work

to Remix - to adapt the work
Attribution - You must attribute the work in the manner specified by the
author or licensor (but not in any way that suggests that they endorse
you or your use of the work).
Noncommercial - You may not use this work for commercial purposes.
Share Alike - If you alter, transform, or build upon this work, you may
distribute the resulting work only under the same or similar license to this
one.
To view a copy of this license, visit

http://creativecommons.org/licenses/by-nc-sa/3.0/
04/11/2014

Introduction To Opencv

Uploaded by

Document Information

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Introduction To Opencv

Uploaded by

Copyright:

Available Formats

Computer Vision

Open source Computer Vision library

Originally developed by Intel

also available for Android and iOS

What it is used for?

Human-Computer Interaction (HCI)

was made for image processing

frames processed per seconds in real time image

needs more system resources than OpenCV

won hands down!

Integrated Development Environment (IDE)

can use Eclipse, Netbeans, Visual Studio, Qt,

OpenCV: pros (final)

Emgu CV, ruby-opencv

More similar to industry-level frameworks

The OpenCV APIs have few capabilities for user

you can open a window with an image inside. Do

C++ learning curve is quite steep

experiences from teaching this course in the last

Some (other) facts

OpenCV C++ APIs exist since OpenCV 1.0 but they

is possible, but not recommended, to mix different

It is possible to use OpenCV C APIs together with

it is a good way to get into trouble!

Some (other) facts

OpenCV C++ APIs exist since OpenCV 1.0 but they

is possible, but not recommended, to mix different

Yeah, some students did it!

It is possible to use OpenCV C APIs together with

it is a good way to get into trouble!

A better world is possible?

OpenCV provides also Java APIs

to compile (on Windows)

Java 7/8 has a first-grade user interface

Swing, but JavaFX

Almost everybody here should have some (basic)

A better world is possible?

The OpenCV Java APIs are really similar to the C++

to store an image in memory both use the Mat object

Something changes a bit

CV_RGB2GRAY (C++) becomes COLOR_RGB2GRAY (Java)

Point, Point2d, Point2f (C++) becomes 3 overloaded

A better world is possible?

OpenCV with Java/JavaFX the best solution for

A better world is possible?

OpenCV with Java/JavaFX the best solution for

OpenCV meets Java

OpenCV has a modular structure:

basic structures and algorithms

video analysis (such as motion estimation and object

camera calibration and 3D reconstruction

basic operation to read/write/encode images; in C, C++

2D features framework (feature detectors, descriptors, and

detection of objects and other items (e.g., faces, eyes, mugs,

learning classes used for statistical

We speak about Java APIs

Point first = new Point(2, 3);

Basic Image I/O

save an image on disk

Basic Drawing Operations

converts an input image from one color space to another

cvtColor(src, dest, Imgproc.COLOR_RGB2GRAY);

Important! Images in OpenCV uses BGR instead of RGB