EE 583 PATTERN RECOGNITION

Introduction Overview, basic concepts Example problems Different Approaches

Introduction
Pattern recognition (PR) is a tool for machine intelligence problem PR is a science for description or classification/recognition of

measurements

Interrelated approaches to PR

Statistical (StatPR) Syntactical or structural (SyntPR) Neural (NeurPR)

Pattern Recognition Applications

Image segmentation Seismic analysis Radar signal classification Face detection/recognition Speech recognition/understanding Fingerprint identification Character recognition Medical diagnosis

What is PATTERN ?
Pattern : anything you want to classify
e.g. Peaches, array of pixels, speech waveform vector

Feature : any data extractable from measurements (low & high level)
e.g. color, age, name, weight (low) e.g aspect ratio, dominant color (high)

Some definitions :
Classification : Assigning input into one of classes based on features Recognition : Ability to classify Description : Alternative to classification where a structural description of input is desired Pattern class : A set of patterns known to originate from the same source, sharing some common attributes Noise : Distortions or errors of input, errors in feature extraction, errors in training data

Classifiers, Decision Regions

A classifier partitions feature space into class-labeled decision regions For unique class assignment, these regions must cover all feature space and disjoint Border of each region is called decision boundary (not easy to find) Classification strategy is simple : assign feature vector according to the class of the decision region

Abstract Representation
Gi M p1 Class Wi Gj p2 m1

m2

Class Wj

p3

Class Membership Space C

Pattern Space P

Measurement Space F

Given measurements, find and invert M and G

Example 1 :
Classify basketballs and oranges Selected features : weight and color Realized patterns are basketballs and oranges with different weights and colors Color (even weight) can be misleading Selected features are not appropriate for this classification

Example 2 :
Classify sea bass and salmon Choose the features

Obtain a threshold from training data for classification

e.g. length, lightness, width

Example 2 (contd) :
Use two features together : ligthness and width Classify by defining a boundary between the samples

Memorize vs. Generalize Complicated vs. simple models

Example 3: Shape Recognition

m pq = x p y q f ( x, y ) dxdy p, q = 0,1,2,K m m pq = ( x 10 ) p ( y 01 ) q f ( x, y ) dxdy p, q = 0,1,2,K m m00 pq 00 pq = [( p + q ) / 2]+1 p + q = 2,3,K
y

Features : moment-based

00

7 RST-invariant features can be derived e.g. x

1 = 20 + 02

Approaches to PR
Statistical : assumes underlying model is a set of probabilities, but structure is ignored Structural or syntactic : assumes interrelations are more important, but not easy to find these relations Neural : imitates humans, based on statistical PR fundamentals.

Components of PR systems
1. 2. 3. 4. 5.

Sensing Segmentation Feature Extraction Classification Post-processing

PR problem Design Cycle

1.

Data collection
Find typical examples

2.

Feature choice
Prior knowledge & invariance

3.

Model choice
Model selection is not easy

4.

Training
`learning by example`

5.

Evaluation