m What is emotion ?

m A basic emotion model from biometrics viewpoint.

m Role of biosignals in detection of human emotions.
mA typical biometric system architecture for emotion
recognition
m Processing model of an ECG signal
m Comparison of bio-signals for different emotions
m Future scope and applications
m Challenges and Limitations
m Conclusion
Emotion is the complex psychophysiological experience
of an individual·s state of mind as interacting with
biochemical(internal) and environmental(external)
influences .
 Emotion: a concept involving three components:
m Subjective experience
m Expressions ( audiovisual: face, gesture, posture, voice
intonation, breathing noise )
m Biological arousal ( ANS: heart rate, respiration
frequency/intensity, perspiration, temperature, muscle
tension, brain wave ) High
Terror arousal
Agitation

Excited
Anticipation
Distressed

Negative Positive
Relaxed
Disgust

Bliss
Mournful
Low
arousal
m Different emotional expressions produce different
changes in autonomic activity:
m Anger: increased heart rate and skin temperature
m Fear: increased heart rate, decreased skin
temperature
m Happiness: decreased heart rate, no change in skin
temperature

m Continuous data collection

m Robust against human social artifact

m Easily integrated with external channels (face and

speech)
m Photoplethysmography, bounces infra-red light
against a skin surface and measures the amount of
reflected light.
m Palmar surface of fingertip
m Features: heart rate, vascular dilation (pinch),
vasoconstriction
m Cues:
m Increasing BV- angry, stress
m Decreasing BV- sadness, relaxation
m Electrical voltages generated by brain cells
(neurons) when they fire, frequencies between 1-
40Hz
m Frequency subsets: high beta (20-40Hz), beta
(15-20Hz), Sensorimotor rhythm (13-15Hz),
alpha (8-13Hz), theta (4-8Hz), delta (2-4Hz),
EMG noise (> 40Hz)
m Standard 10-20 EEG electrode placement
m Mind reading, biofeedback, brain computing

Alpha

Raw
m Muscle activity or frequency of muscle tension
m Amplitude changes are directly proportional to
muscle activity
m On the face to distinguish between negative and
positive emotions
m Recognition of facial expression, gesture and
sign- language
m Measure of skin·s ability to conduct
electricity
m Linear correlated with arousal
m Represents changes in sympathetic nervous
system and reflects emotional responses and
cognitive activity
m Relative measure of chest expansion
m On the chest or abdomen
m Respiration rate (RF) and relative breath
amplitude (RA)
m Emotional cues:
m Increasing RF ² anger, joy
m Decreasing RF ² relaxation, bliss
m Measure of skin temperature as its
extremities
m Dorsal or palmar side of any finger or toe
m Dependent on the state of sympathetic
arousal
m Increase of Temp: anger > happiness,
sadness > fear surprise, disgust
m Measures contractile activity of the heart
m Provides two types of information :
a) by measuring IBI , electrical activity is detected and shows if it
is normal, fast or slow
b) stress carried by hear
m Heart rate (HR), inter-beat intervals (IBI) and heart rate
variability (HRV), respiratory sinus arrhythmia
m Emotional cues:
m Decreasing HR: relaxation, happy
m Increasing HRV: stress, frustration
mAnalysis of various ECG waves and normal vectors of
depolarization and repolarization yields important
emotional information.

mEvery emotion has a unique

PQRST pattern in terms of
amplitude, shape, consistency
and time interval between waves

m By analyzing & comparing

the acquired ECG signal, emotion
of a person can be detected
 No
Require new acquisition Additional image preprocessing,
of biometric adaptive extraction/representation

Signal Processing, Quality

Biometric Transmission Feature Extraction, Sufficient?
Data Collection Representation
Yes
Generate Template
Approx 512 bytes of data
per template Database Template Match

Biometric Template: A file

holding a mathematical Decision No
representation of the identifying Yes Confidence?
features extracted from the raw For practical
biometric data. application/use





  

m Each participant were made to listen to four songs
and their emotional characteristics were observed
using biometrics.
m Basic four signals which were analyzed were :
SC, EMG , RESP and ECG/EKG.

m Song selection criteria

m song1: enjoyable, harmonic, dynamic, moving
m song2: noisy, loud, irritating, discord
m song3: melancholic, reminding of sad memory
m song4: blissful, slow beat, pleasurable,
slumberous





  

m Lie detector test can further be expanded to knowing exactly
what frame of mind of the person is in.

m Understanding abnormal behavior in human beings under

certain conditions.

m Development of human machine interface gadgets.

m In recognizing emotions from a speech or ECG signal in

selection of a training corpus

m In entertainment industry, several models for human interactive

games / rides have been designed and successfully implemented
using emotion recognition.

m Research to understand the super human beings.

mRequires integration of various bio signals and bio sensing
technologies. Hence, in practical applications, it becomes difficult to
customize the entire system

m Mood of human beings differs from one another and each has
different ways of expressing themselves under similar conditions.
Hence, in many situations, same data can not be applied for say a
person from England and one from Thailand. Hence, database for
people from different regions need to be rebuild and may not be
common for all.

m Need to develop more accurate biosensors and unparticular, a multi-

utility bio sensors.

m Generally, emotion recognition requires huge data collection, storage

and processing using some heavy software. So it becomes a challenge
if we want to implement emotion recognition on any portable device.
m Still there remains certain lack of knowledge regarding
human body and its behavior in terms of biology.
However, we can say emotion recognition would help in
understanding human behavior much better and open the
doors for several applications in near future.

m Advancements in several fields like bio sensors, signal

processing, image processing , human psychology and
human biology would collectively help in development of
emotion recognition systems.