Professional Documents
Culture Documents
Bernstein Ran1 , Shar Tal2 , Tsachor Rachelle3 , Studd Karen4 , and Schuster Assaf1
1
and
the
third
is
keeping
our
method
as
Abstract
by
dierent
people
of
dierent
qualities
using
the
Kinect
sensor
We chose to use
that
requires
domain
expertise.
Introduction
expressive ones.
1.1 Motivation
LMA
for
Automated
found.
(phenotype)
towards
various
Figure 2:
human body
that are not visible (e.g., a user's hand is behind his or her back) are provided.
As
and
have
For
reducing
been
our
found
data
collection
predictive
for
emotional
state [23].
and
Space.
LMA has been used in the elds of dance, acting, athletics, physical therapy, and psychology and behavioral science. LMA helps actors
create momentary moods and portray personality traits through movement.
For exam-
prop-
erties
of all
and
Eort
Weight
ban qualities.
who quantied
tion.
ner.
Eort
and
Shape
[1],
for anima-
gure 1.
Figure
shows
the
skeleton
[8]
by
[4] used a
A third
The work of
ties together).
His
formance evaluation.
CMA dataset - includes 6 CMAs per550 clips). Every clip is about 3 seconds
Method
long, and the CMAs executed combinations of the 18 qualities. To achieve uni-
them.
We did
Advance
was
quantied
and
by
Retreat.
This distinction
projecting
the
velocity
sag
If
eral tasks.
P
P~CM (t) = jJoints j P~j (t),
the
is
perpendicular
to
P~shoulders ,
front
The use of a
P~f ront
0 0 1
= P~shoulders 0 1 0 ,
1 0 0
truth.
where
of the section.
contains
about
6000
was
denoted
in
the
beginning
The second
features,
and
Spreading
and
and jerk.
Enclosing
This
were
mean,
variance,
skew,
moments is denoted as
We
denote
P~j (t)
as
and
kurtosis
).
the
vector
(as
we
in time
in a clip with
frames, and
Svert (t) =
ery feature over the training set. Crossvalidation was used to determine the op-
~
~
P
P
j
CM ,
jJoints
Sustained.
Sudden
and
skew of the acceleration, relying on the assumption that the acceleration of a sudden
movement will be skewed further to the left,
i.e., will get a higher value at the beginning
of the movement.
In-
The ve-
is 4%.
V
P~j (t + 1) P~j (t),
~j (t) =
V
direct
motion.
locity direction
direct
is calculated by
and
~ j (t) = V
~j (t + 1) V
~j (t).
A
6, the optimal ratio was obtained by selecting the top 60% out of the features
alone is not a relevant metric for the performance evaluation because one can get 85%
dataset.
The
third
phase
of
feature
section
F1 =
As seen in Figure
2 precision recall
.
precision + recall
(LASSO) regularization.
Quality
Feature Description
Information Gain
p-value
Jump
0.28
3.00E-50
Spread
0.25
2.20E-49
Rotation
0.21
4.80E-46
Up+Rise
0.2
3.00E-31
Free+Light
0.16
1.10E-24
Rhythmicity
0.16
1.50E-11
Table 1: Example of several qualities and the feature found to be the most informative for
them. Relative position stands for the position of the joint relative to the ancestor joint in
the joint hierarchy.
Chance
stands
for
applying
the
Nearest
Neighbors algorithm.
NN
LinearSVC
LabelBalancing
whole dataset.
Lasso, SFS
InfoGain
tion), and
the
stance.
Feature Selection
(information gain
section.
bel sets.
nored.
ure 9.
Figure 8: Recall, precision and F1 score of each Laban quality separately. The evaluation
0.6
0.5
0.5
F1 score
0.6
0.4
0.3
0.4
0.3
SFS
InfoGain
Lasso
LabelBalancing
NN
LinearSVC
Chance
SFS
InfoGain
Lasso
LinearSVC
LabelBalancing
0.2
NN
0.2
Chance
F1 score
Figure
rithm's evolution.
9:
Evaluation
on
CMA
mixture
Ev-
1 ,
and
found
that
multitask
learning
for
kW k2,1 =
X sX
2,
wij
all
(1)
kW k2F =
XX
i
2
wij
,
[15], where
Feature selection
Quality
Precis- Recall
F1
ion
score
Jump
0.89
0.81
0.85
0.69
0.85
0.76
Sink
0.62
0.79
0.69
Rhythmicity
0.59
0.72
0.65
Spread
0.55
0.76
0.64
Head drop
0.60
0.66
0.63
Rotation
0.66
0.60
0.63
0.45
0.94
0.61
Up and Rise
0.67
0.54
0.60
0.44
0.84
0.58
0.67
0.54
0.60
Advance
1.00
0.38
0.55
Retreat
0.50
0.59
0.54
Passive
0.40
0.85
0.54
Bind
0.44
0.61
0.51
Direct
0.56
0.49
0.52
Sudden
0.61
0.41
0.49
Average
SD
0.29
As seen in Table 2,
Metric
Single task
Precision
0.46
0.71
Recall
F1
0.56
Table 2:
0.59
0.6
Multitask
0.65
close
Arms
To
Upper
Body
During the
Strong
kW k2,1 promotes sparsity in the weights matrix W such that for every row in the matrix,
0.42
0.34
ities, (feature
row
ri
in
fi
Strong
setting (
and
Sudden
for example).
The evaluation is
We
Conclusion
We
developed
sensor.
60-90%).
and
We designed sev-
method
for
recognizing
sink,
jump, spread,
0.8
as
strong
and
passive,
F1 score
0.6
degradation
in
the
performance
0.4
improvement
of
the
F1
score
from
Within a CMA
Within a Quality
Between CMAs
Between Qualities
a single task learning setting (0.56) to a mulof a shared model for several correlated tasks.
The mild degradation of the F1 score from a
seen CMA (0.6) to an unseen (0.57) shows a
very good generalization ability of our linear
classication
model.
This
ability
derives
Overall
believe
that
we
succeeded
The
References
and
Norman
Badler.
The
emote
In Proceedings of the 27th annual conference on Computer graphics and interactive techniques, pages 173182. ACM
0.8
0.6
0.4
0.2
0
Press/Addison-Wesley
Publishing
Co.,
2000.
Jump
Spread
ArmsToUpperBody
Sink
Free&Light
Rotation
F1 score
in
we
and
tasks.
Robotics and
and
shape
analysis
of
Laban
aective
In
Tsachor.
Laban/Bartenie
2013.
Nguyen,
Wei
Matthias Rauterberg.
Chen,
and
Online feedback
In IEEE
Symp. e-Learning, e-Management and eServices, 2012.
[14] Megumi Masuda and Shohei Kato. Motion rendering system for emotion ex-
RO-MAN,
2010, pages 324329. IEEE, 2010.
Laban movement analysis. In
Developmental Psychobiol-
[15] Hui Zou and Trevor Hastie. Regularization and variable selection via the elastic
net.
[8] Jean-Claude
Martin,
Niewiadomski,
Stephanie
Pelachaud.
Radoslaw
Laurence
Buisine,
67(2):301320, 2005.
[16] Woo
Devillers,
and
Hyun
Kim,
Catherine
Jeong
Woo
Park,
and
d camera.
International Journal
of Humanoid Robotics, 3(03):269291,
facial expressions.
2006.
The
Perception of congruent
In
ACM, 2014.
language".
Jean-Claude
Atkinson,
Jon-Kar Zubieta.
In
Haptic
Scott
Langenecker,
and
Emotion regulation
Brain
and cognition, 82(2):219227, 2013.
agery of emotional movements.
10
sets of movement characterists are associated with and enhance specic emotions. poster accepted for the international convention of psychological science
(ICPS), 2015.
[20] Jrg Rett and Jorge Dias. Human-robot
interface with anticipatory characteristics based on Laban movement analy-
Rehabilitation Robotics. ICORR, IEEE 10th International Conference on, pages 257268.
sis and bayesian models.
In
IEEE, 2007.
[21] Haris
Zacharatos,
Christos
Gatzoulis,
Emotion
recognition
for
ex-
11