Blue eye technology

(Human-Operator Monitoring
System)

By
Amit Jangirh
VIII Sem, ECE
what is blue eyes ?

• aims on creating computational machines

that have perceptual and sensory ability
like those of human beings.

• interactive computer.

• computer acts as partner (and friend) to the

user.

• realize his physical or emotional states.

How can we make computers
“see” and “feel” ?
 Blue eyes uses sensing technology to
identify a user’s actions and to extract key
information eg
camera ,microphone.
 Information is then analyzed to determine
the user’s physical ,emotional ,or
informational state.
 What is BlueEyes ?

The complex solution for human-

operator monitoring:
◦ Visual attention monitoring
◦ Physiological condition
◦ Operator’s position detection
◦ Wireless data acquisition using Bluetooth
◦ Real time user defined alarm triggering
◦ Recorded data playback
What is BlueEyes not?
Doesn’t predict nor interfere with
operator’s thoughts
Cannot force directly the operator to
work
Why the name ?
bluetooth

eyemovement
contents
• emotion computing
• face detection
• eye tracker
• speech recognition
emotion computing
BLUE EYE – EMOTIONAL MOUSE
sensors in the mouse ,sense the physiological
attributes which are correlated to emotions using
correlation model by simply touching the mouse ,the
computer will be able to determine a person’s
emotional state.
emotion mouse
• pressure
• galvanic skin response
• skin temperature

• heart beat
geometric facial data extraction
basic emotion-specified facial expression

1 2 3 4 5 6
1. disgust
2. fear
3. joy
4. surprise
5. sadness
6. anger
working

Emotio
n
mouse

GSR anger

fear
pulse

sadness
body he
at

disgust
heart be
at

happines
s
 eye
tracker
a device which track the movement of eye
The eye movement sensor
Off-shelf eye movement sensor – Jazz
multisensor
Supplies raw digital data regarding
- Eye position
- Level of blood oxygenation
- Acceleration along horizontal and
vertical axes
- Ambient light intensity
IBM Almaden eye tracker
on axis IR

reflected beam

eye ball
off axis IR

d beam eye ball

reflecte
dual light source gaze tracking
 magic pointing
manual and gaze input cascaded pointing
advantages
• reduce fatigue
• practical accuracy
• speed
 speech recognition

filter 1

ADC
filter 2

filter 3

template
filter n s
System overview

Data Acquisition Unit Central System Unit

Atmel 89C52 Connection Visualization

Bluetooth Bluetooth Manager Module
microcontroller

Jazz Data
Data Analysis
Multisensor Logger

Bluetooth technology provides

means for creating a Personal
Area Network linking the
operators and the central
system.
DAU
The DAU consists of the following components
 ATMEL 8952 microcontroller
 BLUE TOOTH MODULE – supports synchronous voice
data transmission
 PCM CODEC –used to transmit operator’s voice and
central system sound feedback
 UART –communication between bluetooth module and
microcontroller (115200 bps)
 MAX232 –level shifter
 ALPHAUNUMERIC LCD display
 LED indicators
 ID CARD interface
 DAU - features
is
Data Acquisition Unit Lightweight
Runs on batteries -
Atmel 89C52
microcontroller
Bluetooth low power
Jazz
consumption
Multisensor Easy to use - does not
disturb the operator
working
ID cards for operator
authorization
Voice transmission
using hardware PCM
 DAU - components

microphone MC 145483
earphone PCM codec

Jazz Multisensor Bluetooth

module
Beeper Atmel 89C52

UART
microcontroller
LCD display
UART MAX232
LED indicators
BlueEyes
Data Acquisition Unit
ID card Simple
interface keyboard
ID card
 CSU -
features
 Connection Central System Unit
management
Connection Visualization
 Data processing Bluetooth Manager Module

 Visualization Data Analysis

Data
Logger
 Data recording
 Access verification
 System maintenance
CSU – components
 CONNECTION MANAGER – main task to
perform low-level blue tooth communication
 DATA ANALYSIS MODULE – performs the
analysis of the raw sensor data in order to
obtain information about operator’s
physiological condition
 DATA LOGGER MODULE – provides support
for storing the monitored data.
 VISULAIZATION MODULE – provides user
interface for the supervisors
Data security
Only registered mobile devices
can connect to the system
Bluetooth connection authentication
Bluetooth connection encryption
Access rights restrictions
Personal and physiological data
encryption
Conclusion
 In the near future ,ordinary household
devices- such as television , refrigerators
,ovens may be able to do their jobs when we
look at them and speak to them.
 Future applications of blue eye technology is
limitless
 ensures a convenient way of simplifying the
life by providing more delicate and user
friendly facilities in computing devices.
 reduce difference between human and
computer