You are on page 1of 24

BlueEyes

Blue eye technology

Human Operator Monitoring System

Prepared by: J.Harika(08221AO432)

BlueEyes
Human Operator Monitoring System

Agenda
Motivation What is BlueEyes (and what is not) ? How computers see and feel? Emotion mouse System design Current developments Future improvements Benefits Disadvantages Conclusion

Motivation What is BlueEyes ?

Computers see & feel?


Emotion mouse System design Current developments Future improvements Benefits & disadvantages Conclusion

BlueEyes
Human Operator Monitoring System

Motivation
Human error - a frequent reason of catastrophes and ecological disasters temporal indisposition weariness oversight Monitoring of conscious brain involvement Capable sensors available Lack of complex solution exploiting wireless link technology, database systems and AI algorithms

Motivation What is BlueEyes ?

Computers see & feel?


Emotion mouse System design Current developments Future improvements Benefits & disadvantages Conclusion

BlueEyes
Human Operator Monitoring System

What is BlueEyes ?
The BLUE EYES technology aims at creating computational machines that have perceptual and sensory ability like those of human beings. The basic idea behind this technology is to give the computer the human power. For example we can understand ones emotional state by analyzing his facial expression. If we add these perceptual abilities of human to computers, It would enable computers to work together with human beings as intimate partners.

Motivation What is BlueEyes ?

Computers see & feel?


Emotion mouse System design Current developments Future improvements Benefits & disadvantages Conclusion

What is BlueEyes not?


Doesnt predict nor interfere with operators thoughts Cannot force directly the operator to work

BlueEyes
Human Operator Monitoring System

HUMAN FACIAL EXPRESSIONS

Motivation What is BlueEyes ?

Computers see & feel?


Emotion mouse System design Current developments Future improvements Benefits & disadvantages Conclusion

BlueEyes
Human Operator Monitoring System

How can we make computers see and feel ?


Blue eyes uses sensing technology to identify a users actions and to extract key information. Information is then analyzed to determine the users physical, emotional, or informational state.

Motivation

What is
Blue eyes? Computers see & feel ? Emotion mouse System design Current developments Future improvements Benefits & disadvantages Conclusion

BlueEyes
Human Operator Monitoring System

EMOTION MOUSE

Motivation What is BlueEyes ? Computers see & feel? Emotion mouse System design Current developments Future improvements Benefits & disadvantages Conclusion

BlueEyes
Human Operator Monitoring System

WHAT DOES BLUE EYES DO ???


The complex solution for humanoperator monitoring:
Visual attention monitoring Physiological condition Operators position detection Wireless data acquisition using bluetooth Recorded data playback

Motivation What is BlueEyes ? Computers see & feel? Emotion mouse System design Current developments Future improvements Benefits & disadvantages

Conclusion

BlueEyes
Human Operator Monitoring System

The eye movement sensor


Eye position measuring - direct infrared oculography Oxy- and deoxyhemoglobin measurment Two axial accelerometer Ambient light sensor

Motivation What is BlueEyes ?

Physiological foundations
System design Current developments

Future improvements
Benefits & disadvantages Conclusion

Jazz Multisensor

BlueEyes
Human Operator Monitoring System

Wires, wires, wires...


A serious limitation of: mobility comfort safety

Motivation What is BlueEyes ?

Physiological foundations
System design Current developments

Future improvements
Benefits & disadvantages Conclusion

BlueEyes
Human Operator Monitoring System

Personal Area Network !


Solution: A wireless Personal Area Network

Motivation What is BlueEyes ?

Physiological foundations
System design Current developments

Future improvements
Benefits & disadvantages Conclusion

BlueEyes
Human Operator Monitoring System

Design objectives
A mobile data acquisition device

Motivation What is BlueEyes ?

Physiological foundations
System design Objectives System overview DAU CSU Current developments Future improvements Benefits & disadvantages Conclusion

A reliable real-time buffering, processing and recording A clear visualization interface Mechanisms for creating custom data analyzers To ensure a possibility of distributing the processing among a number of computers

BlueEyes
Human Operator Monitoring System

System overview
Data Acquisition Unit Central System Unit

Motivation What is BlueEyes ?

Physiological foundations
System design Objectives System overview DAU CSU Current developments Future improvements Benefits & disadvantages Conclusion

Atmel 89C52 microcontroller Jazz Multisensor

Bluetooth

Bluetooth

Connection Manager Data Analysis

Visualization Module Data Logger

Bluetooth technology provides means for creating a Personal Area Network linking the operators and the central system.

BlueEyes
Human Operator Monitoring System

DAU - features
Data Acquisition Unit

Motivation What is BlueEyes ?

Physiological foundations
System design Objectives System overview DAU CSU Current developments Future improvements Benefits & disadvantages Conclusion

Atmel 89C52 microcontroller Jazz Multisensor

Bluetooth

Lightweight Runs on batteries - low power consumption Easy to use - does not disturb the operator working ID cards for operator authorization Voice transmission using hardware PCM codec

BlueEyes
Human Operator Monitoring System

CSU - features
Connection management Data processing Visualization Data recording
Central System Unit

Motivation What is BlueEyes ?

Physiological foundations
System design Objectives System overview DAU CSU Current developments Future improvements Benefits & disadvantages Conclusion

Bluetooth

Connection Manager Data Analysis

Visualization Module Data Logger

Access verification System maintenance

BlueEyes
Human Operator Monitoring System

CSU - Visualization Module


Raw and processed data visualization using: VU-meters pie-charts time series

Motivation What is BlueEyes ?

Physiological foundations
System design Objectives System overview DAU CSU Current developments Future improvements Benefits & disadvantages Conclusion

audio and video data playback

BlueEyes
Human Operator Monitoring System

Data security
Only registered mobile devices can connect to the system Bluetooth connection authentication Bluetooth connection encryption Access rights restrictions Personal and physiological data encryption

Motivation What is BlueEyes ?

Physiological foundations
System design Objectives System overview DAU CSU Current developments Future improvements Benefits & disadvantages Conclusion

BlueEyes
Human Operator Monitoring System

Current Developments
BLUE EYE EMOTIONAL MOUSE
MAGIC pointing BLUE EYE enabled SUITOR Becomes active when the user makes an eye contact and automatically detect users area of interest and start searching it.

Motivation What is BlueEyes ?

Physiological foundations
System design Objectives System overview DAU CSU Current developments Future improvements Benefits & disadvantages Conclusion

BlueEyes
Human Operator Monitoring System

Future improvements
DAU small CMOS camera to monitor the operators point of gaze single PCB (SMD technlogy) low voltage ICs - LiIO batteries power CSU data mining algorithms advanced database encryption using e.g. AES algorithm

Motivation What is BlueEyes ?

Physiological foundations
System design Current developments

Future improvements
Benefits & disadvantages Conclusion

BlueEyes
Human Operator Monitoring System

BlueEyes - benefits
Prevention from dangerous incidents Minimization of ecological consequences financial loss a threat to a human life The reconstruction of the course of operators work

Motivation What is BlueEyes ?

Physiological foundations
System design Current developments

Future improvements
Benefits & disadvantages Conclusion

BlueEyes
Human Operator Monitoring System

BlueEyes - benefits
Blue Eyes system provides technical means for monitoring and recording Human-operators physiological condition. Data security Only registered mobile devices can connect to the system

Motivation What is BlueEyes ?

Physiological foundations
System design Current developments

Future improvements
Benefits & disadvantages Conclusion

BlueEyes
Human Operator Monitoring System

BlueEyes -disadvantages
Doesnt predict nor interfere with operators thoughts. Cannot force directly the operator to work.

Motivation What is BlueEyes ?

Physiological foundations
System design Current developments

Future improvements
Benefits & disadvantages Conclusion

BlueEyes
Human Operator Monitoring System

Conclusion
In the near future, ordinary household devices- such as television, refrigerators, ovens may be able to do their jobs when we look at them and speak to them.
Future applications of blue eye technology is limitless

Motivation What is BlueEyes ?

Physiological foundations
System design Current developments

Future improvements
Conclusion

BlueEyes
Human Operator Monitoring System

Motivation What is BlueEyes ?

Physiological foundations
System design Current developments

Thank you

Future improvements
Benefits & disadvantages Conclusion

BlueEyes
Human-Operator Monitoring System

You might also like