BlueEyes

Human Operator Monitoring System

Motivation What is BlueEyes ? Physiological foundations System design System implementation

BlueEyes
Human-Operator Monitoring System

Navneet
110119 EC-2
1

BlueEyes
Human Operator Monitoring System

Agenda
Motivation What is BlueEyes (and what is not) ? Physiological foundations System design System implementation

Motivation What is BlueEyes ? Physiological foundations System design System implementation

BlueEyes
Human Operator Monitoring System

Motivation
Human error - a frequent reason of catastrophes and ecological disasters

Motivation What is BlueEyes ? Physiological foundations System design System implementation

temporal indisposition weariness oversight Monitoring of conscious brain involvement Capable sensors available

BlueEyes
Human Operator Monitoring System

What is BlueEyes ?
The complex solution for human-operator monitoring is: conscious brain involvement monitoring triggering user-defined actions data recording Doesnt predict nor interfere with operators thoughts Cannot force directly the operator to work

Motivation What is BlueEyes ? Physiological foundations System design System implementation

BlueEyes
Human Operator Monitoring System

Who is BlueEyes for ?

Generic control rooms Power station Captain bridge Flight control centers Operating theatres anesthesiologists Common application A simpler system version for drivers

Motivation What is BlueEyes ? Physiological foundations System design System implementation

BlueEyes
Human Operator Monitoring System

Eye movements
Two states of Brain: Conscious State Preconscious State During Conscious state eye movements are regular and saccades are detected Saccade - a rapid eye jump to a new location assigned by the conscious attention process.
6

Motivation What is BlueEyes ?

Physiological foundations
System design System implementation

BlueEyes
Human Operator Monitoring System

Design objectives
A mobile data acquisition device A reliable real-time buffering, processing and recording A clear visualization interface Mechanisms for creating custom data analyzers To ensure a possibility of distributing the processing among a number of computers

Motivation What is BlueEyes ?

Physiological foundations
System design Objectives System overview DAU CSU System implementation

BlueEyes
Human Operator Monitoring System

System overview
Data Acquisition Unit Central System Unit

Motivation What is BlueEyes ?

Physiological foundations
System design Objectives System overview DAU CSU System implementation

Atmel 89C52 microcontroller Jazz Multisensor

Bluetooth

Bluetooth

Connection Manager Data Analysis

Visualization Module Data Logger

Bluetooth technology provides means for creating a Personal Area Network linking the operators and the central system.
8

BlueEyes
Human Operator Monitoring System

DAU - components

Motivation What is BlueEyes ?

Physiological foundations
System design Objectives System overview DAU CSU System implementation

Microphone

MC 145483 PCM codec

Jazz Multisensor Beeper LCD display LED indicators

Bluetooth module

Atmel 89C52 microcontroller

UART

MAX232

BlueEyes
Data Acquisition Unit

ID card interface
ID card

Simple keyboard

UART

BlueEyes
Human Operator Monitoring System

DAU - features
Data Acquisition Unit

Motivation What is BlueEyes ?

Physiological foundations
System design Objectives System overview DAU CSU System implementation

Atmel 89C52 microcontroller Jazz Multisensor

Bluetooth

Lightweight Runs on batteries - low power consumption Easy to use - does not disturb the operator working ID cards for operator authorization Voice transmission using hardware PCM codec
10

BlueEyes
Human Operator Monitoring System

CSU - features
Connection management Data processing Visualization Data recording
Central System Unit

Motivation What is BlueEyes ?

Physiological foundations
System design Objectives System overview DAU CSU System implementation

Bluetooth

Connection Manager Data Analysis

Visualization Module Data Logger

Access verification System maintenance

11

BlueEyes
Human Operator Monitoring System

Implementation - DAU
Made from scratch by the team Bluetooth module inside Jazz sensor interface Microphone and earphone sockets 5-key keyboard Two lines, 8 characters LCD Powered from 6 AA batteries
12

Motivation What is BlueEyes ?

Physiological foundations
System design System
implementation

BlueEyes
Human Operator Monitoring System

Implementation - DAU

Motivation What is BlueEyes ?

Physiological foundations
System design System
implementation

PCM codec board Microcontroller board

Batteries and Bluetooth module voltage level monitor

13

BlueEyes
Human Operator Monitoring System

Data security
Only registered mobile devices can connect to the system Bluetooth connection authentication Access rights restrictions Personal and physiological data encryption

14

BlueEyes
Human Operator Monitoring System

BlueEyes - benefits
Prevention from dangerous incidents Minimization of ecological consequences financial loss a threat to a human life The reconstruction of the course of operators work

Motivation What is BlueEyes ? Physiological foundations System design System implementation

15

BlueEyes
Human Operator Monitoring System

References
http://www.articlesbase.com/networksarticles/blue-eyes-monitoring-humanoperator-system-420263.html http://www.scribd.com/Seminar-Reporton-Blue-Eyes/d/17765807 www.seminars4u/electronics/blueeyes.html www.youngscientist.com/seminars/electro nics/blueeyesreport.doc www.exibbi.com/showthreads/blueeyes.ht m

Motivation What is BlueEyes ? Physiological foundations System design System implementation

16

BlueEyes
Human Operator Monitoring System

BlueEyes
Human Operator Monitoring System