SSRG International Journal of Electrical and Electronics Engineering (SSRG-IJEEE) – volume 2 Issue 8 August 2015
Overview of Blue Eyes Technology Deeksha Rajvanshi B.Tech student, Department of Electrical Engineering, G.B Pant University of Agriculture and Technology Pantnagar, Uttarakhand, India Abstract -When hands won't work, a new technology tracks eye movements for computer applications. Imagine, a beautiful world, where humans collaborate with computers .The computer can talk, listen or screech aloud. Without a doubt, computers would be much more powerful if they had even a small fraction of the perceptual ability of animals or humans. The “BLUE EYES” technology aims at creating computational machines that have perceptual and sensory ability like those of human beings. It uses nonobtrusive sensing method, employing most modern video cameras and microphones to identify the users’ actions through the use of imparted sensory abilities. Keywords — Blue-eyes, DAU, Affective Computing, SUITOR, MDS, Magic-pointing. I. INTRODUCTION The basic idea behind this technology is to give the computer the human power, an eye for technology. We all have some perceptual abilities and bear empathy. That is we can understand each other‟s feelings. For example we can understand ones emotional state by analysing his facial expressions. If we add these perceptual abilities of human race to computers, computers would be enabled to work together with human beings as intimate partners. Human cognition depends primarily on the ability to perceive, interpret, and integrate audio-visuals and sensoring information. Researchers are attempting to add such capabilities to computers that will allow them to interact like humans, recognize human presence, talk, listen, or even guess their feelings. The scope of the technology is to have the computer adapt to the user in order to create a better working environment where the user is more productive. This paper is about the hardware, software, benefits and interconnection of various parts involved in the “blue eyes” technology. II. COINAGE OF THE TERM BLUE-EYES BLUE in the term stands for bluetooth which enables reliable wireless communication .EYES because the eye movement enables us to obtain a lot of interesting and important information. III. NEED FOR BLUE EYES TECHNOLOGY For a computer to sense the eye movement, wiring between the system and the operator is required. But this is a serious limitation of the operator's mobility and disables his operation in large control rooms .So utilisation of wireless technology becomes essential
ISSN: 2348 – 8379
which can be implemented through bluetooth technology. The wireless link between the sensors worn by the operator and the supervising system offers new way to system overall reliability and safety. It has the ability to gather information about you and interact with you through special techniques like facial recognition, speech recognition etc. It can even understand your emotions at the click of the mouse. It can verify your identity, feel your presence and start interacting with you. The machine can understand what a user needs, where he is looking at and even realise his physical or emotional states. It realises the urgency of the situation through the mouse. For instance, if you ask the computers to dial to your friend at his office, it understands the situation and establishes a connection without any delay. IV. KEY FEATURES OF THE BLUE-EYES It is the complex solution for human operator monitoring:conscious brain involvement monitoring real time user defined alarm triggering data recording use of BIOMETRICS operators position detection wireless data acquisition using bluetooth technology IBM says-“Blue Eyes uses sensing technologies , such as video cameras and microphones, to identify and observe a user‟s actions, and to extract key information, such as where the user is looking and what the user is saying verbally and gesturely. These cues are analysed to determine the user‟s physical, emotional, or informational state.”
V. METHODS OF ACCOMPLISHING AFFECTIVE COMPUTING The process of making a computer having sensing and emotional capabilities is known as “Affective Computing”. It involves the following steps:A. Process of giving sensing capacity Blue Eyes utilizes many sensor mechanisms, which is equivalent for the ears, eyes and other sensory organs that human beings used to express emotions and recognize each other. Blue Eyes uses voice recognition software, cameras and biometric sensors to understand and respond to the emotional levels of humans. The voice recognition software can perceive not only what is being spoken but also the tone how it
www.internationaljournalssrg.org
Page 50
SSRG International Journal of Electrical and Electronics Engineering (SSRG-IJEEE) – volume 2 Issue 8 August 2015
is said. High resolution cameras are used for tracking the minute facial expressions, hand gestures and eye movements. Biometric sensors are used for measuring and analysing the muscle tension, body temperature, blood pressure and other physiological gesture correlated with emotions. B. Detecting human emotions/ Affect Detection In Blue Eyes technology, the machines have the ability to identify the minor variations in the moods of human beings. Say a person may strike the keyboard hastily or softly depends on his mood like happy or in angry. The Blue Eyes enables the machines to identify these minor emotional variations of human beings even by a single touch on the mouse or key board and the machines started to react with the users according to this emotional levels. This is done with the guidance of intelligent devices like “Emotion Mouse”. Along with this Emotion Mouse, Simple User Interest Tracker (SUITOR) and Artificial Intelligent Speech recognition are equipped with the Blue Eyes technology to understand the speech and identify the interest of the peoples at that instance of time. VI. PARTS OF THE BLUE EYE TECHNOLOGY Blue eyes system monitors the status of the operator‟s visual attention through measurement of saccadic activity. The system checks parameters like heart beat rate and blood oxygenation against abnormal and triggers user defined alarms. Blue Eyes system consists of a mobile measuring device and a central analytical system. The mobile device is integrated with Bluetooth module providing wireless interface between sensors worn by the operator and the central unit. ID cards assigned to each of the operators and adequate user profiles on the central unit side provide necessary data personalization.
1)
2)
The Simple User Interest Tracker (SUITOR): The Simple User Interest Tracker is revolutionary approaches towards the design of machine having the ability to maintain an intimate relationship between the humans and the computers. The SUTOR continuously analyses the user that where his eye focus on the personal computer screen. The SUITOR has the ability to determining the topic of interest of the user and also according to this it can able to deliver the appropriate data to a handheld device. It fills a scrolling ticker on a computer screen with information related to user's task.
3)
Vision System: The system uses IBM Blue Eyes infrared lighting cameras. These cameras are used as sensors for our eye tracking algorithm and the tracked eyes are used in conjunction to estimate the user's head pose and eye gaze direction. Each eye tracker utilizes a simple dynamics model of eye movements along with Kalman filters and appearance models to track the eyes robustly in real-time and under widely varying lighting conditions. The tracked head pose is used to estimate a user's eye gaze to measure whether a user is looking at a previously defined region of interest that the prototype applications use to further interact with the user. In multicamera IR based eye tracking several pre-calibrated cameras to estimate a user's head pose are used. For each camera, we use the tracked eye locations to estimate mouth corners.
4)
MAGIC Pointing: In this approach, eye gaze pointing appears to the user as a manual job, utilized for fine selection and manipulation processes. Even so, a large amount of the
A. Hardware System consists of:Data Acquisition Unit (DAU) Central System Unit (CSU)
Fig. 1 System overview: DAU-CSU features
ISSN: 2348 – 8379
B. EMOTIONAL SENSORS For Hand - Emotion Mouse: Actually this Emotion Mouse is an input device to track the emotions of a user by a simple touch on it. The Emotion Mouse is designed to evaluate and identify the user‟s emotions such as fear, surprise, anger, sadness, happiness, disgust etc. when he/she is interacting with computer. The main objective of the Emotion Mouse is to gather the user‟s physical and physiological information by a simple touch. Heart rate is taken by IR on the thumb, temperature is taken using a thermistor chip, GSA( General Somatic Activity) is taken through the mouse device driver, and GSR (Galvanic Skin Response) is taken through fingertips. These values are input into a series of discriminate function analyses and correlated to an emotional state
www.internationaljournalssrg.org
Page 51
SSRG International Journal of Electrical and Electronics Engineering (SSRG-IJEEE) – volume 2 Issue 8 August 2015
cursor movement is removed by bending the cursor to the eye gaze portion, which surrounds the target. The selection and pointing of the curser is primarily controlled by manual means but also guided by a gaze tracking mechanism and is commonly known as MAGIC Pointing. The main aim of MAGIC pointing is to use „gaze‟ to warp the previous position (home) of the curser to the locality of the target, reasonably where the user was looking at, so as to reduce the cursor motion amplitude required for target selection. When the cursor position is identified, only a small movement is needed by the user to click on the target by a manual input device that is to accomplish Manual Acquisition with Gaze Initiated Cursor or Manual and Gaze Input Cascaded (MAGIC) pointing.
B. PONG A robot releases by IBM designed for demonstrating the new technology. It is equipped with a computer capable of analysing a person's glances and other forms of expressions of feelings. It smiles when a person calls his name but expresses loneliness when it loses sight of the person.
C. SECURE PAD An electronic badge that can identify the wearer and track his movements and activities with an array of sensors. The device was designed for a major health care provider to track the activities of doctors and other personnel at large medical institutes. Blue Eyes is developing ways for computers to anticipate user's wants by gathering video data on eye movement and facial expressions. Your gaze might rest on a website heading, for example, and that would prompt your computer to find similar links.
Fig. 1 The magic pointing technique
VII.
BLUE-EYES ENABLED DEVICES / APPLICATIONS A. POD The first blue Eye enabled mass production device. It was a unique car manufactured by TOYOTA in collaboration with SONY. The Pod was much like a living being due to the artificial intelligence programmed into it. The car could also judge the attitude and mood of the driver based on their reactions and how they are driving, and could offer advice on how to improve their current mood. The seats inside are like stools which could freely spin and rotate. On the exterior, the Pod could express its own feelings with coloured LEDs - red for anger, yellow for happy, blue for sad - and an antenna that wags.
ISSN: 2348 – 8379
VIII. PRESENT STATUS The present state of the Blue Eye can be witnessed if we take a glance at new advanced cell phones or ATM Machines which has the touch screen. Blue Eye Technology is still at work in progress but its different parts are already being implemented in realtime application such as in security system. Many security systems uses retina scan for authentication purpose or even a voice cipher can be used as a password which is unique. This technique is currently being used in the field of biomechanics, outdoor sports and motion picture for making visual effects and animation. Along with these following are the states working under Blue Eye: visual attention monitoring physiological condition monitoring(pulse rate, blood oxygen) operator's position detection(standing, lying, sitting) IX. CONCLUSION The nineties witnessed quantum leaps interface designing for improved man machine interactions. The BLUE EYES technology ensures a convenient way of simplifying the life by providing more delicate and user friendly facilities in computing devices. Instead of using cumbersome modules to gather information about the user, it will be better to use smaller and less intrusive units. Ordinary household devices -- such as televisions, refrigerators, and ovens --may be able to do their jobs when we look at them and speak to them. It is only a technological forecast.
www.internationaljournalssrg.org
Page 52
SSRG International Journal of Electrical and Electronics Engineering (SSRG-IJEEE) – volume 2 Issue 8 August 2015
REFERENCES [1]
[2]
[3]
[4]
Perceptual User Interfaces using Vision based Eye Tracking Ravikrishna Ruddarrajuy Antonio Haroz, Kris Nagelz, Quan T. Tranz Irfan A. Essayz, Gregory Abowdz, Elizabeth D. Mynattz. M. Harville, A. Rahimi, T. Darrell, G. Gordon, and J. Wood_ll. 3-d pose tracking with linear depth and brightness constraints. In International Conference on Computer Vision, 1999. B. Jabrain, J. Wu, R. Vertegaal, and L. Grigorov. Establishing remote conversations through eye contact with physical awareness proxies. In Extended Abstracts of ACM CHI, 2003. Y. Matsumoto, T. Ogasawara, and A. Zelinsky. Behavior recognition based on head pose and gaze direction
ISSN: 2348 – 8379
[5]
[6]
[7] [8] [9] [10] [11] [12]
measurement. In IEEE International Conference on Intelligent Robots and Systems, 2000 C.H. Morimoto, D. Koons, A. Amir, and M. Flickner. Pupil detection and tracking using multiple light sources. Technical report RJ-10117, IBM Almaden Research Center, 1998. E. Mynatt, J. Rowan, and A Jacobs. Digital family portraits: Providing peace of mind for extended family members. In ACM CHI, 2001. www.wherisdoc.com www.fixya.com [ www.penniblack56.gratisphphost.info/blue-eyes www.scribd.com/doc/13763040/Blue-Eyes-Technology www.cs.put.poznan.pl/achieve/load/CSIDC01Poznan.ppt www.slideshare.net/jainshef/blue-eye-technology
www.internationaljournalssrg.org
Page 53
