CONTROLLING REAL-TIME EYE MOUSE CURSOR MOVEMENT FOR HUMAN COMPUTER INTERFACES

(1)

Available Online at www.ijpret.com

775

INTERNATIONAL JOURNAL OF PURE AND

APPLIED RESEARCH IN ENGINEERING AND

TECHNOLOGY

A PATH FOR HORIZING YOUR INNOVATIVE WORK

CONTROLLING REAL-TIME EYE MOUSE CURSOR MOVEMENT FOR HUMAN

COMPUTER INTERFACES

MS. SONALI S. DOHE , PROF. TARUN S.YENGANTIWAR

1. Department of Computer Science and Engineering, Tulsiramji Gaikwad Patil College of

Engineering & Technology Nagpur University, Maharashtra, India

Accepted Date: 27/02/2014 ; Published Date: 01/05/2014

\

Abstract: In recent years wide interest has developed in real time eye pursuit for varied applications. During this paper, a personal human laptop interface system exploitation eye motion is introduced. Historically, human laptop interface uses mouse, keyboard as associate degree device. This paper presents hands free interface between laptop and human. This technology is meant to exchange the standard visual display unit informs devices for the utilization of disabled. The paper presents a unique plan to regulate mouse indicator movement with human eyes it controls mouse-moving by mechanically poignant the position wherever seeing focuses on, and simulates mouse-click by crucial the time intervals/period for depression there in position (i.e. 30ms) after that the click event happened. However, the planned vision-based virtual interface controls system work on varied eye movements like eye measure.

Keywords: Eye tracking, mouse movement, time Interval clicking event.

Corresponding Author: MS. SONALI S. DOHE

Access Online On:

www.ijpret.com

How to Cite This Article:

Sonali Dohe, IJPRET, 2014; Volume 2 (9): 775-784

(2)

776

INTRODUCTION

Recently there has been a growing interest in developing natural interaction between human and laptop. Many studies for humanist laptop interaction in universal computing square measure introduced. [1] Human gesture data has been multifariously utilized within the game, computer game and other applications. Such gesture data is classed into the static gesture and dynamic gesture. Static gesture uses spatial data solely and therefore the dynamic gesture uses spatial data and time data along. Since, the dynamic gesture presents varied expressions and it's thought of as a natural presenting technique. Such motion data may be no heritable by each exploitation device-based interface and vision-based interface. The device-based interface techniques gets motion data by motion capturing devices and marker. However, the vision-based interface technique extracts motion data {without associate degree/with none} high price equipments from an input video image. Thus, vision primarily based approach is taken into consideration a good technique to develop human laptop interface systems. For vision-based human laptop interaction, eye pursuit could be a hot stock. Eye pursuit analysis is distinguished by the emergency of interactive applications. However, to develop a vision-based multimodal human laptop interface system, an eye fixed pursuit and their recognition is finished. The planned vision-based virtual interface integrates the performance of the motion pursuit with winking. This paper any describe relate add section a pair of, varied face detection approaches in section three, varied eye pursuit techniques to spot or track eye is explained in section four, operating of the system is represented in section eight and planned add section seven.

1. RELATED WORK

“Design and implementation of human pc interface chase system supported multiple eye features”. For human eye (Iris) detection, batch mode is utilized. Iris chase technique is enforced on static pictures. this system merely works once the direction of iris such as it is center, left or right . If the position of iris is up or down, it doesn't work. The system not works in real time. It’s not skilled to handle blinks and shut eyes.[2] Identification achieves a coffee accuracy victimization ancient face recognition algorithms.

(3)

777 system that detects the iris position from still pictures provides Associate in nursing alternate input modality to facilitate pc users with severe disabilities. “MouseField” an easy and versatile device for omnipresent Computing”. [7] “MouseField” could be a individual personal {laptop/laptop pc/portable computer} or human computer interaction system that uses RFID reader and motion detector. Particularly the vision primarily based faces and hand motion chase and gesture recognition is a gorgeous input mode for higher human-computer interaction. Human gesture data has been diversely utilized within the game, computer game and alternative applications. Such gesture data is classed into the static gesture which uses special data solely and also the dynamic gesture that uses the special data and time data along. Since, the dynamic gesture will gift numerous expressions and it's thought-about as a natural presenting technique. Such motion data are often no inheritable by each victimization device-based interface and vision-device-based interface. The device-device-based interface technique gets motion data by motion capture devices and marker. However, the vision primarily based interface technique extracts motion data from input video image with none high value equipments. Thus, vision-based approach is taken into account a good technique to develop human pc interface systems. For vision-based human pc interaction, eye and hand chase is hot issue. Eye chase search is distinguished by the emergence of interactive applications.

Although numerous interaction technologies for handling data within the gift computing atmosphere are projected, some techniques square measure too simple for acting human pc interaction, et al need special costly equipments to be created everyplace, and can\'t quickly be accessed in our daily setting. In this, a brand new easy and versatile device referred to as the Mouse Field that allows users to regulate numerous data appliances simply while not great deal of expenses. [6] Mouse Field consists of Associate in Nursing identification recognizer Associate in Nursing motion sensors which will observe an object and its movement when the article is placed on that. The system will simply translate the user's actions as a command to regulate the flow of data. a strong and versatile device referred to as the Mouse Field which will be used at nearly anyplace for dominant data appliances. Mouse Field could be a device that mixes ID reader and motion sensing devices into one package.

2. FACE DETECTION

Face detection has continually been a massive analysis field within the pc vision world. Considering that it's the rear bone of any application that deals with the face. [8] The face detection methodology may be organized in 2 categories:

(4)

778 The first involves finding face expression (e.g. noses, eye brows, lips, eye pupils) and so as to verify their credibility performs by geometrical analysis of their locations, areas and distances from one another. This analysis can eventually cause localization of the face and therefore the options that it contains. The feature based mostly analysis is understood for its pixel-accuracy, options localization and speed, on the opposite hand its lack of strength.

3.2. Image-based method:

The second methodology is predicated on scanning the image of interest with a window that appears for faces the least bit scales and locations. This class of face detection implies pattern recognition, and achieves it with straightforward strategies like templet matching or with additional advanced techniques like neural networks and support vector machines. Before over viewing the face detection algorithmic program we tend to applied during this work here is an evidence of a number of the idioms that square measure associated with it.

4. EYEDETECTIONAPPROACHES Following square measure the assorted eye detection

approaches:

4.1. Regression approach

Tries to attenuate the space between the expected and actual eye positions. just by understanding the purposeful mapping from the input image to eye positions.

4.2. Bayesian approach

Learns the non-eye look and eye look for this model. A “probability of eye” make by using the Baye’s principle. Produces output for patches around every picture element of the input image, from that a prediction is going to be extracted.

4.3. Discriminative approach

Treats the problem as one of classification. A classifier classifier is trained to supply positive output for patches round the eye and negative elsewhere. From the on top of approaches, Bayesian approach is been taken into thought. [8]

5. EYE TRACKING TECHNIQUES

There is no universal technique to trace the movement of the eyes. In any study, the choice of the technique rests with the particular demands of the appliance. Throughout the analysis part of this analysis, 3 techniques were analyzed; the structure trailing, Pupil trailing, and Electrooculography.

(5)

779 Limbus trailing explains how of trailing the attention mistreatment the structure. The structure is that the boundary between the white albuginea of the attention and therefore the darker iris. Because the albuginea is white and therefore the iris is darker, this boundary will simply be visually detected further as half-track. This method is predicated on the position and form of the structure relative to the top, thus the top should be unbroken quite still or the equipment should be mounted to the user’s head. This method is negatively full of the lid usually concealing all or a part of the structure. This makes its uses restricted to horizontal trailing. Sometimes this method doesn't involve the employment of below red light-weight.

5.2Pupil tracking

Pupil trailing could be a technique of gaze detection that’s normally used usually in conjunction with completely different sorts of trailing. There square measure many reasons for this; but the most advantage is that the notion of the “bright spot” just like the scenario related to red eye once taking flash pictures in the dark, infrared will employed in pupil detection to create a high intensity bright spot that’s straightforward to search out with image process. This bright spot happens once infrared is mirrored off the rear of the pupil and increased by the lens. The most advantage of pupil trailing is that because the border of the pupil is slicker than the structure, the next resolution is doable. Also, because the pupil is rarely very coated by the lid, x-y trailing is additional possible as compared to structure trailing. The disadvantage is that the distinction in distinction is lower between the pupil and iris than between the iris and sclera-thus creating the border detection harder.

5.3Electrooculography

Electrooculography is predicated on electrodes hooked up to the human skin. Because of the upper rate at the membrane compared to the tissue layer, the attention maintains a continuing voltage with relevance the membrane. This will be just about optical axis which is used with aligned. The direction of gaze is responsible for rotates the voltage and may be measured by surface electrodes placed on the skin round the eyes. This method is well mounted elsewhere aside from directly ahead of the person as compared to different techniques. Electrical skin potential pursuit is commonly utilized in medication and follow to diagnose bound conditions. For instance, EOG is utilized to diagnose sixth nerve palsy. From their analysis it is seen that whereas a clinical orthotic examination continues to be the simplest technique of identification. Electrooculography provides an appropriate replacement among the follow-up stage of treatment programs. Whereas these uses area unit helpful, the use of electrodes makes this method of gaze pursuit unsuitable to be used in everyday applications.

(6)

780 A saccade could be a fast/rapid movement of a watch. Particularly because it jumps from one fixation purpose to a different (as in reading).When one thing attracts our attention, we have a tendency to position our gaze thereon, so activity a fixation. A fixation typically has period of a minimum of one hundred to one hundred fifty milliseconds (ms).The quick eye movements that occur between fixations area unit called SACCADES.

6. INPUT FROM THE EYE

Now input medium turns to eye movements as a true time. Eye movement input is clearly quicker than different current input. Before the user operates any mechanical inform device, he or she typically appearance at the destination to that he or she needs to maneuver. so the attention movement is out there as a sign of the user’s goal before he or she may actuate the other device. The eye is, of course, far more than a high-speed pointer positioning tool. Attributable to the higher and lower palpebra, etc., it's tough to seek out the whole circular form of the pupil.

6.1Mouse pointer control

In order to use the pupil to regulate the mouse pointer (cursor) on the screen of monitor, the monitor’s central coordinate of the screen is about as a begin purpose. This position is employed because the base for gaze tracing, and also the initial position of the mouse pointer is about because the center of the screen. The moving position of the pointer takes the initial position because the base. because the pupil move to some direction, the coordinate of the mouse pointer on screen amendment per the movement of the pupil. Once the pupils come back to the first position, the pointer stops moving. The horizontal movement of the pupil is totally grasped by the movement of the circular objects. The vertical movement of the circular object is additional refined than the horizontal movement, therefore the size of the pupil is employed for management. Once individuals look upwards, the eyes are becoming larger. Once wanting downwardly, the eyes area unit in slightly half-closed state. This development is used for dominant the mouse pointer to maneuver from high to bottom.

6.2Mouse click events control

(7)

781 errors of the human blinks occur, each eyes area unit closed along. At this point, we have a tendency to don't perform any actions. The action is merely meted out with the closure of one eye.

7. PROPOSED PLAN OF WORK

A complete procedure is conferred that moves the mouse from one place to a different on desktop through user's eyes movement. Before the process for the movement of mouse begins, elaborate process is conferred below:

1. Camera receives the input from the attention.

2. When receiving these streaming videos from the cameras, it'll forced an entry frames.

3. when receiving frames, can/it’ll} check for lighting conditions as a result of cameras need decent lights from external sources otherwise error message will show on the screen.

4. The captured frames that area unit already in RGB mode area unit regenerate into Black 'n' White.

5. Pictures (frames) from the input supply focusing the attention area unit analyzed for Iris detection (center of eye).

6. After this, a middle purpose is calculated by taking the mean of left and right eye centre purpose.

7. Finally the mouse can move from one position to a different on the screen and user can perform clicking by blinking their eyes for five seconds.

(8)

782

IMAGE VIDEVIDEOOCAPTURING

FA

VIDEO IMAGE CAPTURING

FACE DETECTION

EYES DETECTION

GAZE

DETERMINATION EYE TRACKING

TIME INTERVAL/PERIOD

MOUSE SCROLLING

CURSOR MOVEMENT

CLICK EVENT

Figure 1: Implementation of the system

The user should sits ahead of the screen of private pc or portable computer, a specialized video camera mounted higher than the screen to watch the user’s eyes. The pc frequently analyzes the video image of the attention and determines wherever the user is reckoning on the screen. Nothing is hooked up to the user’s head or body. To “select” any key, the user appearance at the key for a nominative amount of your time and to “press” any key, the user simply sees for some time period for clicking. During this system, standardization procedure isn’t needed. For this technique input is merely eye. No external hardware is hooked up or needed. Figure 1. shows the implementation of the system.

9. CONCLUSION

This paper centered on the analysis of the event of hands-free laptop management - dominant mouse pointer movement’s mistreatment human eyes. Thus, the great study of the gaze-based interaction processes is enforced. The mouse pointer is operated mistreatment eye. the foremost distinctive facet of this technique is that it doesn't need any wearable attachments. This makes the interaction additional economical and gratifying. A programme is that the system by that human act with a pc. The programme includes hardware and computer code parts. No external hardware is hooked up or needed.

(9)

783 This is a M-Tech project and work is under development, under the guidance of Mr. T. S. Yengantiwar. Expected outcome of this proposed technique used to controlling real-time eye mouse cursor movement by detecting face and eyes for mouse scrolling and click event.

11.REFERENCES

1. Sidra Naveed, Bushra Sikander, andMalik Sikander Hayat Khiyal “Eye Tracking System with

Blink Detection”, IEEE,2012.

2. Craig Hennessey, Jacob Fiset, “Long Range Eye Tracking:Bringing Eye Tracking into the Living

Room”, IEEE ,2012.

3. Bacivarov, Ionita M., Corcoran,P. , “Statistical models of appearance for eye tracking and

eye-blink detection and measurement”, IEEE Transactions, August 2010.

4. Ioana Bacivarov, Mircea Ionita, Peter Corcoran, “Statistical models of appearance for eye

tracking and eye blink detection and measurement”, IEEE transactions on consumer electronics,

Vol.54 , No.3, pp. 1312‐1320 August 2009.

5. Mohan M. Trivedi, “Simultaneous eye tracking and blink detection with interactive particle

filters” ,ACM , January 2010.

6. Grauman, K.; Betke, M.; Gips, J.; Bradski, G.R. , “Communication via eye blinks‐ Detection and

duration analysis in real-time”, IEEE CONFERENCE PUBLICATIONS, 2009.

7. Toshiyuki Masui, Koji Tsukada, and Itiro Siio, “MouseField: A Simple and Versatile Input

Device for Ubiquitous Computing”, Vol. 3205, Springer (2011), p. 319-328.

8. Akhil Gupta, Akash Rathi, Dr. Y. Radhika, “HANDS- FREE PC CONTROL” CONTROLLING OF

MOUSE CURSOR USING EYE MOVEMENT, International Journal of Scientific and Research Publications, Volume 2, Issue 4, April 2012.

9. Jixu Chen, Yan Tong ,Wayne Grayy ,Qiang Jiz“A Robust 3D Eye Gaze Tracking System”,IEEE

,2011 Representation Framework“, Sixth International Conference on Image and Graphics,2011.

10.Brendan F. Klare, Zhifeng Li, Anil K. Jain,”Matching Forensic Sketches to Mug Shot Photos”,

IEEE transactions on pattern analysis and machine intelligence, vol. 33, 3, march 2011.

11.Arantxa Villanueva, Rafael Cabeza,Sonia Porta “Eye Tracking System Model With Easy

Calibration”,IEEE ,2011.

12. Arie E. Kaufman, Amit Bandopadhay, and Bernard D. Shaviv “An Eye Tracking Computer

(10)

784

13.Takehiko Ohno, Naoki Mukawa, Shinjiro Kawato “Just Blink Your Eyes: A Head-Free Gaze

Tracking System”, IEEE, 2011.

14.Shazia Azam, Aihab Khan, M.S.H. Khiyal, “design and implementation of human computer

interface tracking system based on multiple eye features” JATIT‐journal of theoretical and

applied information technology, Vol.9, No.2 Nov, 2009.

15.Margrit Betke, James Gips, Peter Fleming ,“The Camera Mouse: Visual Tracking of Body

features to Provide Computer Access for People With Severe Disabilities”, IEEE Transactions On Neural Systems And Rehabilitation Engineering, Vol.10, No.1, March 2008.

16.H.T. Nguyen, “Occlusion robust adaptive template tracking.”, Computer Vision, 2001.ICCV

2001 Proceedings International Journal of Scientific and Research Publications, Volume 2, Issue 4, April 2012.

17.M. Betke, “the camera mouse: Visual Tracking of Body Features to provide Computer Access