Chapter 9: Conclusions and Future Directions
9.2 Future Work
Based on the theoretical and experimental work carried out during this research, it is recommended that further research should be done to improve the efficiency of NAAB to address the following points:
The system should be produced as a complete package in one mobile device such as a smartphone, watch or helmet, not the multiple parts used in this thesis as shown in figure 1.1.
In a crowd, only the author’s voice matters to NAAB but the voice recognition needs significant training. Therefore, simplify the voice recognition task to the user will be taken into account in future. Alternative user input methods should also be explored (such as haptic or touch based).
The Hough circle-detection algorithm (Xu et al. 1990) has been used to detect QR-code easily from further distances. The circle would look like an ellipse at a narrow angle, so modifying the circle-detection algorithm to enable it to detect ellipses would represent a significant improvement to the system.
Avoidance of obstacles should be generalised to avoid objects other than humans, as NAAB currently provides.
It would be a significant idea to integrate a magnetometer to overcome the directional issues particularly when there is no QR code within scanning range. Because of the walking speed varies greatly from person to person, the system
119
Bibliography
A. M. Ali and M. J. Nordin 2010, ‘SIFT based monocular SLAM with multi-clouds features for indoor navigation’, in TENCON IEEE Region 10 Conference, pp. 2326– 2331, IEEE.
A. Al-Shaery, A. Zhang, S and C. Rizos 2013, ‘An enhanced calibration method of GLONASS inter-channel bias for GNSS RTK’, GPS Solutions, 17(2):165–173.
T. Amemiya and H. Sugiyamaand 2010, ‘Orienting kinesthetically: a haptic handheld wayfinder for people with visual impairments’, ACM Transactions on Accessible
Computing, 3(2):6.
K. Arning, M. Ziefle, M. Li and L. Kobbeltand 2010, ‘Insights into user experiences and acceptance of mobile in-door navigation devices’, in Proceedings of the 11th
International Conference on Mobile and Ubiquitous Multimedia, p. 41, ACM.
M. Asad and W. Ikram 2012, ‘Smartphone based guidance system for visually impaired person’, in 3rd International Conference on Image Processing Theory, Tools and
Applications, pp. 442–447, IEEE.
M. Asonuma and C. Wada 2006, ‘Presenting the sense of distance by air stimulation to develop an assistive device for the visually impaired’, in SICE–ICASE, International
Joint Conference, pp. 4156–4159, IEEE.
A. W. S. Au, C. Feng, S. Valaee, S. Reyes, S. Sorour, S. N. Markowitz, D. Gold, K. Gordon and M. Eizenman 2013, ‘Indoor tracking and navigation using received signal strength and compressive sensing on a mobile device’, IEEE Transactions on Mobile
Computing, 12(10):2050–2062.
G. Balakrishnan, G. Sainarayanan, R. Nagarajan and S. Yaacob 2005, ‘Stereo image to stereo sound methods for vision based ETA’, in 1st International Conference on
120
Computers, Communications, & Signal Processing with Special Track on Biomedical Engineering, pp. 193–196, IEEE.
H. Bay, A. Ess, T. Tuytelaars and L. Van Gool 2008, ‘Speeded-up robust features (SURF)’, Computer Vision and Image Understanding, 110(3):346–359.
S. S. Bhatlawande, J. Mukhopadhyay and M. Mahadevappa 2012, ‘Ultrasonic spectacles and waist-belt for visually impaired and blind person’, in National
Conference on Communications, pp. 1–4, IEEE.
J. Borenstein and I. Ulrich 1997, ‘The guidecane—a computerized travel aid for the active guidance of blind pedestrians’, in IEEE Proceedings International Conference on
Robotics and Automation, volume 2, pp. 1283–1288, IEEE.
Calder, David, ‘Ecological solutions for the blind 2010’, in IEEE International
Conference on Digital Ecosystems and Technologies, pp. 625–630, IEEE.
D. J. Calder, ‘Travel aids for the blind—the digital ecosystem solution 2009’, in 7th
IEEE International Conference on Industrial Informatics, pp. 149–154, IEEE.
Y.-J. Chang and T.-Y. Wang 2010, ‘Comparing picture and video prompting in autonomous indoor wayfinding for individuals with cognitive impairments’, Personal
and Ubiquitous Computing, 14(8):737–747.
M. H. Choudhury, D. Aguerrevere and A. B. Barreto 2004. ‘A pocket-PC based navigational aid for blind individuals’, in IEEE Symposium on Virtual Environments,
Human–Computer Interfaces and Measurement Systems, pp. 43–48, IEEE.
S. Chumkamon, P. Tuvaphanthaphiphat and P. Keeratiwintakorn 2008, ‘A blind navigation system using RFID for indoor environments’, in 5th International
Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology, volume 2, pp. 765–768, IEEE.
121
based on Bluetooth’, in 21st International Conference on Electrical Communications
and Computers, pp. 271–277, IEEE.
M. da Silva Cascalheira, P. Pinho, D. Teixeira and N. de Carvalho 2012, ‘Indoor guidance system for the blind and the visually impaired’, Microwaves, Antennas &
Propagation, IET, 6(10):1149–1157.
A. Denso 2011, QR code essentials, viewed 10 April 2014, http://www.nacs.org/LinkClick.aspx.
E. Di Giampaolo 2010, ‘A passive-RFID based indoor navigation system for visually impaired people’, in 3rd International Symposium on Applied Sciences in Biomedical
and Communication Technologies, pp. 1–5, IEEE.
E. W. Dijkstra 1959, ‘A note on two problems in connexion with graphs’, Numerische
mathematik, 1(1):269–271.
A. Dodson, G. Moon, T. Moore and D. Jones 1999, ‘Guiding blind pedestrians with a personal navigation system’, Journal of Navigation, 52(03):330–341.
L. Dunai, G. Peris-Fajarnes, E. Lluna and B. Defez 2013, ‘Sensory navigation device for blind people’, Journal of Navigation, 66(3):349–362.
N. Fallah 2010, ‘Audionav: a mixed reality navigation system for individuals who are visually impaired’, ACM SIGACCESS Accessibility and Computing, (96):24–27.
N. Fallah, I. Apostolopoulos, K. Bekris and E. Folmer 2012, ‘The user as a sensor: navigating users with visual impairments in indoor spaces using tactile landmarks’, in
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp.
425–432, ACM.
J. Faria, S. Lopes, H. Fernandes, P. Martins and J. Barroso 2010, ‘Electronic white cane for blind people navigation assistance’, in World Automation Congress, pp. 1–7, IEEE.
122
A. J. Fukasawa and K. Magatani 2012, ‘A navigation system for the visually impaired an intelligent white cane’, in Annual International Conference of the IEEE Engineering
in Medicine and Biology Society, pp. 4760–4763, IEEE.
B. Furht 2011, Handbook of augmented reality, volume 71, New York: Springer, viewed 30 October 2014.
T. Gallagher, E. Wise, B. Li, A. G. Dempster, C. Rizos and E. Ramsey-Stewart 2012, ‘Indoor positioning system based on sensor fusion for the blind and visually impaired’, in International Conference on Indoor Positioning and Indoor Navigation, pp. 1–9, IEEE.
A. Ganz, S. Gandhi, C. Wilson and G. Mullett 2010, ‘Insight: RFID and Bluetooth enabled automated space for the blind and visually impaired’, in Annual International
Conference of the IEEE Engineering in Medicine and Biology Society, pp. 331–334,
IEEE.
A. Ganz, S. Gandhi, J. Schafer, T. Singh, E. Puleo, G. Mullett and C. Wilson 2011, ‘Percept: indoor navigation for the blind and visually impaired’, in Annual International
Conference of the IEEE Engineering in Medicine and Biology Society, pp. 856–859,
IEEE.
V. Garaj, Z. Hunaiti and W. Balachandran 2007, ‘The effects of video image frame rate on the environmental hazards recognition performance in using remote vision to navigate visually impaired pedestrians’, in Proceedings of the 4th International
Conference on Mobile Technology, Applications, and Systems and the 1st International Symposium on Computer Human Interaction in Mobile Technology, pp. 207–213,
ACM.
G. Ghiani, B. Leporini and F. Paterno 2008, ‘Supporting orientation for blind people using museum guides’, in CHI’08 Extended Abstracts on Human Factors in Computing
systems, pp. 3417–3422, ACM.
123
support system for wayfinding’, in Proceedings of the 5th Nordic Conference on
Human–computer Interaction: Building Bridges, pp. 172–181, ACM.
S. Holland, D. R. Morse and H. Gedenryd 2002, ‘Audio GPS: spatial audio navigation with a minimal attention interface’, Personal and Ubiquitous Computing, 6(4):253–259.
I. Hong and A. T. Murray 2013, ‘Efficient wayfinding in complex environments: derivation of a continuous space shortest path’, in Proceedings of the Sixth ACM
SIGSPATIAL International Workshop on Computational Transportation Science, p. 61,
ACM.
I. Hussain, L. Chen, H. T. Mirza, A. Majid and G. Chen 2012, ‘Hybrid auditory feedback: a new method for mobility assistance of the visually impaired’, in
Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 255–256, ACM.
J. Hwang, Y. Ji and E. Y. Kim 2012, ‘Monocular vision-based collision avoidance system’, in Proceedings of the 14th International Conference on Human-computer
Interaction with Mobile Devices and Services Companion, pp. 125–130, ACM.
S. Innet and N. Ritnoom 2009, ‘An application of infrared sensors for electronic white stick’, in International Symposium on Intelligent Signal Processing and
Communications Systems, pp. 1–4, IEEE.
R. Ivanov 2011, ‘Algorithm for blind navigation along a GPS track’, in Proceedings of
the 12th International Conference on Computer Systems and Technologies, pp. 372–
379, ACM.
D. Jain, A. Jain, R. Paul, A. Komarika and M. Balakrishnan 2013, ‘A path-guided audio based indoor navigation system for persons with visual impairment’, in Proceedings of
the 15th International ACM SIGACCESS Conference on Computers and Accessibility,
124
S. L. Joseph, C. Yi, J. Xiao, Y. Tian and F. Yan 2013, ‘Visual semantic parameterization to enhance blind user perception for indoor navigation’, in IEEE
International Conference on Multimedia and Expo Workshops, pp. 1–6, IEEE.
E. Kaiser and M. Lawo 2012, ‘Wearable navigation system for the visually impaired and blind people’, in IEEE/ACIS 11th International Conference on Computer and
Information Science, pp. 230–233, IEEE.
K. Karacs, A. Lazar, R. Wagner, B. Balint, T. Roska and M. Szuhaj 2008, ‘Bionic eyeglass: the first prototype a personal navigation device for visually impaired—a review’, in First International Symposium on Applied Sciences on Biomedical and
Communication Technologies, pp. 1–5, IEEE.
A. Kassim, H. Jaafar, M. Azam, N. Abas and T. Yasuno 2013, ‘Design and development of navigation system by using RFID technology’, in IEEE 3rd
International Conference on System Engineering and Technology, pp. 258–262, IEEE.
A. Khan, F. Moideen, J. Lopez, W. L. Khoo and Z. Zhu 2012, ‘Kindectect: kinect detecting objects’, in Computers helping people with special needs, pp. 588–595, Springer.
M. Kiers, W. Bischof, E. Krajnc and M. Dornhofer 2011, ‘Evaluation and improvements of an RFID based indoor navigation system for visually impaired and blind people’, in International Conference on Indoor Positioning and Indoor
Navigation, Guimaraes, Portugal (September 2011).
E. Ko, J. S. Ju and E. Y. Kim 2011, ‘Situation-based indoor wayfinding system for the visually impaired’, in Proceedings of the 13th International ACM SIGACCESS
Conference on Computers and Accessibility, pp. 35–42, ACM.
K. Koiner, H. Elmiligi and F. Gebali 2012, ‘GPS waypoint application’, in BWCCA, pp. 397–401.
125
K. Kostopoulos, K. Moustakas, D. Tzovaras, G. Nikolakis, C. Thillou and B. Gosselin 2007, ‘Haptic access to conventional 2D maps for the visually impaired’, Journal on
Multimodal User Interfaces, 1(2):13–19.
J. LaPlante and T. P. Kaeser 2007, ‘A history of pedestrian signal walking speed assumptions’, in 3rd Urban Street Symposium: Uptown, Downtown, or Small Town:
Designing Urban Streets that Work.
X. Liu, H. Makino, S. Kobayashi and Y. Maeda 2007, ‘Design of an indoor self- positioning system for the visually impaired-simulation with RFID and Bluetooth in a visible light communication system’, in 29th Annual International Conference of the
IEEE Engineering in Medicine and Biology Society, pp. 1655–1658, IEEE.
Macular Degeneration Support 2011, viewed 1 March 2012, http://www.mdsupport.org/library/savinglives.html.
C. Magnusson, K. Rassmus-Grohn and D. Szymczak, ‘Navigation by pointing to GPS locations 2012’, Personal and Ubiquitous Computing, 16(8):959–971.
S. Mann, J. Huang, R. Janzen, R. Lo, V. Rampersad, A. Chen and T. Doha 2011, ‘Blind navigation with a wearable range camera and vibrotactile helmet’, in Proceedings of the
19th ACM international conference on Multimedia, pp. 1325–1328, ACM.
J. R. Marston, J. M. Loomis, R. L. Klatzky, R. G. Golledge and E. L. Smith 2006, ‘Evaluation of spatial displays for navigation without sight’, ACM Transactions on
Applied Perception, 3(2):110–124.
A. J. May, T. Ross, S. H. Bayer and M. J. Tarkiainen 2003, ‘Pedestrian navigation aids: information requirements and design implications’, Personal and Ubiquitous
Computing, 7(6):331–338.
P. Mihajlik, M. Guttermuth, K. Seres and P. Tatai 2001, ‘DSP-based ultrasonic navigation aid for the blind’, in Proceedings of the 18th IEEE Instrumentation and
126
W. Mooi, T. Eng, et al. 2010, Efficient RFID tag placement framework for in building navigation system for the blind, in 8th Asia–Pacific Symposium on Information and
Telecommunication Technologies, pp. 1–6, IEEE.
A. Mpitziopoulos, C. Konstantopoulos, D. Gavalas and G. Pantziou 2008, ‘Hazard monitoring for visually impaired people enabled by wireless sensor networking technology’, in Proceedings of the 1st International Conference on Pervasive
Technologies Related to Assistive Environments, p. 21, ACM.
R. Nagarajan, S. Yaacob and G. Sainarayanan 2002, ‘Fuzzy clustering in vision recognition applied in NAVI’, in Proceedings of the Annual Meeting of the North
American Fuzzy Information Processing Society, pp. 261–266, IEEE.
R. Nagarajan, S. Yaacob and G. Sainarayanan 2003, ‘Role of object identification in sonification system for visually impaired’, in TENCON 2003, Conference on
Convergent Technologies for the Asia–Pacific Region, volume 2, pp. 735–739, IEEE.
R. Nagarajan, G. Sainarayanan, S. Yacoob and R. R. Porle 2004, ‘An improved object identification for NAVI’, in TENCON 2004, IEEE Region 10 Conference, pp. 455–458, IEEE.
P. Najera, J. Lopez and R. Roman 2011, ‘Real-time location and inpatient care systems based on passive RFID’, Journal of Network and Computer Applications, 34(3):980– 989.
L. Ni, Y. Liu, Y. Lau and A. Patil 2004, ‘Landmarc: indoor location sensing using active RFID’, Wireless Networks, 10(6):701–710.
H. Nicolau, J. Jorge and T. Guerreiro 2009, ‘Blobby: how to guide a blind person’, in
CHI’09 Extended Abstracts on Human Factors in Computing Systems, pp. 3601–3606,
ACM.
127
visually impaired people’, in 34th Annual Conference of IEEE Industrial Electronics, pp. 2982–2987, IEEE.
J. F. Oliveira 2013, ‘The path force feedback belt’, in 8th International Conference on
Information Technology in Asia, pp. 1–6, IEEE.
N. Paisios, A. Rubinsteyn, L. Subramanian, M. Tierney and V. Vyas 2011, ‘Tracking indoor location and motion for navigational assistance’, in Proceedings of the 24th
Annual ACM Symposium Adjunct on User Interface Software and Technology, pp. 83–
84, ACM.
A. Papapostolou and H. Chaouchi 2011, ‘RFID-assisted indoor localization and the impact of interference on its performance’, Journal of Network and Computer
Applications, 34(3):902–913.
K. K. Patel and S. Vij 2008, ‘Externalizing virtually perceived spatial cognitive maps’, in 2nd Annual IEEE Systems Conference, pp. 1–7, IEEE.
O. Polacek, T. Grill and M. Tscheligi 2012, ‘Towards a navigation system for blind people: a Wizard of Oz study’. ACM SIGACCESS Accessibility and Computing, (104):12–29.
V. Pradeep, G. Medioni and J. Weiland 2010, ‘Robot vision for the visually impaired’, in IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Workshops, pp. 15–22, IEEE.
B. Prudhvi and R. Bagani 2013, ‘Silicon eyes: GPS–GSM based navigation assistant for visually impaired using capacitive touch braille keypad and smart SMS facility’, in
World Congress on Computer and Information Technology, pp. 1–3, IEEE.
E. Puffenbarger, F. P. Teer and S. Kruck 2007, ‘RFID: new technology on the horizon for its majors’, International Journal of Information and Communication Technology
128
J. Rahhal, Y.-L. Wang and G. E. Atkin 1996, ‘Template matching for a local guidance system’, in IEEE 39th Midwest symposium on Circuits and Systems, volume 3, pp. 1268–1271, IEEE.
G. Retscher and Q. Fu 2010, ‘Continuous indoor navigation with RFID and INS’, in
IEEE/ION Position Location and Navigation Symposium, pp. 102–112, IEEE.
D. A. Ross and B. B. Blasch 2000, ‘Wearable interfaces for orientation and wayfinding’, in Proceedings of the 4th International ACM Conference on Assistive
Technologies, pp. 193–200, ACM.
D. A. Ross and A. Lightman 2005, ‘Talking braille: a wireless ubiquitous computing network for orientation and wayfinding’, in Proceedings of the 7th international ACM
SIGACCESS Conference on Computers and Accessibility, pages 98–105, ACM.
A. R. J. Ruiz, F. S. Granja, J. C. Prieto Honorato and J. I. G. Rosas 2012, ‘Accurate pedestrian indoor navigation by tightly coupling foot-mounted IMU and RFID measurements’, IEEE Transactions on Instrumentation and Measurement, 61(1):178– 189.
J. Sanchez and N. de la Torre 2010, ‘Autonomous navigation through the city for the blind’, in Proceedings of the 12th International ACM SIGACCESS Conference on
Computers and Accessibility, pp. 195–202, ACM.
J. H. Sanchez, F. A. Aguayo and T. M. Hassler 2007, ‘Independent outdoor mobility for the blind’, in Virtual Rehabilitation, pp. 114–120. IEEE.
B. Schmitz, S. Becker, A. Blessing and M. Großmann 2011, ‘Acquisition and presentation of diverse spatial context data for blind navigation’, in 12th IEEE
International Conference on Mobile Data Management, volume 1, pp. 276–284, IEEE.
Science Daily 2007, viewed 10 April 2014
129
S. Sethu Selvi, U. Kamath and M. Sudhin 2008, ‘Andha asthra—a navigation system for the visually impaired’, in IEEE International Conference on Multisensor Fusion and
Integration for Intelligent Systems, pp. 137–142, IEEE.
T. Seto and K. Magatani 2009, ‘A navigation system for the visually impaired using colored navigation lines and RFID tags’, in Annual International Conference of the
IEEE Engineering in Medicine and Biology Society, pp. 831–834, IEEE.
M. Shamsi, M. Al-Qutayri and J. Jeedella 2011, ‘Blind assistant navigation system’, in
1st Middle East Conference on Biomedical Engineering, pp. 163–166, IEEE.
Y. Shiizu, Y. Hirahara, K. Yanashima and K. Magatani 2007, ‘The development of a white cane which navigates the visually impaired’, in 29th Annual International
Conference of the IEEE Engineering in Medicine and Biology Society, pp. 5005–5008,
IEEE.
I. Shim and J. Yoon 2002, ‘A robotic cane based on interactive technology’, in 28th
Annual Conference of the Industrial Electronics Society, volume 3, pp. 2249–2254,
IEEE.
S. Shoval, J. Borenstein and Y. Koren 1994, ‘Mobile robot obstacle avoidance in a computerized travel aid for the blind’, in Proceedings, IEEE International Conference
on Robotics and Automation, pp. 2023–2028, IEEE.
S. Shoval, J. Borenstein and Y. Koren 1998. ‘Auditory guidance with the Navbelt—a computerized travel aid for the blind’, IEEE Transactions on Systems, Man, and
Cybernetics, Part C: Applications and Reviews, 28(3):459–467.
J.-W. Song and S.-H. Yang 2010, ‘Touch your way: haptic sight for visually impaired people to walk with independence’, in CHI’10 Extended Abstracts on Human Factors in
Computing Systems, pp. 3343–3348, ACM.
130
real-time obstacle avoidance’, in Proceedings IEEE International Conference on
Robotics and Automation, volume 3, pp. 2891–2896, IEEE.
Y. Sun, N. Ding, H. Qian and Y. Xu 2012, ‘Real-time monocular visual self-localization approach using natural circular landmarks for indoor navigation’, in IEEE International
Conference on Robotics and Biomimetics, pp. 495–500. IEEE.
A. Szeto and S. Sharma 2007, ‘RFID based indoor navigational aid for persons with severe visual impairments’, in 29th Annual International Conference of the IEEE
Engineering in Medicine and Biology Society, pp. 6360–6363. IEEE.
R. Tesoriero, J. Gallud, M. Lozano and V. Penichet 2008, ‘Using active and passive RFID technology to support indoor location-aware systems’, IEEE Transactions on
Consumer Electronics, 54(2):578–583.
I. Ulrich and J. Borenstein 2001, ‘The guidecane—applying mobile robot technologies to assist the visually impaired’, IEEE Transactions on Systems, Man and Cybernetics,
Part A: Systems and Humans, 31(2):131–136.
D. Wave 2010, QR-code features. QR-Code. Com, viewed 30 October 2014
Vision Australia (VA) 2014a, Help raise seeing eye dogs, viewed 3 July 2014 http://www.visionaustralia.org/fundraising-and-volunteering/our-fundraising-
campaigns/help-raise-seeing-eye-dogs
Vision Australia (VA) 2014b, Blindness and vision loss, viewed 3 July 2014 http://www.visionaustralia.org/living-with-low-vision/newly-diagnosed/blindness-and- vision-loss
World Health Organization (WHO) 2011, viewed 3 July 2014, http://www.who.int/topics/blindness/en/
F. Wong, R. Nagarajan and S. Yaacob 2003, ‘Application of stereovision in a navigation aid for blind people’, in Proceedings of the 2003 Joint Conference of the
131
Fourth International Conference on Information, Communications and Signal Processing, volume 2, pp. 734–737, IEEE.
H. Wu, A. Marshall and W. Yu 2007, ‘Path planning and following algorithms in an indoor navigation model for visually impaired’, in Second International Conference on
Internet Monitoring and Protection, pp. 38–38, IEEE.
L. Xia, C.-C. Chen and J. Aggarwal 2011. ‘Human detection using depth information by Kinect’, in IEEE Computer Society Conference on Computer Vision and Pattern
Recognition Workshops, pp. 15–22, IEEE.
L. Xu, E. Oja and P. Kultanen 1990, ‘A new curve detection method: randomized Hough transform (RHT)’, Pattern Recognition Letters, 11(5):331–338.
X. Yang, H. He, S. Wang and L. Fang 2011, ‘Communication satellite location/cell location integrated navigation system for all-blind war’, in International Conference on
Electric Information and Control Engineering, pp. 2044–2046, IEEE.
K. Yelamarthi, D. Haas, D. Nielsen and S. Mothersell 2010, ‘RFID and GPS integrated navigation system for the visually impaired’, in 53rd IEEE International Midwest
Symposium on Circuits and Systems, pp. 1149–1152, IEEE.
M. Zollner, S. Huber, H.-C. Jetter and H. Reiterer 2011, NAVI—a proof-of-concept of a