Integrated online localization and navigation for people with visual impairments using smart phones

Ilias Apostolopoulos, Navid Fallah, Eelke Folmer, Kostas Bekris

Research output: Chapter in Book/Report/Conference proceedingConference contribution

9 Citations (Scopus)

Abstract

Indoor localization and navigation systems for individuals with visual impairments (VI) typically rely upon extensive augmentation of the physical space or heavy, expensive sensors; thus, few systems have been adopted. This work describes a system able to guide people with VI through buildings using inexpensive sensors, such as accelerometers, which are available in portable devices like smart phones. The method takes advantage of feedback from the human user, who confirms the presence of landmarks. The system calculates the user's location in real time and uses it to provide audio instructions on how to reach the desired destination. Previous work suggested that the accuracy of the approach depended on the type of directions and the availability of an appropriate transition model for the user. A critical parameter for the transition model is the user's step length. The current work investigates different schemes for automatically computing the user's step length and reducing the dependency of the approach to the definition of an accurate transition model. Furthermore, the direction provision method is able to use the localization estimate and adapt to failed executions of paths by the users. Experiments are presented that evaluate the accuracy of the overall integrated system, which is executed online on a smart phone. Both people with visual impairments, as well as blindfolded sighted people, participated in the experiments. The experiments included paths along multiple floors, that required the use of stairs and elevators.

Original languageEnglish (US)
Title of host publication2012 IEEE International Conference on Robotics and Automation, ICRA 2012
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1322-1329
Number of pages8
ISBN (Print)9781467314039
DOIs
StatePublished - Jan 1 2012
Externally publishedYes
Event 2012 IEEE International Conference on Robotics and Automation, ICRA 2012 - Saint Paul, MN, United States
Duration: May 14 2012May 18 2012

Publication series

NameProceedings - IEEE International Conference on Robotics and Automation
ISSN (Print)1050-4729

Other

Other 2012 IEEE International Conference on Robotics and Automation, ICRA 2012
CountryUnited States
CitySaint Paul, MN
Period5/14/125/18/12

Fingerprint

Navigation
Stairs
Elevators
Experiments
Sensors
Navigation systems
Accelerometers
Availability
Feedback

All Science Journal Classification (ASJC) codes

  • Software
  • Control and Systems Engineering
  • Artificial Intelligence
  • Electrical and Electronic Engineering

Cite this

Apostolopoulos, I., Fallah, N., Folmer, E., & Bekris, K. (2012). Integrated online localization and navigation for people with visual impairments using smart phones. In 2012 IEEE International Conference on Robotics and Automation, ICRA 2012 (pp. 1322-1329). [6225093] (Proceedings - IEEE International Conference on Robotics and Automation). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICRA.2012.6225093
Apostolopoulos, Ilias ; Fallah, Navid ; Folmer, Eelke ; Bekris, Kostas. / Integrated online localization and navigation for people with visual impairments using smart phones. 2012 IEEE International Conference on Robotics and Automation, ICRA 2012. Institute of Electrical and Electronics Engineers Inc., 2012. pp. 1322-1329 (Proceedings - IEEE International Conference on Robotics and Automation).
@inproceedings{716f53872fdc4b3094f819cefdb21b60,
title = "Integrated online localization and navigation for people with visual impairments using smart phones",
abstract = "Indoor localization and navigation systems for individuals with visual impairments (VI) typically rely upon extensive augmentation of the physical space or heavy, expensive sensors; thus, few systems have been adopted. This work describes a system able to guide people with VI through buildings using inexpensive sensors, such as accelerometers, which are available in portable devices like smart phones. The method takes advantage of feedback from the human user, who confirms the presence of landmarks. The system calculates the user's location in real time and uses it to provide audio instructions on how to reach the desired destination. Previous work suggested that the accuracy of the approach depended on the type of directions and the availability of an appropriate transition model for the user. A critical parameter for the transition model is the user's step length. The current work investigates different schemes for automatically computing the user's step length and reducing the dependency of the approach to the definition of an accurate transition model. Furthermore, the direction provision method is able to use the localization estimate and adapt to failed executions of paths by the users. Experiments are presented that evaluate the accuracy of the overall integrated system, which is executed online on a smart phone. Both people with visual impairments, as well as blindfolded sighted people, participated in the experiments. The experiments included paths along multiple floors, that required the use of stairs and elevators.",
author = "Ilias Apostolopoulos and Navid Fallah and Eelke Folmer and Kostas Bekris",
year = "2012",
month = "1",
day = "1",
doi = "10.1109/ICRA.2012.6225093",
language = "English (US)",
isbn = "9781467314039",
series = "Proceedings - IEEE International Conference on Robotics and Automation",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "1322--1329",
booktitle = "2012 IEEE International Conference on Robotics and Automation, ICRA 2012",
address = "United States",

}

Apostolopoulos, I, Fallah, N, Folmer, E & Bekris, K 2012, Integrated online localization and navigation for people with visual impairments using smart phones. in 2012 IEEE International Conference on Robotics and Automation, ICRA 2012., 6225093, Proceedings - IEEE International Conference on Robotics and Automation, Institute of Electrical and Electronics Engineers Inc., pp. 1322-1329, 2012 IEEE International Conference on Robotics and Automation, ICRA 2012, Saint Paul, MN, United States, 5/14/12. https://doi.org/10.1109/ICRA.2012.6225093

Integrated online localization and navigation for people with visual impairments using smart phones. / Apostolopoulos, Ilias; Fallah, Navid; Folmer, Eelke; Bekris, Kostas.

2012 IEEE International Conference on Robotics and Automation, ICRA 2012. Institute of Electrical and Electronics Engineers Inc., 2012. p. 1322-1329 6225093 (Proceedings - IEEE International Conference on Robotics and Automation).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Integrated online localization and navigation for people with visual impairments using smart phones

AU - Apostolopoulos, Ilias

AU - Fallah, Navid

AU - Folmer, Eelke

AU - Bekris, Kostas

PY - 2012/1/1

Y1 - 2012/1/1

N2 - Indoor localization and navigation systems for individuals with visual impairments (VI) typically rely upon extensive augmentation of the physical space or heavy, expensive sensors; thus, few systems have been adopted. This work describes a system able to guide people with VI through buildings using inexpensive sensors, such as accelerometers, which are available in portable devices like smart phones. The method takes advantage of feedback from the human user, who confirms the presence of landmarks. The system calculates the user's location in real time and uses it to provide audio instructions on how to reach the desired destination. Previous work suggested that the accuracy of the approach depended on the type of directions and the availability of an appropriate transition model for the user. A critical parameter for the transition model is the user's step length. The current work investigates different schemes for automatically computing the user's step length and reducing the dependency of the approach to the definition of an accurate transition model. Furthermore, the direction provision method is able to use the localization estimate and adapt to failed executions of paths by the users. Experiments are presented that evaluate the accuracy of the overall integrated system, which is executed online on a smart phone. Both people with visual impairments, as well as blindfolded sighted people, participated in the experiments. The experiments included paths along multiple floors, that required the use of stairs and elevators.

AB - Indoor localization and navigation systems for individuals with visual impairments (VI) typically rely upon extensive augmentation of the physical space or heavy, expensive sensors; thus, few systems have been adopted. This work describes a system able to guide people with VI through buildings using inexpensive sensors, such as accelerometers, which are available in portable devices like smart phones. The method takes advantage of feedback from the human user, who confirms the presence of landmarks. The system calculates the user's location in real time and uses it to provide audio instructions on how to reach the desired destination. Previous work suggested that the accuracy of the approach depended on the type of directions and the availability of an appropriate transition model for the user. A critical parameter for the transition model is the user's step length. The current work investigates different schemes for automatically computing the user's step length and reducing the dependency of the approach to the definition of an accurate transition model. Furthermore, the direction provision method is able to use the localization estimate and adapt to failed executions of paths by the users. Experiments are presented that evaluate the accuracy of the overall integrated system, which is executed online on a smart phone. Both people with visual impairments, as well as blindfolded sighted people, participated in the experiments. The experiments included paths along multiple floors, that required the use of stairs and elevators.

UR - http://www.scopus.com/inward/record.url?scp=84864433146&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84864433146&partnerID=8YFLogxK

U2 - 10.1109/ICRA.2012.6225093

DO - 10.1109/ICRA.2012.6225093

M3 - Conference contribution

AN - SCOPUS:84864433146

SN - 9781467314039

T3 - Proceedings - IEEE International Conference on Robotics and Automation

SP - 1322

EP - 1329

BT - 2012 IEEE International Conference on Robotics and Automation, ICRA 2012

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Apostolopoulos I, Fallah N, Folmer E, Bekris K. Integrated online localization and navigation for people with visual impairments using smart phones. In 2012 IEEE International Conference on Robotics and Automation, ICRA 2012. Institute of Electrical and Electronics Engineers Inc. 2012. p. 1322-1329. 6225093. (Proceedings - IEEE International Conference on Robotics and Automation). https://doi.org/10.1109/ICRA.2012.6225093