Publication detail

AI-SenseVision: A Low-Cost Artificial-Intelligence-Based Robust and Real-Time Assistance for Visually Impaired People

Joshi, R.C., Singh, N., Sharma, A.K., Burget, R. and Dutta, M.K

Original Title

AI-SenseVision: A Low-Cost Artificial-Intelligence-Based Robust and Real-Time Assistance for Visually Impaired People

Type

journal article in Web of Science

Language

English

Original Abstract

Visually impaired people (VIPs) encounter various challenges in their daily lives, and there is a need for portable, user-friendly device for real-time assistance to give them guidance regarding their surroundings. This article presents an artificial-intelligence-based innovative wearable assistive device-artificial intelligence (AI)-SenseVision-to analyze visual and sensory information about the objects and obstacles present in the scene to perceive the surrounding environment. The device is a complete amalgamation of sensor and computer-vision-based technologies that generate auditory information with the name of identified objects or audio warnings for detected obstacles. The performance of the trained deep-learning model is rigorously tested in complex and real-life scenarios using various statistical parameters for experimental validation. Moreover, the trained deep-learning models have been integrated into a low-cost single-board processor to make a standalone cost-effective device. All data processing is done within an optimized single hardware setup, and the user can easily access different modes, such as indoor and outdoor mode, while also enabling object counting in observed scenes. The proposed system has low-cost sensors, multiple operational modes, easy integration, and small volume, making this assistive device helpful for VIPs for independent navigation and collision prevention.

Keywords

Navigation; Cameras; Acoustics; Visualization; Real-time systems; Headphones; Assistive devices; Artificial intelligence (AI); guidance system; navigation system; obstacle avoidance; visually impaired people (VIPs)

Authors

Joshi, R.C., Singh, N., Sharma, A.K., Burget, R. and Dutta, M.K

Released

29. 3. 2024

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC

Location

PISCATAWAY

ISBN

2168-2305

Periodical

IEEE Transactions on Human-Machine Systems

Year of study

1

Number

1

State

United States of America

Pages from

1

Pages to

12

Pages count

12

URL

https://ieeexplore.ieee.org/abstract/document/10485529?casa_token=4l-nuPLnmGEAAAAA:le2jpHFshX6sSaAqD9eCOnP42T3HzB8HfwKVL-Ali23o_kYnhMZX2S7b8kMenv-zgC0HHFjvphg

BibTex

@article{BUT188577,
  author="Rakesh Chandra {Joshi} and Radim {Burget} and Malay Kishore {Dutta}",
  title="AI-SenseVision: A Low-Cost Artificial-Intelligence-Based Robust and Real-Time Assistance for Visually Impaired People",
  journal="IEEE Transactions on Human-Machine Systems",
  year="2024",
  volume="1",
  number="1",
  pages="1--12",
  doi="10.1109/THMS.2024.3375655",
  issn="2168-2305",
  url="https://ieeexplore.ieee.org/abstract/document/10485529?casa_token=4l-nuPLnmGEAAAAA:le2jpHFshX6sSaAqD9eCOnP42T3HzB8HfwKVL-Ali23o_kYnhMZX2S7b8kMenv-zgC0HHFjvphg"
}