Detail publikace

AI-SenseVision: A Low-Cost Artificial-Intelligence-Based Robust and Real-Time Assistance for Visually Impaired People

Joshi, R.C., Singh, N., Sharma, A.K., Burget, R. and Dutta, M.K

Originální název

AI-SenseVision: A Low-Cost Artificial-Intelligence-Based Robust and Real-Time Assistance for Visually Impaired People

Typ

článek v časopise ve Web of Science, Jimp

Jazyk

angličtina

Originální abstrakt

Visually impaired people (VIPs) encounter various challenges in their daily lives, and there is a need for portable, user-friendly device for real-time assistance to give them guidance regarding their surroundings. This article presents an artificial-intelligence-based innovative wearable assistive device-artificial intelligence (AI)-SenseVision-to analyze visual and sensory information about the objects and obstacles present in the scene to perceive the surrounding environment. The device is a complete amalgamation of sensor and computer-vision-based technologies that generate auditory information with the name of identified objects or audio warnings for detected obstacles. The performance of the trained deep-learning model is rigorously tested in complex and real-life scenarios using various statistical parameters for experimental validation. Moreover, the trained deep-learning models have been integrated into a low-cost single-board processor to make a standalone cost-effective device. All data processing is done within an optimized single hardware setup, and the user can easily access different modes, such as indoor and outdoor mode, while also enabling object counting in observed scenes. The proposed system has low-cost sensors, multiple operational modes, easy integration, and small volume, making this assistive device helpful for VIPs for independent navigation and collision prevention.

Klíčová slova

Navigation; Cameras; Acoustics; Visualization; Real-time systems; Headphones; Assistive devices; Artificial intelligence (AI); guidance system; navigation system; obstacle avoidance; visually impaired people (VIPs)

Autoři

Joshi, R.C., Singh, N., Sharma, A.K., Burget, R. and Dutta, M.K

Vydáno

29. 3. 2024

Nakladatel

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC

Místo

PISCATAWAY

ISSN

2168-2305

Periodikum

IEEE Transactions on Human-Machine Systems

Ročník

1

Číslo

1

Stát

Spojené státy americké

Strany od

1

Strany do

12

Strany počet

12

URL

https://ieeexplore.ieee.org/abstract/document/10485529?casa_token=4l-nuPLnmGEAAAAA:le2jpHFshX6sSaAqD9eCOnP42T3HzB8HfwKVL-Ali23o_kYnhMZX2S7b8kMenv-zgC0HHFjvphg

BibTex

@article{BUT188577,
  author="Rakesh Chandra {Joshi} and Radim {Burget} and Malay Kishore {Dutta}",
  title="AI-SenseVision: A Low-Cost Artificial-Intelligence-Based Robust and Real-Time Assistance for Visually Impaired People",
  journal="IEEE Transactions on Human-Machine Systems",
  year="2024",
  volume="1",
  number="1",
  pages="1--12",
  doi="10.1109/THMS.2024.3375655",
  issn="2168-2305",
  url="https://ieeexplore.ieee.org/abstract/document/10485529?casa_token=4l-nuPLnmGEAAAAA:le2jpHFshX6sSaAqD9eCOnP42T3HzB8HfwKVL-Ali23o_kYnhMZX2S7b8kMenv-zgC0HHFjvphg"
}