Skip to main content
  • U.S. Department of Health & Human Services
National Institutes of Health (NIH) - Turning Discovery into Health
  • Virtual Tour
  • En Español

Site Menu

  • Home
  • Health Information
    • Health Care Providers & Facilities
    • Health Info Lines
    • HealthCare.gov
    • Science Education Resources
    • NIH Clinical Research Trials and You
    • Talking to Your Doctor

    More »

    Quick Links

    • MedlinePlus Health Info
    • NIH News in Health
    • Wellness Toolkits
  • Grants & Funding
    • Grants Home Page
    • Find Funding
    • Due Dates
    • How to Apply
    • About Grants
    • Policy & Compliance
    • Grants News/Blog
    • Contracts
    • Loan Repayment

    More »

    Quick Links

    • RePORT
    • eRA Commons
    • NIH Common Fund
  • News & Events
    • News Releases
    • Digital Media Kits
    • Media Resources
    • Media Contacts
    • Images and B-roll
    • Events
    • Social Media

    More »

    Quick Links

    • NIH News in Health
    • NIH Research Matters
    • NIH Record
  • Research & Training
    • Medical Research Initiatives
    • Science Highlights
    • Science Education
    • Research in NIH Labs & Clinics
    • Training Opportunities
    • Library Resources
    • Research Resources
    • Clinical Research Resources
    • Safety, Regulation and Guidance

    More »

    Quick Links

    • PubMed
    • Stem Cell Information
    • OppNet
    • NIDB
    • NIH Blueprint for Neuroscience Research
  • Institutes at NIH
    • List of Institutes and Centers
    • NIH Office of the Director
    • Directors of NIH Institutes and Centers
    • NIH Institute and Center Contact Information

    More »

    Quick Links

    • NCI
    • NEI
    • NHLBI
    • NHGRI
    • NIA
    • NIAAA
    • NIAID
    • NIAMS
    • NIBIB
    • NICHD
    • NIDCD
    • NIDCR
    • NIDDK
    • NIDA
    • NIEHS
    • NIGMS
    • NIMH
    • NIMHD
    • NINDS
    • NINR
    • NLM
    • CC
    • CIT
    • CSR
    • FIC
    • NCATS
    • NCCIH
  • About NIH
    • Who We Are
    • What We Do
    • Jobs at NIH
    • Visitor Information
    • Frequently Asked Questions
    • Contact Us

    More »

    Quick Links

    • The NIH Director
    • Take the Virtual Tour
    • NIH…Turning Discovery Into Health®
    • Impact of NIH Research
    • Science, Health, and Public Trust

You are here

Home » News & Events » News Releases

News Releases

News Release

Wednesday, September 8, 2021

NIH-funded modern “white cane” brings navigation assistance to the 21st century

Robotic cane with 3D camera can accurately guide user to chosen location, avoiding obstacles.

Person tests robotic cane Study author Lingqiu Jin tests the robotic cane.Cang Ye, VCU.

Equipped with a color 3D camera, an inertial measurement sensor, and its own on-board computer, a newly improved robotic cane could offer blind and visually impaired users a new way to navigate indoors. When paired with a building’s architectural drawing, the device can accurately guide a user to a desired location with sensory and auditory cues, while simultaneously helping the user avoid obstacles like boxes, furniture, and overhangs. Development of the device was co-funded by the National Institutes of Health’s National Eye Institute (NEI) and the National Institute of Biomedical Imaging and Bioengineering (NIBIB). Details of the updated design were published in the journal IEEE/CAA Journal of Automatica Sinica.

“Many people in the visually impaired community consider the white cane to be their best and most functional navigational tool, despite it being century-old technology,” said Cang Ye, Ph.D., lead author of the study and professor of computer science at the College of Engineering at the Virginia Commonwealth University, Richmond. “For sighted people, technologies like GPS-based applications have revolutionized navigation. We’re interested in creating a device that closes many of the gaps in functionality for white cane users.”

While there are cell phone-based applications that can provide navigation assistance – helping blind users stay within crosswalks, for example – large spaces inside buildings are a major challenge, especially when those spaces are unfamiliar. Earlier versions of Ye’s robotic cane began tackling this problem by incorporating building floorplans; the user could tell the cane whether he or she wished to go, and the cane – by a combination of auditory cues and a robotic rolling tip – could guide the user to their destination. But when used over long distances, the inaccuracies in the user’s location could build up, eventually leaving the user at an incorrect location.

To help correct this issue, Ye and colleagues have added a color depth camera to the system. Using infrared light, much like a mobile phone’s front-facing camera, the system can determine the distance between the cane and other physical objects, including the floor, features like doorways and walls, as well as furniture and other obstacles. Using this information, along with data from an inertial sensor, the cane’s onboard computer can map the user’s precise location to the existing architectural drawing or floorplan, while also alerting the user to obstacles in their path.

“While some cell phone apps can give people auditory navigation instructions, when going around a corner for example, how do you know you’ve turned just the right amount?” said Ye. “The rolling tip on our robotic cane can guide you to turn at just the right point and exactly the right number of degrees, whether it’s 15 degrees or 90. This version can also alert you to overhanging obstacles, which a standard white cane cannot.”

There are still a few kinks to be worked out before the system will be market-ready – it’s still too heavy for regular use, for example, and Ye’s team is looking for a way to slim down the device. Nevertheless, with the ability to easily switch between its automated mode and a simpler, non-robotic “white cane mode,” Ye believes this device could provide a key independence tool for the blind and visually impaired, without losing the characteristics of the white cane that have stood the test of time.

The study was funded by NEI and NIBIB through grant EB018117.

 NEI leads the federal government’s research on the visual system and eye diseases. NEI supports basic and clinical science programs to develop sight-saving treatments and address special needs of people with vision loss. For more information, visit https://www.nei.nih.gov.

About the National Institutes of Health (NIH): NIH, the nation's medical research agency, includes 27 Institutes and Centers and is a component of the U.S. Department of Health and Human Services. NIH is the primary federal agency conducting and supporting basic, clinical, and translational medical research, and is investigating the causes, treatments, and cures for both common and rare diseases. For more information about NIH and its programs, visit www.nih.gov.

NIH…Turning Discovery Into Health®

References

Zhang H, Jin LQ, Ye C. “An RGB-D camera based visual positioning system for assistive navigation by a robotic navigation aid,” IEEE/CAA J. Autom. Sinica. 2021. 8(8):1389-1400. doi:10.1109/JAS.2021.1004084

###

Institute/Center

National Eye Institute (NEI)

Contact

Lesley Earl or Kathryn DeMott
301-496-5248

Connect with Us

  • Subscribe to news releases
  • RSS Feed

Connect with Us

  • Contact Us
  • X
  • Facebook
  • Instagram
  • YouTube
  • Flickr
  • More Social Media from NIH

Footer

  • NIH Home
  • Virtual Tour
  • En Español
  • Visitor Information
  • Frequently Asked Questions
  • Privacy Policy
  • Disclaimers
  • Accessibility
  • NIH Website Archives
  • Nondiscrimination Notice
  • Freedom of Information Act
  • No Fear Act
  • HHS Vulnerability Disclosure
  • Office of Inspector General
  • USA.gov

NIH…Turning Discovery Into Health®

National Institutes of Health, 9000 Rockville Pike, Bethesda, Maryland 20892

U.S. Department of Health and Human Services

Back to Top