Skip to main content
  • Brain-machine Interface Control of a Robotic Arm for Object Grasping is Improved with Computer-vision Based Shared Control

    Final Number:
    201

    Authors:
    Elizabeth C. Tyler-Kabara MD, PhD; John Downey; Jeffrey Weiss; Katharina Muelling; Arun Venkataraman; Jean-Sebastien Valois; Shervin Javdani; Martial Herbert; J. Andrew Bagnell; Andrew Schwartz; Jennifer Collinger

    Study Design:
    Clinical Trial

    Subject Category:

    Meeting: Congress of Neurological Surgeons 2015 Annual Meeting

    Introduction: Brain-machine interface neuroprosthetic arms for people with upper limb impairment are developing quickly, but could be improved through intelligent computer-vision based assistance. Grasping and manipulating objects requires very accurate control of a prosthetic arm and hand, and is required for these limbs to eventually be used clinically. With the computer helping to stabilize the hand during grasping, the user’s control would not need to be as accurate, and they would be free to concentrate on the larger goals of the arm movements.

    Methods: A brain-machine interface was used to control a robotic arm to complete a subset of tasks from the Action Research Arm Test to determine two subjects’ functional control of the arm. The task was done with and without computer-vision based assistance. The computer-vision system identified objects and how the objects could be stably grasped. Once the user approached the object the system helped the movements to ensure a stable grasp.

    Results: Both subjects successfully completed the tasks more often with the grasp assistance than without. The assistance lowered the speed with which the arm moved while near the objects, but did not increase the amount of time required to complete the task. This shows that the assistance made the movements both more accurate and more efficient. Both subjects reported that the arm was easier to use with assistance.

    Conclusions: By integrating brain-machine interface based high level control with computer-vision based low level control of a robotic arm people with tetraplegia showed improved functional use of the arm. This result highlights the importance of combining neuroscience and robotic based assistive technologies to create a highly flexible and effective neuroprosthetic arm for people with upper limb impairment

    Patient Care: Improved neuroprosthetic

    Learning Objectives: By the conclusion of this session, participants should be able to: 1) Describe the importance of shared control, 2) Discuss the use of neuroscience and and robotic technology in relation to neuroprosthetics, 3) Describe metrics for testing upper limb neuroprosthetics.

    References:

We use cookies to improve the performance of our site, to analyze the traffic to our site, and to personalize your experience of the site. You can control cookies through your browser settings. Please find more information on the cookies used on our site. Privacy Policy