Leap Motion Hand Tracking for Movement Disorder


PROJECT STATUS: Open. LOOKING FOR RESEARCHERS, DEVELOPERS, PARTNERS

Leap Motion controller (aka Ultraleap) is a small device designed to be placed on a physical desktop, facing upward.
Using two monochromatic IR cameras and three infrared LEDs, the device generate almost 200 frames per second of reflected data.

In a 2013 study, the overall average accuracy of the controller was shown to be 0.7 millimeters ( Weichert, Frank; Bachmann, Daniel; Rudak, Bartholomäus; Fisseler, Denis (2013-05-14). “Analysis of the Accuracy and Robustness of the Leap Motion Controller”Sensors (Basel, Switzerland)13 (5): 6380–6393)

Given its accuracy, and the no-contact technology, Leap Motion is an ideal hand-tracking device for movement disorders. Free APIs allow for a fast development of a virtual environment in Unity, while recording submillimetric finger positions.
Data post-analysis will give out informations about tremor’s nature, frequency span, frequency peak, fatigue response.

App is ready, running and working (Developed in Unity).

However, there’s few more things to do:

  • Develop a more user-friendly GUI
  • Create a better testing environment (on-screen instructions, L/R hand, timer etc.)
  • Automate data analysis
  • Validate the method (sci paper)
Tapping-Test recording (Thumb-Index fingers). TOP: fingers acceleration. BOTTOM: fingers distance (does not reach “zero” because center-of-mass is not on finger’s skin surface – needs calibration)
Tapping-Test recording (Thumb-Index fingers): Frequency Analisys