Nimble SDK User guide

Overview

Our hand-tracking system is designed to track the position and orientation of a user's hands as well as the (limited) pose of the ten fingers. Presently, we support several finger poses such as pinching and pointing.

Our technology works best when the user is seated at a desk and the cameras are looking down at the user's hands. This configuration allows the user to rest his hands on the desk most of the time. A desktop environment is also good for facilitating interaction with virtual objects.

In this version of the hand-tracker, we've focused on exposing robust tracking of the hand and the pinching pose in particular. Pinching is a good way for users to select or "grab" virtual objects or drive a touchless GUI. It's analogous to "clicking" with a mouse. In fact, our API exposes the "pinching" gesture much like a mouse event.

Limitations

Our system currently tracks some poses better than others because it relies on a database of poses to track a user's hands. Poses outside of the database may be tracked poorly. For the most general version of our tracking, please try our "Arbitrary 10-finger Tracking Mode" described in the installation notes (part 2).

Feel free to contact us with any problems, suggestions for improvements, etc. Fill out our feedback form or send email to info@threegear.com.

Thanks for giving our SDK a try!