Has anyone here tried out Leap Motion (which is the company doing the hand tracking for Pimax)? Would it be accurate enough to enable virtual fingers on a virtual keyboard?
I ask because I would love to use VR for productivity in a virtual desktop, but I need to be able to occasionally see the keyboard and my fingers to be able to accurately type at a decent speed. I think the Pimax is the first headset to make true productivity a possibility, with its higher resolution with head tracking (as opposed to Pimax 4k which didn’t have head tracking), but I need my fingers!
That article/video doesn’t explain something important (or I missed it): how it is tracking hands/fingers. Having a good accurate virtual keyboard is a really good start, but the fingers are just as important, if not more.
As I understand it, because the keyboard is mapped perfectly IRL it can be used as a green-screen for the camera.
You may not get very good depth information about your hands (basically the hands are 2d, if I’m right) and the tracking could fail if you do not have your hands over the keyboard, but you will have very accurate information regarding which keys you are about to press.
Here is an old demo video from 2014 using the original Leap Motion controller:
Hand tracking has improved a lot since the Leap Motion Orion update in February 2016.
However tracking accuracy might still be affected by how much your specific keyboard reflects infrared light.
A better option could be using Leapmotion in passthrough mode which shows the images of both cameras in realtime:
There should be less problems alignment problems with the new Leap Motion hardware has the two cameras are now placed in the average human interpupillary distance (IPD) of 64 mm. Much better than the 40 mm of the old Leap Motion controller hardware.