Are the hand trackers accurate enough for displaying fingers on a keyboard?

Pimax 8K Series
1

Has anyone here tried out Leap Motion (which is the company doing the hand tracking for Pimax)? Would it be accurate enough to enable virtual fingers on a virtual keyboard?

I ask because I would love to use VR for productivity in a virtual desktop, but I need to be able to occasionally see the keyboard and my fingers to be able to accurately type at a decent speed. I think the Pimax is the first headset to make true productivity a possibility, with its higher resolution with head tracking (as opposed to Pimax 4k which didn’t have head tracking), but I need my fingers!

2

This is what you want

Hopefully Pimax will support it as well.

Leap Motion does track hands quite well, but AFAIK it does not track keyboards

2 Likes
3

That article/video doesn’t explain something important (or I missed it): how it is tracking hands/fingers. Having a good accurate virtual keyboard is a really good start, but the fingers are just as important, if not more.

1 Like
4

As I understand it, because the keyboard is mapped perfectly IRL it can be used as a green-screen for the camera.

You may not get very good depth information about your hands (basically the hands are 2d, if I’m right) and the tracking could fail if you do not have your hands over the keyboard, but you will have very accurate information regarding which keys you are about to press.

1 Like
5

I’m not sure pimax has the camera to see your hands. HTC vive does.

6

A camera could be a simple and fairly cheap module.

Alternately, perhaps the cameras in the leap-motion module could be used for this as well.

1 Like
7

Here is an old demo video from 2014 using the original Leap Motion controller:

Hand tracking has improved a lot since the Leap Motion Orion update in February 2016.
However tracking accuracy might still be affected by how much your specific keyboard reflects infrared light.

A better option could be using Leapmotion in passthrough mode which shows the images of both cameras in realtime:

There should be less problems alignment problems with the new Leap Motion hardware has the two cameras are now placed in the average human interpupillary distance (IPD) of 64 mm. Much better than the 40 mm of the old Leap Motion controller hardware.

3 Likes
8