Is the eye tracking for foveated rendering?

Until their partner creates the device with specs its hard to give a direct answer & may also have an nda of sorts in place on releasing details early.

@deletedpimaxrep1 @Matthew.Xu @bacon

are you able to give details on eye tracking modul software features? Ie

  • FoV rendering/and or Foveate rendering?

  • Avatar eye mapping (mapping eye movement to Avatar) if a program supports.

    We understand that even once released not all features maybe ready at time of release.

Sorry,we still need more co-work with our partners and also need get the approval from them.

2 Likes

Honestly I wouldn’t get your hopes up. For eye direction and other things sure, but to have an eye tracker acurate enough for foveated rendering would be a huge leap in the technology.
For context here’s Palmer Luckey talking about the current state of eye tracking:

1 Like

Yeah I saw that quite interesting. But in truth hard to say what kind of progress will be made by time of release.

Another interesting idea for use for folks without vision issues that would affect ut from working. Would be ipd setup. In theory might be able to use it to track the eye position to assist ipd setup.

It would ease my mind if pimax would at least say, yes, it is possible to do foveated rendering on the current pimax 8k and we will implement it sometime in the future.

But them refusing to say such a thing, seems to me like, maybe the eye tracker module (or the pimax 8k – eye tracker module combination) does not have the foveated rendering capability at all, for some technical reasons we are not aware of.

Btw, nvidia is onto foveated rendering as well. https://www.roadtovr.com/nvidia-perceptually-based-foveated-rendering-research/ not ssure if they would work with older graphics card though

1 Like

I hear you its a bit of tease. But with the modul being free! Whatever features will be cool as the modul is a gift.

With NDAs its important to honor as the costs of breaching them is very high.

I don’t quite know how ndas work but would saying that the pimax 8K will or will not implement foveated rendering breach it? They don’t even have to mention who their partners are.

And also, I understand that getting a free gift is good, whatever it is. But that will help me make a decision whether I should continue with the pledge or cancel it because my lowly graphics card can’t handle the almighty pimax 8k.

These would all be resolved with a test of a game like arizona sunshine or sairento vr on a gtx 1070 laptop. I believe @Matthew.Xu is still trying to get it done but we’ll see i guess

From what i understand it should be possible. The trouble Palmer discuses is calibration.

The problem with calibration is if the headset shifts during play it will likely need recalibrated or something to that effect.

Me I don’t see why if its calibrated to the ipd. Then i would think as long as its tracking the pupils it should be able to say render a circle/square etc a touch bigger then needed.

The 3d Firephone was neat with its eye tracking display.

1 Like

Not Too worry i am challenging my r9 390 8gig card. Lol

I am confident that I will get stable 75 if not as an owner of a 4k model. Sure 60hz will look nice with brainwarp. But of course will need to wait to see how well it works or not.

& this will vary from person to person. If reducing frequency works well with brainwarp; this could reduce load on the gpu due to reduced bandwidth. While maintaining a higher resolution.

I will repeat once again. The module ITSELF is not even ready, what kind of software can go now it? WELL, NO MODULE, it hasn’t even collected what you want from them right now?

it would be exciting if they pick the Adhawk option and if it is as good as they said. look like no issue to do foveated rendering with it since latency is 10x better than traditional camera based one.

Doubt they will take the adhawk, they promised eye tracking, not foveated rendering

Modul is ready. Not for 8K but for Vive is on the market already and it cost 200$.
It is third part modul and Pimax will let third part to do moduls for Pimax8K.
Pimax policy is to focus on VR only and will alow third part to make modules for it.
Right now they have offer on table from same people who made Vive eye tracking module and they have some other offers as well so only reason it is still not done is because they are choosing better product but will be ready in time. As they say q2 or q3 2018.

2 Likes

Pimax will support Foveated rendering with eye tracking and rift is not. That is why Palmer Lucky trolling about FR.
With eye tracking and FR will be only way to smooth play in 4K per eye with today’s GPU so eye tracking for serious gaming likw in Star citizen, Elite dangerous, Il2 BoS, Some driving sims or DCS.
Only with full 4K per eye PD we will be able to see huge diference in small details like reading instruments in cockpit or spot detailes in distance which in CV1 is just melted with background and it was hard to see.
On superficial look and experiance most of the users will not notice that but after more hours of gameplay in VR and experience you got in spotting enemies in distance make you noncompetitive to people who play on monitors and put you in huge disadvantage. This start to annoying you more than PPD or SDE and make you frustrated so first wow effect of real 3D space soon wanished and it is only reason why some people abandoned playing in VR.
For games like Fruit ninja or Blue, games from 8K presentation even 5K is good model and they work good even on DK2.

Have you seen this module? Where is it, show us and developers how it looks. Maybe then you and the software for the module already, too? Feel free to show us.

I totally agree with Bennus. Pimax wrote in the letter:

Again:

That means the module isn’t finished, yet. They didn’t even decide which partner to work with. What some of you are doing here is only pure speculation. There are nearly no known facts what the features of the eye tracking module will be.
Only thing that is sure is: It will track eyes.

2 Likes

Correct, and this is why I would like to hear from Pimax, not any speculating backer, what they actually are looking to provide when they say eye-tracking. It is obvious that 95% of the users would only have any use for it if capable of foveated rendering (which may or may not have different levels of quality depending on the accuracy of the eye-tracking, I have no idea).
As it stands now, especially with it being promised to backers for free and no further clarifications coming from Pimax although it has been asked multiple times, I fear that it will rather be one of the cases where it is being advertised to tick a box on the user wishlist rather than give us what we are hoping for. Perhaps I am wrong but to me it seems that Pimax are just exploring this without having any deeper understanding yet as to the suitability of what they will provide for foveated rendering of any kind which would substantially reduce GPU load almost unnoticable to the user.

Well until they pick a partner you will have to live with my speculations. XD. I have been very grounded in what i have been talking about. I said clearly not to expect this to mean driver level foveated rendering but that it guarantees the ability to do foveated rendering. And it does, this is not speculation, it is reality.

At an absolute worst case scenario it means eye tracking that allows games which take advantage of that to do foveated rendering etc.

The reason i say this is that aglass, the company they initially reached out to has products for vr out in the market right now, and working playable demos for that product that do foveated rendering. Reddit - Dive into anything
But no magic driver level implementation.

Now if you would like to see some speculation here it is
http://www.aglass.com/ note the 7invensun logo beside a glass on the a glass website.

Note the logo at the start of this video.

My speculation is that you are seeing aglass being used in this video to perform foveated rendering on a game designed to make use of that data input.

Lastly.

Best case scenario is pimax integrate their chosen partners tech to the level that its fove like, driver level foveated rendering.

Anyone noticed how quiet pimax is in this thread? It is highly likely foveated rendering will stay in our wish list for a while.

3 Likes