Jump to content

Free face tracking - No lamps, reflexes or anything - that WORKS!


Recommended Posts

Great news everyone!

 

FaceTrackNoIR is an application that uses a webcam to track face movements in real time.

 

 

NEW METHOD as of 20 aug 2010:

 

Go to http://sourceforge.net/projects/facetracknoir/files/ get the program and the Update_FaceTrackNoIR_20100716 TrackIR.zip Second Update

 

Then go to naturalpointofview.blogspot.com/p/trackirfixer.html and follow instructions. Real simple.

 

 

 

OLD:

 

Go to http://sourceforge.net/projects/facetracknoir/files/ get the program and the Update_FaceTrackNoIR_20100716 TrackIR.zip Second Update

 

Then get ppjoy0846testrelease.exe from here: http://ppjoy.blogspot.com/2010/03/new-test-release.html

 

First, open the windows control panel and find your PPJoy controlpanel. Make a new joystick. I called mine Joystick 10 and set it like this:

 

kontrolpanel2.jpg

 

We should get 6 DOF but, alas, poor Yorrick. Perhaps something we can work on. I cant get FaketrackIR working under Game Protocol. I tried running PPJoy -> TrackIR4Fun also to no avail. One of those would be killer so please post if you find a solution to this.

 

 

Then open the FaceTrackNoIR. Here's how I set it up:

 

headtrack2.jpg

The program tracks your face through webcam. This is my built-in laptop cam and I get 0% CPU but only 20fps - this must be a limitation in the cheapo webcam that Dell puts there.

 

If you disable EWMA filtering, you get a much sharper and faster reacting result. Ahhh, lots of tinkering to do. All of this is great for the more anal type that likes these kinds of things. :thumbup:

 

Set the Game Protocol to Virtual Joystick and select Joystick 10 under setting. See? Joystick 10, our friend from before :D Now, we are sending the values from the headtracking to Joystick 10, which is a virtual joystick, and NOW we can go to our simulator and set things up.

 

This is the good part:

 

headtrack1.jpg

 

Inverse the X and Y axis, set your deadzones as you like it and its up up up and AWAY! :pilotfly:

 

No Wii controllers, no soldering and setting the cat on fire, no old caps with a flashlight, no taping bicycle lamps to your face. Just you and the good old webcam :)

 

Let me know if it works out for ya.

 

PS: I am running this on Win7 x64

 

PPS: If the FaceTrackNoIR installer or program says it's missing dll or similar, try getting FaceAPI: http://www.seeingmachines.com/product/faceapi/downloads/ - request a non commercial license, its automated and takes 1 minute.


Edited by RipKirby
Better method
  • Like 1
Link to comment
Share on other sites

  • Replies 390
  • Created
  • Last Reply

Top Posters In This Topic

I have a tir 4 so I don't need to give it a go but I always thought the precision would not be as good. Actual usage beats my theory/guessing though so I am interested to see how it performs for people.

 

I know from other interests that finding the center of a blob like tir does can be done with sub pixel accuracy easily and quickly. Finding facial positions with the same accuracy may not be possible at all or would take up serious cpu.

 

So it would be good to see in real life what it behaves like, they probably have some serious smoothing built in to stop the jerkyness that I would expect.

Link to comment
Share on other sites

I have a tir 4 so I don't need to give it a go but I always thought the precision would not be as good. Actual usage beats my theory/guessing though so I am interested to see how it performs for people.

 

I know from other interests that finding the center of a blob like tir does can be done with sub pixel accuracy easily and quickly. Finding facial positions with the same accuracy may not be possible at all or would take up serious cpu.

 

So it would be good to see in real life what it behaves like, they probably have some serious smoothing built in to stop the jerkyness that I would expect.

 

You are absolutely right. There is filtering built in - the mission is to find a balance between jitter/smoothness and update speed. Now, my webcam is shitpoor so I get very low fps which makes everything a lot harder.

 

You can see the same setup in IL-2 here:

Link to comment
Share on other sites

That didn't look too bad at all. Of course it's hard to judge how it feels to the user as far as lag etc.

 

I hope it does well, when I feel the need to upgrade I will certainly give it a go before spending a lot of $$$.

 

It would be a nice feeling to play something with speakers on, loking around with nothing on your head :)

Link to comment
Share on other sites

I'm too tired to muck with it right now but I'd love to hear what everyone is doing with it, what is your settings and how does it behave. What are your FPS and how does the filter behave on your rigs. See yall tomorrow.


Edited by RipKirby
Link to comment
Share on other sites

I have only 1800 Mhz... when I turned it on it freezed my PC and I needed to do hard restart lol.

Reminder: Fighter pilots make movies. Bomber pilots make... HISTORY! :D | Also to be remembered: FRENCH TANKS HAVE ONE GEAR FORWARD AND FIVE BACKWARD :D

ಠ_ಠ



Link to comment
Share on other sites

Nice find RipKirby. I had a quick play with this just now, got it working in Black Shark, although I need more time tinkering with settings yet before I can say if it's any good at this stage.

 

When you get a good result, please let us know what your settings are.

Link to comment
Share on other sites

RipKirby so all that is needed to have a ''trackIR'' is a webcamera?:joystick:

if yes - that awesome:smilewink:

 

That would be a yes - still some experimenting to do to get a really smooth result, at least with my built-in laptop webcam.

Link to comment
Share on other sites

When you get a good result, please let us know what your settings are.

 

Well, I tried to simplify things by starting with just 2 axis; the two most useful in game, x-rotation and y-rotation. I tried your smoothing and filtering settings to begin with. The motion was very stuttery and my first thoughts were this is the limitation of the webcam (also inbuilt laptop). I adjusted and turned off filtering and set smoothing to 0. This gave a huge improvement, and was quite useable (with the 2-axis). I've gone upto four axis now and it's become more tricky to get stable results. Centering is off and the axis tend to be more sensitve in one direction than the other. I need to play some more, but there's huge potential with this software, particularly if the team keep developing it and don't jump like Cachya did.

Valve Index | RTX 3070 Ti (Mobile) | i7-12700H @ 2.7GHz | 16GB RAM

Link to comment
Share on other sites

facetrack.jpg

 

Decent results with these settings and a good starting point for anyone wanting to give this a go. However the = key isn't resetting my view so I'm staring down into the cockpit. Also, notice the X and Y movement is less smooth when compared with X & Y rotation. Not sure why this is.

  • Like 1

Valve Index | RTX 3070 Ti (Mobile) | i7-12700H @ 2.7GHz | 16GB RAM

Link to comment
Share on other sites

Im getting errors, ippcore-5.3...

 

Is this because I dont have trackir? I followed OP instructions, downloaded facetracknoir, update, installed update, ran it, ippcore error.

 

Any ideas?

 

You don't need trackir, only a webcam. Did you download & install Face API? If not request a non-commercial license from here:-

http://www.seeingmachines.com/product/faceapi/downloads/


Edited by martinistripes

Valve Index | RTX 3070 Ti (Mobile) | i7-12700H @ 2.7GHz | 16GB RAM

Link to comment
Share on other sites

  • Recently Browsing   0 members

    • No registered users viewing this page.
×
×
  • Create New...