kraft

the screen surrounded with leds is a good idea but if this experiment fails then it could be possible to kill different light effects that could occur like high beam lights, sun i'm thinking now for some stuff that already exists in industry from long time, i mean an eye tracking system made of cheap hardware.

ideas :

Old glasses that can be dismantled or new one like some cheap safety glasses that can be dismantled too.
Prism, fiber optic to relay optic signal ?
Cheap pin hole camera sensitive to infra-red light or very small camera with tiny lens.
Infra-red led to enlighten the eye whole the time

Mouting a prism or a fiber optic, infra-red led for lighting, while this stuff mounted on the glasses structure to avoid the weight of the camera pcb, don't know if this would work i mean prism or fiber optic for relaying ?

If this could work then using the eye detection code added with some duration could allow a mouse move. We have the bearing, add duration, the mouse cursor could move accordingly to the time and direction with eyes or eye move.

Now to get something really usable beyond the experimental thing, we don't want to get a harness plugged on the side of our head when sitting in the car or get equipment as we were in an aircraft so the reply could be to locate whole the stuff in the middle mirror, behind the chrome surface.

MP3Car.com

 

kraft

if some of you want to play with the code here it is

http://www.r-kraft.com/motempl2.c

it won't work as is, you need to download the Intel's library from sourceforge.

reece146

Just thinking out loud... after seeing your code track hand movements...

Wouldn't it be fairly straightforward (LOL) to read sign language?

You can have a circle/zone/whatever follow each finger and two parts of the palm. Logic dictates that the 7 entities can be only arranged a certain way and then use a LUT (or similar) to match the hand shape/motion to sign language?

JAT

kraft

This would probably be nice but this is not what i'm actually doing and i don't even know how i could do that at the moment but if you want it's just up to you to download the opencv library and give a try to this idea

They are working at the CMU on this axis multimodal recognition and especially turned towards the signs language for people with disabilities.
This would add life comfort for those sadly hit by the life people.

kraft

found a good candidate, an old webcam i found between things to scrap.

I'm installing needed modules and i'll give it a try in the next hours to check how the IR things works, following pupil as i think or not

shotgunefx

I know on one of your installs, the lcd is on top of the dash, but most people and OEM have them slightly out of the line of site of the road. I'm thinking that for those situations, your eyes are going to be looking slightly downards, so headlights might not be as big as a problem.

__________________
GE Cache Builder | me@cardomain |Coolstuff :autospeed.com | bit-tech.net | Nitemax Ultra Pinouts

kraft

Yes this is a good remark you pointed but then it would be another effect, when you look down eyes looks like they are nearly closed when observed from a static camera.
I'll try with several positions of the camera to check what can be the most efficient and usable.

Grrr have to rebuild a kernel because of this unsupported camera losing time, delayed things are harassing

shotgunefx

I hear ya, there was a time I was doing that every other day.

__________________
GE Cache Builder | me@cardomain |Coolstuff :autospeed.com | bit-tech.net | Nitemax Ultra Pinouts

MP3Car.com

 

kraft

ok fixed now

Next will be for tomorrow, on my side it's 00:29, time to sleep a bit. i shortly tried the camera, the IR is giving pretty good results in complete dark.

kraft

Today i modified the code to let it me say using voice synthesis the directions but this was slowing too much the overall result so i left the voice on the side for the moment to focus on the most important.
I simplified the angles readings to get simple directions like N, E, S, W, NE, SE, SW, NW with thisand using counters inside the code, they should play the role of determining how long i watch in one direction. When comparing the elapsed time to a certain amount of pixels i wish to move, i send values to a dummy device. This dummy device using Xlib has for task to get values and move the cursor on the screen.

Don't know if you followed the idea but with simple elements, it's possible to get something roughly designed to be used as starting point to make something usefull

The video showing the result of the simplified output, after that i believe things will be clearer.

http://www.dailymotion.com/video/x2q2ez_dscf1634_tech

kraft

ok on the previous video the interesting part was in the console juste under what camera was displaying. Now one more with IR, i definitely have to build some glasses with a camera at least for the dev time, after that it'll be always time to chose a good camera to be embedded inside the mirror or clipped somewhere on the mirror's structure.

http://www.dailymotion.com/video/x2q4dr_dscf1637_tech

Still perfecting the thing to make it be not polluted by other shadows or light events and to always make the camera be in relation with the pupil in every conditions. Tried the camera cursor redirected to the dummy mouse, it werks

kraft

Should be hopefully a new video in next days for the eye tracking thing and direct access to mouse cursor only by looking at it, this means that detecting angle and sending pulses to the dumy device is not needed anymore. Just look the screen and the mouse cursor is jumping to that position but before that i still have to fix accuracy which sometimes is losing iris

kraft

Last news, finally found a way to lock eyes position in despite of head moves, this will allow me to go to next step, guessing the gaze direction without the hassles to remain in one unique position which is not usable in car environment.

I also found a skin detection algo, the purpose of it will be, once integrated inside the eyes locking program, to detect eye blink and by the way check if it was intentional blink or not, so click or not on the point the eye is looking at.

http://www.dailymotion.com/video/x2s...e-tracker_tech

KaZeR

You're starting to get famous, kraft
You're quoted in severals forums for your voice control : http://www.alionet.org/index.php?showtopic=16882

__________________

NavIt. The Open Source vector based Navigation software with routing engine.

kraft

lol i'm not famous and i don't care.
I thought that this version of perlbox could be usefull for people with disabilities to use it at home but it seems more that no one is interested with french voice recognition

While i'm here, i have insulated the iris but i still have troubles with filtering, sometimes for unknown reason and while the iris is well insulated from the background and displayed, the library has difficulties to extract the shape. I'll try some other strategic way of filtering but i have the feeling that i'm very near of final result, at least the pupils only are displayed in live image. I also have to find a way to get relative movement of pupils to the targeted area (eyes) instead of the whole image.
This is necessary to avoid a camera hanging on glasses.

MP3Car.com