How to have hand gesture recognition with OpenCV

[jumpingFox]

I am new to Ubuntu, and have installed OpenCV for one of my projects. Basically what I want to do is to recognize simple hand gestures (move left, move right, etc). I looked at HandVu but that has only been done for Windows & Mac. Can anyone point me to a OpenCV library for Ubuntu which would enable me to get hand gesture recognition working. Any help would be appreciated. The library can also be outside OpenCV.

Thanks.