Grafiti is a Gesture Recognition mAnagement Framework for Interactive Tabletop Interfaces. The infrastructure, using the TUIO protocol, supports multi-touch interactions, with particular regard to the use of tangible objects.
Get the Code:
http://code.google.com/p/grafiti/
Read about the TUIO Protocol [PDF]
Read More
http://grafitiproject.wordpress.com/