Look 'n Lick:

Look ’n Lick is a multimodal kiosk experience that is controlled through eye tracking and expression recognition. Every play comes with a custom free prize. There are two modules that the exhibit guest interacts with. One module is active while the other is passive. The active input is pointing your eyes at the screen, the active feedback is seeing the bugs on the screen get eaten, the screens response to your eye direction. It uses the Tobii Eyex Eye-tracker as its controller input and outputs visual feedback on the 19.5” Acer touch-screen monitor. (There is also touch screen interaction that may occur, instructing the player on how to use the eye tracker with a simple, animated diagram. Having a touch screen also helped us with development and troubleshooting.) The second interactive module occurs passively. We use a generic webcam running OpenCV over every frame, it detects and quantifies the smile expressions on the face(s) in front of the screen. We select the frame with the highest smile score and print it out with the second module component, a thermal printer. The guest can take with them the receipt documenting their enjoyment of Look ’n Lick. The guest may or may not know about the passive module until the end of the interaction when it prints out for them.

Heather with the kiosk on opening day.

The first player of the weekend.

A happy group of exhibit guests.