heather coles

Interaction Designer

(425) 310-2014

heather.coles@gmail.com

 

Look 'n Lick:

a Thermo-Ocular Experience

Mood board for Look 'n Lick
Setup day at the 2015 Seattle Maker Faire.
Look 'n Lick Demo video

Look ’n Lick is a multimodal kiosk experience that is controlled through eye tracking & expression recognition. Every play comes with a free custom prize. There are two modules that the exhibit guest interacts with. One module is active while the other is passive. The active input is pointing your eyes at the screen, the active feedback is seeing the bugs on the screen get eaten, the screens response to your eye direction.

Heather with the kiosk on opening day.
 
The kiosk is attracting attention.

It uses the Tobii Eyex Eye-tracker as its controller input and outputs visual feedback on the 19.5” Acer touch-screen monitor. (There is also touch screen interaction that may occur, instructing the player on how to use the eye tracker with a simple, animated diagram. Having a touch screen also helped us with development and troubleshooting.)

 
The first player of the weekend.
 
A happy group of exhibit guests.

 The second interactive module occurs passively. We use a generic webcam running OpenCV over every frame, it detects and quantifies the smile expressions on the face(s) in front of the screen. We select the frame with the highest smile score and print it out with the second module component, a thermal printer. The guest can take with them the receipt documenting their enjoyment of Look ’n Lick. The guest may or may not know about the passive module until the end of the interaction when it prints out for them.

 
Many more smiles.
 
Every person that tried Look 'n Lick left with a free thermal print.
Our youngest guest was 11 months old. There were big smiles on his parents faces as they played through a full cycle of the game.

 

heather coles

Interaction Designer

(425) 310-2014