heather coles

Interaction Designer

(425) 310-2014

heather coles

Interaction Designer

(425) 310-2014

I'm an Interaction Designer who specialispes in User eXperience and User Interfaces from Seattle. This page documents my currently touring exhibit.
If you're a venue, please contact me at

heather.coles@gmail.com.

 
Mood board for Look 'n Lick

Look 'n Lick:

a Thermo-Ocular Experience

Look ’n Lick is a multimodal kiosk experience that is controlled through eye tracking and expression recognition. Every play comes with a custom free prize. There are two modules that the exhibit guest interacts with. One module is active while the other is passive. The active input is pointing your eyes at the screen, the active feedback is seeing the bugs on the screen get eaten, the screens response to your eye direction. It uses the Tobii Eyex Eye-tracker as its controller input and outputs visual feedback on the 19.5” Acer touch-screen monitor. (There is also touch screen interaction that may occur, instructing the player on how to use the eye tracker with a simple, animated diagram. Having a touch screen also helped us with development and troubleshooting.) The second interactive module occurs passively. We use a generic webcam running OpenCV over every frame, it detects and quantifies the smile expressions on the face(s) in front of the screen. We select the frame with the highest smile score and print it out with the second module component, a thermal printer. The guest can take with them the receipt documenting their enjoyment of Look ’n Lick. The guest may or may not know about the passive module until the end of the interaction when it prints out for them.

 
Look 'n Lick Demo video
 
Setup day at the 2015 Seattle Maker Faire.
 
Heather with the kiosk on opening day.
 
The first player of the weekend.
 
The kiosk is attracting attention.
 
A happy group of exhibit guests.
 
Many more smiles.
 
Every person that tried Look 'n Lick left with a free thermal print.
 
Our youngest guest was 11 months old. There were big smiles on his parents faces as they played through a full cycle of the game.

heather coles

Interaction Designer

(425) 310-2014