The MIT Media Lab’s Pranav Mistry recounted the history of his SixthSense project at TED India this week. SixthSense started when Mistry took the rollers out of two computer mice (mouses?), attached some pulleys, and made a glove-like hand-gesture interface. Moving through SixthSense’s evolution, Mistry talks about some Internet-synced sticky notes, pens that draw in three dimensions, Google maps that interact with physical objects, and other things that, if said by anyone else, would just be crazy talk.

From there, he explains how he inverted the process, in an effort to “paint the physical world with that digital information.” He started with a projector mounted on his bike helmet that would project pixels onto the physical world. He added a camera and the system eventually shrank down to the pendant we recognize as the current incarnation of SixthSense.

In the video, Mistry demonstrates the system by casually doing things that shouldn’t make any sense: Digitally painting on a physical wall, taking a photo of the Boston skyline by framing it with his index fingers and thumbs, dialing a phone number on numbers projected on his palm, watching video of President Obama’s MIT speech on a print newspaper; reading a tag cloud — “comedian,” “geek,” etc. — that appears on comedian/blogger Baratunde Thurston’s shirt when Mistry meets him; playing a video game on a piece of paper; and copying text and charts from the regular kind of paper and pasting them to his crazy, digital paper, just by picking it up and moving it.