Sci/Tech The New Science of Seeing Around Corners

tom_mai78101

The Helper Connoisseur / Ex-MineCraft Host
Staff member
Reaction score
1,633
While vacationing on the coast of Spain in 2012, the computer vision scientist Antonio Torralba noticed stray shadows on the wall of his hotel room that didn’t seem to have been cast by anything. Torralba eventually realized that the discolored patches of wall weren’t shadows at all, but rather a faint, upside-down image of the patio outside his window. The window was acting as a pinhole camera — the simplest kind of camera, in which light rays pass through a small opening and form an inverted image on the other side. The resulting image was barely perceptible on the light-drenched wall. But it struck Torralba that the world is suffused with visual information that our eyes fail to see.

“These images are hidden to us,” he said, “but they are all around us, all the time.”

The experience alerted him and his colleague, Bill Freeman, both professors at the Massachusetts Institute of Technology, to the ubiquity of “accidental cameras,” as they call them: windows, corners, houseplants and other common objects that create subtle images of their surroundings. These images, as much as 1,000 times dimmer than everything else, are typically invisible to the naked eye. “We figured out ways to pull out those images and make them visible,” Freeman explained.

The pair discovered just how much visual information is hiding in plain sight. In their first paper, Freeman and Torralba showed that the changing light on the wall of a room, filmed with nothing fancier than an iPhone, can be processed to reveal the scene outside the window. Last fall, they and their collaborators reported that they can spot someone moving on the other side of a corner by filming the ground near the corner. This summer, they demonstrated that they can film a houseplant and then reconstruct a three-dimensional image of the rest of the room from the disparate shadows cast by the plant’s leaves. Or they can turn the leaves into a “visual microphone,” magnifying their vibrations to listen to what’s being said.

 
Last edited by a moderator:
General chit-chat
Help Users
  • No one is chatting at the moment.

      The Helper Discord

      Members online

      No members online now.

      Affiliates

      Hive Workshop NUON Dome World Editor Tutorials

      Network Sponsors

      Apex Steel Pipe - Buys and sells Steel Pipe.
      Top