Learning to Estimate Intrinsic Images

Mr. Marshall Tappen
Thursday, March 23, 2006
1:30PM - CSB 232

Abstract


The goal of computer vision is to use an image to recover the characteristics of a scene, such as its shape or illumination. This is difficult because an image is the mixture of multiple characteristics. For example, an edge in an image could be caused by either an edge on a surface or change in the surface's color. Distinguishing the effects of different scene characteristics is an important step towards high-level analysis of an image.

In this talk, I will show how to use machine learning to build a system that isolates the effects of two important characteristics of a scene, its shading and reflectance, from a single image. From the observed image, the system estimates a shading image, which captures the interaction of the illumination and shape of the scene pictured, and an albedo image, which represents how the surfaces in the image reflect light. Measured both qualitatively and quantitatively, this system produces state-of-the-art estimates of shading and albedo images. I will also show how this system is flexible enough to be applied to the problem of denoising images.

Short Bio


Marshall Tappen is a PhD candidate in the Computer Science and Artificial Intelligence Laboratory at the Massachusetts Institute of Technology. He graduated with a BS in Computer Science from BYU in 2000 and received a SM degree in Electrical Engineering and Computer Science from MIT in 2002. He is the recipient of the National Defense Science and Engineering Graduate (NDSEG) Fellowship.