Light Field Cameras, also known as plenoptic cameras, capture both the intensity and direction of light rays within a scene. Unlike traditional cameras that record 2D images, light field cameras record additional information about the direction of incoming light, enabling post-capture adjustments such as refocusing or changing the perspective. Light field cameras are valuable in applications like computational photography and 3D scene reconstruction.

Posts

SVBRDF-Invariant Shape and Reflectance Estimation from a Light-Field Camera

/in /by

Light-field cameras have recently emerged as a powerful tool for one-shot passive 3D shape capture. However, obtaining the shape of glossy objects like metals or plastics remains challenging, since standard Lambertian cues like photo-consistency cannot be easily applied. In this paper, we derive a spatially-varying (SV)BRDF-invariant theory for recovering 3D shape and reflectance from light-field cameras. Our key theoretical insight is a novel analysis of diffuse plus single-lobe SVBRDFs under a light-field setup. We show that, although direct shape recovery is not possible, an equation relating depths and normals can still be derived. Using this equation, we then propose using a polynomial (quadratic) shape prior to resolve the shape ambiguity. Once shape is estimated, we also recover the reflectance. We present extensive synthetic data on the entire MERL BRDF dataset, as well as a number of real examples to validate the theory, where we simultaneously recover shape and BRDFs from a single image taken with a Lytro Illum camera.

Read more