TR2005-047

A Measurement-Based Skin Reflectance Model for Face Rendering and Editing


    •  Tim Weyrich, Wojciech Matusik, Hanspeter Pfister, Jinho Lee, Addy Ngan, Henrik Wann Jensen, Markus Gross, "A Measurement-Based Skin Reflectance Model for Face Rendering and Editing", Tech. Rep. TR2005-047, Mitsubishi Electric Research Laboratories, Cambridge, MA, July 2005.
      BibTeX TR2005-047 PDF
      • @techreport{MERL_TR2005-047,
      • author = {Tim Weyrich, Wojciech Matusik, Hanspeter Pfister, Jinho Lee, Addy Ngan, Henrik Wann Jensen, Markus Gross},
      • title = {A Measurement-Based Skin Reflectance Model for Face Rendering and Editing},
      • institution = {MERL - Mitsubishi Electric Research Laboratories},
      • address = {Cambridge, MA 02139},
      • number = {TR2005-047},
      • month = jul,
      • year = 2005,
      • url = {https://www.merl.com/publications/TR2005-047/}
      • }
  • Research Area:

    Computer Vision

Abstract:

We present a novel skin reflectance model for faces and its application to face appearance editing. We decompose the high-dimensional bidirectional scattering surface reflectance distribution function (BSSRDF) of skin into components that can be estimated from measured data. Our model is intuitive, amenable to interactive rendering, and easy to edit. High-quality renderings come close to reproducing real photographs. We have measured 3D face geometry, skin reflectance, and subsurface scattering for a large group of people using custom-built devices and fit the data to our model. The analysis of the reflectance data reveals variations according to subject age, race, gender, and external factors (heat, cold, makeup, etc.) We derive a low-dimensional model using non-negative matrix factorization (NMF) that spans the spaace of skin reflectance in our database. A user can define meaningful parameters in this space - such as race, gender, and age - and change the overall appearance of a person (e.g. making a Caucasian face look more Asian) or change local features (e.g., adding moles, freckles, or hair follicles).