TR2007-117

Factored Time-Lapse Video

    •  Sunkavalli, K., Matusik, W., Pfister, H., Rusinkiewicz, S., "Factored Time-Lapse Video", ACM Transactions on Graphics (TOG), Vol. 26, No. 3, July 2007.
      BibTeX TR2007-117 PDF
      • @article{Sunkavalli2007jul,
      • author = {Sunkavalli, K. and Matusik, W. and Pfister, H. and Rusinkiewicz, S.},
      • title = {Factored Time-Lapse Video},
      • journal = {ACM Transactions on Graphics (TOG)},
      • year = 2007,
      • volume = 26,
      • number = 3,
      • month = jul,
      • issn = {0730-0301},
      • url = {https://www.merl.com/publications/TR2007-117}
      • }
  • Research Area:

    Computer Vision

TR Image
We decompose a time-lapse sequence of photographs (a) into sun, sky, shadow, and reflectance components. The representation permits re-rendering without shadows (b) and without skylight (c), or modifying the reflectance of surfaces in the scene (d).
Abstract:

We describe a method for converting time-lapse photography captured with outdoor cameras into Factored Time-Lapse Video (FTLV): a video in which time appears to move faster (i.e., lapsing) and where data at each pixel has been factored into shadow, illumination, and reflectance components. The factorization allows a user to easily relight the scene, recover a portion of the scene geometry (normals), and to perform advanced image editing operations. Our method is easy to implement, robust, and provides a compact representation with good reconstruction characteristics. We show results using several publicly available time-lapse sequences.

 

  • Related News & Events

    •  NEWS    ACM Transactions on Graphics (TOG): 6 publications by Ashok Veeraraghavan, Jay Thornton, Amit Agrawal, John Barnwell and others
      Date: July 15, 2007
      Where: ACM Transactions on Graphics (TOG)
      Brief
      • The articles "Prakash: Lighting Aware Motion Capture using Photosensing Markers and Multiplexed Illuminators" by Raskar, R., Nii, H., deDecker, B., Hashimoto, Y., Summet, J., Moore, D., Zhao, Y., Westhues, J., Dietz, P., Barnwell, J., Nayar, S., Inami, M., Bekaert, P., Noland, M., Branzoi, V. and Bruns, E., "Dappled Photography: Mask Enhanced Cameras for Heterodyned Light Fields and Coded Aperture Refocusing" by Veeraraghavan, A., Raskar, R., Agrawal, A., Mohan, A. and Tumblin, J., "Seam Carving for Content-Aware Image Resizing" by Avidan, S. and Shamir, A., "Factored Time-Lapse Video" by Sunkavalli, K., Matusik, W., Pfister, H. and Rusinkiewicz, S., "Post-production Facial Performance Relighting using Reflectance Transfer" by Peers, P., Tamura, N., Matusik, W. and Debevec, P. and "Multi-scale Capture of Facial Geometry and Motion" by Bickel, B., Botsch, M., Angst, R., Matusik, W., Otaduy, M., Pfister, H. and Gross, M. were published in ACM Transactions on Graphics (TOG).
    •