TR2006-107

Non-photorealistic Camera: Depth Edge Detection and Stylized Rendering using Multi-Flash Imaging


    •  Raskar, R., Feris, R., Yu, J., Turk, M., "Non-photorealistic Camera: Depth Edge Detection and Stylized Rendering Using Multi-flash Imaging", ACM SIGGRAPH, July 2006.
      BibTeX TR2006-107 PDF
      • @inproceedings{Raskar2006jul3,
      • author = {Raskar, R. and Feris, R. and Yu, J. and Turk, M.},
      • title = {Non-photorealistic Camera: Depth Edge Detection and Stylized Rendering Using Multi-flash Imaging},
      • booktitle = {ACM SIGGRAPH},
      • year = 2006,
      • month = jul,
      • isbn = {1-59593-364-6},
      • url = {https://www.merl.com/publications/TR2006-107}
      • }
  • Research Area:

    Computer Vision

Abstract:

We present a non-photorealistic rendering approach to capture and convey shape features of real-world scenes. We use a camera with multiple flashes that are strategically positioned to cast shadows along depth discontinuities in the scene. The projective-geometric relationship of the camera-flash setup is then exploited to detect depth discontinuities and distinguish them from intensity edges due to material discontinuities.We introduce depiction methods that utilize the detected edge features to generate stylized static and animated images. We can highlight the detected features, suppress unnecessary details or combine features from multiple images. The resulting images more clearly convey the 3D structure of the imaged scenes.We take a very different approach to capturing geometric features of a scene than traditional approaches that require reconstructing a 3D model. This results in a method that is both surprisingly simple and computationally efficient. The entire hardware/software setup can conceivably be packaged into a self-contained device no larger than existing digital cameras.

 

  • Related News & Events

    •  NEWS    ACM SIGGRAPH 2006: 7 publications by Paul Beardsley, Ron Perry, Darren Leigh, Ramesh Raskar and Jeroen van Baar
      Date: July 30, 2006
      Where: ACM SIGGRAPH
      Brief
      • The papers "Cartoon Dioramas in Motion" by Raskar, R., Ziegler, R. and Willwacher, T., "Non-photorealistic Camera: Depth Edge Detection and Stylized Rendering Using Multi-flash Imaging" by Raskar, R., Feris, R., Yu, J. and Turk, M., "RFIG Lamps: Interacting with a Self-Describing World via Photosensing Wireless Tags and Projectors" by Raskar, R., Beardsley, P., van Baar, J., Wang, Y., Dietz, P., Lee, J., Leigh, D. and Willwacher, T., "Designing with Distance Fields" by Frisken, S.F. and Perry, R.N., "An Improved Representation for Stroke-based Fonts" by Jakubiak, E.J., Perry, R.N. and Frisken, S.F., "iLamps: Geometrically Aware and Self-configuring Projectors" by Raskar, R., van Baar, J., Beardsley, P., Willwacher, T., Rao, S. and Forlines, C. and "Natural Video Matting using Camera Arrays" by Joshi, N., Matusik, W. and Avidan, S. were presented at ACM SIGGRAPH.
    •