Offline Deep Importance Sampling for Monte Carlo Path Tracing


Proceedings of Pacific Graphics 2019

Computer Graphics Forum (CGF)
Vol. 38, No. 7, Oct 2019



Abstract


Although modern path tracers are successfully being applied to many rendering applications, there is considerable interest to push them towards ever-decreasing sampling rates. As the sampling rate is substantially reduced, however, even Monte Carlo (MC) denoisers - which have been very successful at removing large amounts of noise - typically do not produce acceptable final results. As an orthogonal approach to this, we believe that good importance sampling of paths is critical for producing better-converged, path-traced images at low sample counts that can then, for example, be more effectively denoised. However, most recent importance-sampling techniques for guiding path tracing (an area known as "path guiding") involve expensive online (per-scene) training and offer benefits only at high sample counts. In this paper, we propose an offline, scene-independent deep-learning approach that can importance sample first-bounce light paths for general scenes without the need of the costly online training, and can start guiding path sampling with as little as 1 sample per pixel. Instead of learning to "overfit" to the sampling distribution of a specific scene like most previous work, our data-driven approach is trained a priori on a set of training scenes on how to use a local neighborhood of samples with additional feature information to reconstruct the full incident radiance at a point in the scene, which enables first-bounce importance sampling for new test scenes. Our solution is easy to integrate into existing rendering pipelines without the need for retraining, as we demonstrate by incorporating it into both the Blender/Cycles and Mitsuba path tracers. Finally, we show how our offline, deep importance sampler (ODIS) increases convergence at low sample counts and improves the results of an off-the-shelf denoiser relative to other state-of-the-art sampling techniques.


Paper and Additional Materials




Bibtex


@article{Bako19,
  	authors = {Bako, Steve and Meyer, Mark and DeRose, Tony and Sen, Pradeep},
  	title   = {Offline Deep Importance Sampling for Monte Carlo Path Tracing},
  	journal = {Computer Graphics Forum (Proceedings of Pacific Graphics 2019)},
  	volume  = {38},
  	number  = {7},
  	pages   = {527--542},
  	year    = {2019},
}


The definitive version of this work was published in CGF and can be accessed through "External URL."

The source code provided on this website is for non-commercial, research purposes only.

This material is partially supported by the National Science Foundation under grants #IIS-1321168 and #IIS-1619376. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.