Machine Learning Is the Solution Also for Foveated Path Tracing Reconstruction
Lotvonen,Atro; Koskela,Matias; Jääskeläinen,Pekka (2020-02)
02 / 2020
This publication is copyrighted. You may download, display and print it for Your own personal use. Commercial use is prohibited
Julkaisun pysyvä osoite on
Real-time photorealistic rendering requires a lot of computational power. Foveated rendering reduces the work by focusing the effort to where the user is looking, but the very sparse sampling in the periphery requires fast reconstruction algorithms with good quality. The problem is even more complicated in the field of foveated path tracing where the sparse samples are also noisy. In this position paper we argue that machine learning and data-driven methods play an important role in the future of real-time foveated rendering. In order to show initial proofs to support this opinion, we propose a preliminary machine learning based method which is able to improve the reconstruction quality of foveated path traced image by using spatio-temporal input data. Moreover, the method is able to run in the same reduced foveated resolution as the path tracing setup. The reconstruction using the preliminary network is about 2.9ms per 658 × 960 frame on a GeForce RTX 2080 Ti GPU.
- TUNICRIS-julkaisut 
Näytetään aineisto, joilla on samankaltaisia nimekkeitä, tekijöitä tai asiasanoja.
Smirnov,Sergey; Gotchev,Atanas; Hannuksela,Miska
IEEE International Conference on Multimedia and Expo (2013)
Joint de-noising and fusion of 2D video and depth map sequences sensed by low-powered tof range sensor Georgiev,Mihail; Gotchev,Atanas; Hannuksela,Miska
IEEE International Conference on Multimedia and Expo (Institute of Electrical and Electronics Engineers IEEE, 2013)
Georgiev,Mihail; Gotchev,Atanas; Hannuksela,Miska
IEEE International Symposium on Circuits and Systems (Institute of Electrical and Electronics Engineers IEEE, 2013)