We propose a fully differentiable framework named neural ambient illumination (NeAI), which incorporates Neural Radiance Fields (NeRF) as a physically-based lighting model to handle complex lighting. Our method integrates physically based rendering into NeRF, utilizing roughness-adaptive specular lobe encoding and precise decomposition via the pre-convoluted background.
AAAI 2024 Paper    Project Page