Computer Graphics

Neural Representations

Learned scene representations, and their reconstruction lineage.

Colour is the family; a dashed line is the second member of it.

Drag to pan · scroll to zoom · click a node to open it · hover one for the reasons on its edges, and to bring it forward
G gaussian-splatting 3D Gaussian Splatting nerf Neural Radiance Fields gaussian-splatting->nerf rasterization Rasterization gaussian-splatting->rasterization stochastic-gradient-descent Stochastic Gradient Descent gaussian-splatting->stochastic-gradient-descent instant-ngp Instant NGP multiresolution-hash-encoding Multiresolution Hash Encoding instant-ngp->multiresolution-hash-encoding mip-nerf Mip-NeRF mip-nerf->nerf multiresolution-hash-encoding->nerf radiative-transfer-equation Radiative Transfer Equation nerf->radiative-transfer-equation nerf->stochastic-gradient-descent neural-radiance-cache Neural Radiance Cache irradiance-caching Irradiance Caching neural-radiance-cache->irradiance-caching path-tracing Path Tracing neural-radiance-cache->path-tracing neural-radiance-cache->stochastic-gradient-descent plenoxels Plenoxels plenoxels->nerf
The 12 reasons on these edges, as text

7 nodes

Neural Radiance Fields

Fits an MLP mapping position and direction to density and colour, then renders it by volumetric ray marching. Optimizing a radiance field directly ag… · 2020

Mip-NeRF

Encodes conical frusta rather than points, so the representation is aware of the footprint each sample covers and stops aliasing when rendered at a d… · 2021

Neural Radiance Cache

Trains a small network online, during rendering, to predict outgoing radiance, so paths can terminate into a learned estimate after a couple of bounc… · 2021

Instant NGP

A fused CUDA implementation built on hash encoding that trains a usable radiance field in seconds rather than hours, which is what turned NeRF from a… · 2022

Multiresolution Hash Encoding

Replaces most of the network's capacity with trainable feature vectors in hash tables at several resolutions, so a tiny MLP suffices and collisions a… · 2022

Plenoxels

Optimizes a sparse voxel grid of spherical harmonic coefficients with no network at all, matching NeRF quality and demonstrating that the neural part… · 2022

3D Gaussian Splatting

Represents the scene as anisotropic Gaussians with spherical harmonic colour and rasterizes them sorted by depth. Explicit primitives and a rasterize… · 2023