Neural Radiance Fields

Computer Graphics · Neural Representations · 2020 · also: NeRF · nerf.yaml

Fits an MLP mapping position and direction to density and colour, then renders it by volumetric ray marching. Optimizing a radiance field directly against photographs sidestepped reconstruction entirely.

• supersedescorrects · extends
• classifiesspecializes · part-of
• substitutes forapproximates · alternative-to
• depends onrequires · validates

Colour is the family; a dashed line is the second member of it.

This node

• specializesis a specific case of Radiative Transfer Equationan MLP supplies density and colour along the ray
• requiresdoes not work without Stochastic Gradient Descentthe field is fitted to photographs by gradient descent

Referenced by

• alternative-to3D Gaussian Splatting is a competing approach to thisrasterizes explicit primitives instead of querying a field
• correctsMip-NeRF fixes a defect in thispoint samples alias when rendered at another scale
• correctsMultiresolution Hash Encoding fixes a defect in thisthe deep MLP, not the idea, is what made it slow
• correctsPlenoxels fixes a defect in thisa sparse grid works too; the network was not the point

References

• NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis — Mildenhall, Srinivasan, Tancik, Barron, Ramamoorthi, Ng — 2020 · link
• Background — Neural radiance field on Wikipedia