README

Instant Neural Graphics Primitives !

 

Ever wanted to train a NeRF model of a fox in under 5 seconds? Or fly around a scene captured from photos of a factory robot? Of course you have!

Here you will find an implementation of four __neural graphics primitives__, being neural radiance fields (NeRF), signed distance functions (SDFs), neural images, and neural volumes.
In each case, we train and render a MLP with multiresolution hash input encoding using the __tiny-cuda-nn__ framework.

 __Instant Neural Graphics Primitives with a Multiresolution Hash Encoding__  
 Thomas Müller, Alex Evans, Christoph Schied, Alexander Keller  
 _ACM Transactions on Graphics (__SIGGRAPH__), July 2022_  
 __Project page / Paper / Video / Presentation / Real-Time Live / BibTeX__

For business inquiries, please submit the NVIDIA research licensing form.


 Installation

If you have Windows, download one of the following releases corresponding to your graphics card and extract it. Then, start instant-ngp.exe.

- RTX 5000 series and other Blackwell cards
- RTX 3000 & 4000 series, RTX A4000–A6000, and other Ampere & Ada cards
- RTX 2000 series, Titan RTX, Quadro RTX 4000–8000, and other Turing cards
- GTX 1000 series, Titan Xp, Quadro P1000–P6000, and other Pascal cards

Keep reading for a guided tour of the application or, if you are interested in creating your own NeRF, watch the video tutorial or read the written instructions.

If you use Linux, or want the developer Python bindings, or if your GPU is not listed above (e.g. Hopper, Volta, or Maxwell generations), you need to build __instant-ngp__ yourself.


 Usage



__instant-ngp__ comes with an interactive GUI that includes many features:
- comprehensive controls for interactively exploring neural graphics primitives,
- VR mode for viewing neural graphics primitives through a virtual-reality headset,
- saving and loading "snapshots" so you can share your graphics primitives on the internet,
- a camera path editor to create videos,
- NeRF-Mesh and SDF-Mesh conversion,
- camera pose and lens optimization,
- and many more.


 NeRF fox

Simply start instant-ngp and drag the data/nerf/fox folder into the window. Or, alternatively, use the command line:

sh
instant-ngp$ ./instant-ngp data/nerf/fox




You can use __any__ NeRF-compatible dataset, e.g. from original NeRF, the SILVR dataset, or the DroneDeploy dataset. To create your own NeRF, watch the video tutorial or read the written instructions.

 SDF armadillo

Drag data/sdf/armadillo.obj into the window or use the command:

sh
instant-ngp$ ./instant-ngp data/sdf/armadillo.obj




 Image of Einstein

Drag data/image/albert.exr into the window or use the command:

sh
instant-ngp$ ./instant-ngp data/image/albert.exr




To reproduce the gigapixel results, download, for example, the Tokyo image and convert it to .bin using the scripts/convert_image.py script. This custom format improves compatibility and loading speed when res