Reaigen
SKEN

Reaigen technology

The technology behind Reaigen’s 3D tours: a working prototype of live, feed-forward 3D reconstruction from a camera stream, and our research papers.

Live 3D reconstruction

Walk through a home with a phone and watch it become 3D as you go. Our Reaigen-VGGT prototype builds the scene from what the camera sees in real time: images stream straight into the model, which adds each one to the 3D in a single feed-forward pass. It doesn’t wait for the whole capture to be collected and solved together, and it needs no depth sensor.

The apartment was scanned with an iPhone 15 Pro, the room with a Samsung Galaxy S24. Press play to watch the scan build up with the camera positions, then drag to look around. Research prototype.

Scene repair

Reaigen-VGGT is a prototype that already does the heavy lifting of turning a camera stream into 3D. By default it is not yet precise to 1 mm, so repair tightens the result: it corrects the camera layout and removes doubled surfaces, and the same scan comes out as one clean scene.

Live scan
Live scan
Repaired
Repaired
< 2 minUsual repair time after a scan
LiveIn parallel with the scan, with auto-repair on a second GPU

Explore the repaired room in 3D

Spinoff rendering engine

After the scan, Spinoff takes over. It is our own rendering engine for Gaussian splats: it draws scenes of millions of splats in real time directly in the browser, and brings the same spaces at full scale to Apple Vision Pro.

This runs live in your browser: pick a scene, drag to look around and use W, A, S and D to move. The coastline has 10 million splats and is a 133 MB download. Marienplatz and the Graz church are from TerraSky3D (D’Urso et al., TU Graz / Sony, CC BY 4.0); Garden, Kitchen, Room, Counter, Bicycle, Stump and Treehill are from the Mip-NeRF 360 benchmark.

Papers