Why Creating 'Gaussian Splats' Will Become Your Favorite Way to Preserve Family Memories

My question about virtual reality has always been, "But what is it for?" I finally have an answer: Guassian Splatting. We've always tried to capture our past, whether it's through physical photographs, VHS tapes, or every picture you have stored in the cloud, but we've been limited to viewing our personal histories in flat media, usually from a behind a screen, and always from a single angle. But Gaussian Splatting changes that. This technology allows you to create volumetric 3D models of objects, people, or spaces, so instead of a picture of your child's favorite toy, you can have a realistic scan of it that you can examine from every angle; instead of a snapshot of Thanksgiving dinner, you can have a photorealistic diorama of the dining room that you can walk around.

What is Gaussian Splatting?

Gaussian Splatting is a technological newborn. It was first theoretically introduced in a 2023 research paper by Bernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, and George Drettakis. The paper details a new rendering technique that builds 3D models out of millions of semi-transparent blobs called "Gaussians" instead of the solid triangles used in traditional computer graphics. Once calculated, the Gaussians are "Splatted" onto a 2D plane by your computer, and that is arranged and layered based on how they should look from any viewpoint within the Splat. Because the blobs are semi-transparent, they don't block each other. They blend together like brushstrokes in a painting.

Another bonus: Splatting provides a much higher level of detail for its file size compared to traditional methods of scanning. Older scans work on a the geometric principle of stretching a virtual skin made of triangles over an object. For a detailed scan, that could be billions of triangles, resulting in PC-choking file sizes. Splatting is based on mathematical probability rather than rigid geometry. Instead of a solid edge, each "blob" is a tiny cloud that tells the computer how likely a color is to exist in that spot. It only stores the position, color, and transparency of millions of relevant areas in space, as well as how they should reflect light from different angles. The result is files that are big compared to Word documents, but not so huge that you can't work with them on a phone.

You May Also Like

Gaussian Splatting quickly went from theory to practice, and now Splats can be created and rendered with only a decent smartphone, making it more accessible than older methods that sometimes required laser scanners or specialized equipment.

Why you should start Splatting

3D scanning is already in use professionally in things like mapping real estate for virtual tours and creating photorealistic assets for video games, but Gaussian Splatting is accessible enough that anyone can future-proof their nostalgia.

Splatting gives your future self (or your kids) the ability to "visit" your current life with a level of realism that's breathtaking. It lets you digitally "bottle" the exact layout and volume of a moment in time and preserve it. If your parents had this, you'd be able to walk around your childhood bedroom, or check out every angle and detail of the first car you ever bought.

"Digital preservation" and "3D modeling" sound clinical, but the results of Gaussian Splats are anything but sterile. While photography captures a single angle of light in a room, Gaussian Splats capture the behavior of light from all angles, so the result isn't what the past looks like, but what the past feels like. It's hard to describe, but capturing the quality of light on an object or location puts you in touch with it in a way you didn't think possible. That combined with the haziness of Spats and your own memories adds up to a ethereal, dreamlike experience that isn't like anything else. (I like Splats a lot.)

How to get started Splatting

The barrier to entry for Splatting is just a little time to figure out how it works. You don't need a specialized LiDAR scanner or an overpowered PC, just a relatively recent smartphone. Here's how to get started:

Pick an app: Though the technology is new, a few apps are making it very user-friendly. Here are the two I've tried:

- Scaniverse: Excellent for iPhone users, Scaniverse is free, and it processes Splats entirely on your device in only a minute or two.

- Luma 3D Capture: Available on both Android and iPhone, Luma is great for beginners, with a scanning process that walks you through creating your first Splat.

Make a capture: Here are some things to think about when making your capture.

- Before you start scanning locations or bigger objects, pick something small and simple so you get the concepts down. But not pets: Your subject has to remain perfectly still through the process. (Make an exception for your child. They won't hold still enough, but having even a blurry model of your kid is vital for future you.)

- Place your subject in an evenly lit room with enough space to walk all the way a