The Pit — video to Gaussian splat

Ordinary video in, a real 3D Gaussian splat out, trained locally on one GPU for $0. Every flythrough below is rendered FROM the splat — none of it is source footage.

Each entry says which clip it came from, because the useful finding is which sources reconstruct and which do not.

Lead

The tree, outside — Pip’s home → wide → front gates

Composer EnvironmentVideo, Love Bird Birdhouse — Season 1. Two approved clips joined: “The Palm Tree (master pull-back)” + “The Palm Tree → Front Gates”.

TRIM: the last 0.208s of the gates clip was cut (kept 0→2.00s of 2.208s). From about t=2.06 the front gates begin to swing open, and that motion alone broke the solve — the same clip untrimmed registers 2 of 50 frames. Pip’s door needed no trim: it is shut and static for the whole first leg. Both doors closed in every frame, as instructed.

Left: source video frame. Right: the reconstruction.

Left: a frame of the source video. Right: the trained splat from a camera angle that never existed in the source. Soft, because the source is 95 frames of 854×480 covering a whole tree and a jungle horizon — but the trunk, the nest cavities and the pods are all really there in 3D.

Frames registered
95 / 95 (100%)
COLMAP 3D points
11,426
Gaussians trained
441,526
Trim cut
last 0.208s
Untrimmed, this fails
2 / 50 (4%)
Cost
$0

Family Feud stage

Unreal Engine 5 editor viewport capture — the first source that proved the lane end to end.

Every frame rendered from the trained splat — none of it is the source clip.

Left: source video frame. Right: the reconstruction.

Left: the source video. Right: the reconstruction, from an angle that never existed in the source.

Frames registered
149 / 149 (100%)
COLMAP 3D points
15,218
Gaussians trained
503,133
Source
Real UE capture

Every clip tried

Environment clipFramesRegistered3D pointsVerdict
The tree, outside (trimmed, joined)9595 / 95 — 100%11,426TRAINED
The Pool · orbit6161 / 61 — 100%4,588trained — near-planar, not shown
The Palm Tree (master pull-back)5050 / 50 — 100%5,769passes (leg 1 above)
Pip’s Home — Orbit & Exit6115 / 61 — 24.6%2,710below gate
The Palm Tree → Front Gates (untrimmed)502 / 50 — 4.0%743fails — the moving gates
Pip Home Interior → Exterior612 / 61 — 3.3%53fails — travels through a doorway
Pip’s Home Exterior → The Palm Tree612 / 61 — 3.3%20fails
Wide → Pip’s Home Exterior612 / 61 — 3.3%13fails — ends inside
Bird House · master pan972 / 97 — 2.1%2fails

One honest exception: The Pool orbit registers every frame and trains to 196,843 gaussians, but the camera barely translates, so the result is a near-flat sheet rather than a volume — full marks on the solve, no real depth. It is not shown above, because a splat with no parallax is a photograph wearing a 3D costume. Registration is necessary, not sufficient; what a splat needs is BASELINE. The pattern: clips whose camera stays outside and moves through space reconstruct. Clips that pass through a doorway, or that contain a door in motion, do not — a moving door is geometry that contradicts itself between frames, and structure-from-motion has no way to reconcile it. That is why the trim mattered.