Gate3DGen selectively purifies real-world images while bypassing inputs classified as clean, improving downstream 3D generation without retraining the 3D generator.
Gate3DGen improves 3D generation by purifying real-world image inputs. Each example compares the same frozen 3D generator conditioned on the observed image (top) and our purified image (bottom). The examples show occlusion removal, illumination correction, and reflection suppression, with reduced extraneous geometry, contour distortions, and surface artifacts.
Abstract
Single-image 3D generation has achieved high fidelity on curated benchmarks, yet degrades sharply on real-world images with uneven illumination, blur, and occlusions. Purifying such inputs requires deciding when to intervene and preserving the visual cues needed for 3D generation. We introduce Gate3DGen, a selective pre-processing model that gates image inputs to existing 3D generators without retraining them. A degradation-aware router bypasses inputs classified as clean and extracts features to guide purification of the remaining inputs. Conditioned on these features, a 3D-oriented one-step purifier purifies degraded inputs with spatial losses that encourage preservation of object identity, contours, and textural cues. To provide paired supervision, we construct a synthetic data engine that renders clean views of 3D assets and synthesizes composite degradations. On the synthetic benchmark, the purifier improves image fidelity and downstream 3D geometry, reducing TRELLIS.2 mesh distance by 61.5% relative to degraded inputs. VLM evaluation and human preferences on real photographs further support identity preservation and degradation correction.
Method
Overview of Gate3DGen.(A) Data Engine. We render 3D assets from multi-view, select informative anchor views, and apply composite degradations to construct aligned observation-reference pairs (xo, xc). (B) Gate3DGen. Router 𝓡φ bypasses inputs classified as clean (γ̂ = 0). Otherwise (γ̂ = 1), its features h guide the one-step DiT purifier 𝓒θ. The image x̂c conditions the frozen 3D generator 𝓖, with clean references and spatial losses used only during training.
Results
Comparison
Legacy comparison
Archived comparison layout
Compare synchronized 2D images, rendered turntable videos, or live 3D assets with an automatic detail tour followed by linked manual inspection.
Select case
Inspect
RotatingObject identity and occluder fusion
Paper Case 03 · overexposure
Observed inputOriginal → Pixal3D
DETAIL · 3 SEC
FireRed-Image-EditEdited → Pixal3D
DETAIL · 3 SEC
GPT Image-2.5Edited → Pixal3D
DETAIL · 3 SEC
Gate3DGenPurified → Pixal3D
DETAIL · 3 SEC
3D GTGround-truth 3D asset
DETAIL · 3 SEC
Loading 3D assetsThe automatic tour locks interaction until one complete rotation finishes.
Observed inputOriginal → Pixal3D
DETAIL · 3 SECAUTO TOUR · CONTROLS LOCKED
FireRed-Image-EditEdited → Pixal3D
DETAIL · 3 SECAUTO TOUR · CONTROLS LOCKED
GPT Image-2.5Edited → Pixal3D
DETAIL · 3 SECAUTO TOUR · CONTROLS LOCKED
Gate3DGenPurified → Pixal3D
DETAIL · 3 SECAUTO TOUR · CONTROLS LOCKED
3D GTGround-truth 3D asset
DETAIL · 3 SECAUTO TOUR · CONTROLS LOCKED
After the automatic tour: drag any model to rotate all views · scroll or pinch any model to zoom all views · double-click any model to reset the linked camera.
Observed inputOriginal image
FireRed-Image-EditRepaired image
GPT Image-2.5Repaired image
Gate3DGenPurified image
Clean GTClean oracle reference
Scroll zooms all images together · Drag pans all images together · Double-click resets the shared view
RotateZoom & inspect · 3sContinue rotating
Citation
@article{li2026gate3dgen,
title = {Gate3DGen: A Pre-processing Model that Selectively Purifies Real-World Images for 3D Generation},
author = {Li, Xiaolin and Huang, Zihao and Meng, Fanpeng and Yang, Chen and Wu, Guanjun and Zhang, Kai and Fang, Jiemin and Tian, Qi},
journal = {arXiv preprint},
year = {2026}
}