PREPRINT · 2026

Gate3DGen: A Pre-processing Model that Selectively Purifies Real-World Images for 3D Generation

*Equal Contribution. ‡Project Lead. ✉Corresponding Authors.

1Tsinghua University · 2Huawei Inc. · 3Huazhong University of Science and Technology

TL;DR

Gate3DGen selectively purifies real-world images while bypassing inputs classified as clean, improving downstream 3D generation without retraining the 3D generator.

Gate3DGen examples comparing 3D generation from observed and selectively purified images
Gate3DGen improves 3D generation by purifying real-world image inputs. Each example compares the same frozen 3D generator conditioned on the observed image (top) and our purified image (bottom). The examples show occlusion removal, illumination correction, and reflection suppression, with reduced extraneous geometry, contour distortions, and surface artifacts.

Abstract

Single-image 3D generation has achieved high fidelity on curated benchmarks, yet degrades sharply on real-world images with uneven illumination, blur, and occlusions. Purifying such inputs requires deciding when to intervene and preserving the visual cues needed for 3D generation. We introduce Gate3DGen, a selective pre-processing model that gates image inputs to existing 3D generators without retraining them. A degradation-aware router bypasses inputs classified as clean and extracts features to guide purification of the remaining inputs. Conditioned on these features, a 3D-oriented one-step purifier purifies degraded inputs with spatial losses that encourage preservation of object identity, contours, and textural cues. To provide paired supervision, we construct a synthetic data engine that renders clean views of 3D assets and synthesizes composite degradations. On the synthetic benchmark, the purifier improves image fidelity and downstream 3D geometry, reducing TRELLIS.2 mesh distance by 61.5% relative to degraded inputs. VLM evaluation and human preferences on real photographs further support identity preservation and degradation correction.

Method

Gate3DGen pipeline with synthetic data engine, degradation-aware router, one-step purifier, and frozen 3D generation
Overview of Gate3DGen. (A) Data Engine. We render 3D assets from multi-view, select informative anchor views, and apply composite degradations to construct aligned observation-reference pairs (xo, xc). (B) Gate3DGen. Router 𝓡φ bypasses inputs classified as clean (γ̂ = 0). Otherwise (γ̂ = 1), its features h guide the one-step DiT purifier 𝓒θ. The image x̂c conditions the frozen 3D generator 𝓖, with clean references and spatial losses used only during training.

Results

Comparison

Citation

@article{li2026gate3dgen,
  title   = {Gate3DGen: A Pre-processing Model that Selectively Purifies Real-World Images for 3D Generation},
  author  = {Li, Xiaolin and Huang, Zihao and Meng, Fanpeng and Yang, Chen and Wu, Guanjun and Zhang, Kai and Fang, Jiemin and Tian, Qi},
  journal = {arXiv preprint},
  year    = {2026}
}
Figure preview

Pinch or use the browser zoom controls to inspect details. Rotate a phone to landscape for a wider view.