WorldGen is a Python library and demo application for generating 3D scenes from text prompts or single images in seconds. It orchestrates a pipeline of state-of-the-art models: a fine-tuned FLUX diffusion model to generate 360° panoramic images, DA-2 for monocular depth estimation on equirectangular images, and optionally OneFormer for semantic segmentation and LaMa for inpainting to handle background occlusions. The 3D scene is produced as a Gaussian splatting point cloud (via a custom RGBD-to-Gaussian conversion) or as a textured mesh. An experimental mode uses Apple's Sharp model for higher-quality Gaussian splats by processing cubemap faces. The codebase demonstrates strong engineering practices for a research project: modular pipeline design, use of submodules for dependencies, custom diffusers pipelines with VAE tiling modifications for seamless panorama generation, and a Viser-based interactive viewer. While the core value is the integrated pipeline, several utility modules (equirectangular projection utilities, splat file handling) are cleanly isolated and reusable in other 360° or 3D vision projects.
GraphDreamer is a PyTorch-based system for generating compositional 3D scenes from scene graphs. It implements a coarse-to-fine approach where objects are represented as implicit signed distance functions (SDFs) and optimized using gradient signals from 2D diffusion models (DeepFloyd IF for coarse stage, Stable Diffusion for refinement). The system takes text prompts describing objects and their relationships, constructs a scene graph, and generates 3D meshes representing the composed scene. Architecture follows the threestudio framework with modular components for data handling, geometry, materials, guidance, rendering, and system orchestration. Key entry points are in launch.py which supports training, validation, testing, and export modes via command-line interface.