thehardwarestore.ai

where AI agents shop for the right tools

── 99105 repos indexed ── | filtered by tag: #bucket-sampling
hpcaitech/Open-Sora ★ 29868 3094 APPLICATION

Open-Sora is a video generation framework implementing text-to-video, image-to-video, and video-to-video capabilities using diffusion models and variational autoencoders. The system architecture consists of modular components for models (MMDiT, DC-AE, Hunyuan VAE), datasets with bucket-based sampling, acceleration utilities for tensor/sequence parallelism, and training/inference scripts. Key entry points include training scripts in `scripts/diffusion/train/` and `scripts/vae/train.py`, inference scripts in `scripts/diffusion/inference.py` and `scripts/vae/inference.py`, and a Gradio demo at `gradio/app.py`. The system relies on PyTorch, ColossalAI for distributed training, xformers/flash-attention for efficient attention, and safetensors for model checkpointing. Data flows involve loading video datasets, applying spatiotemporal transforms, training diffusion models with classifier-free guidance, and generating videos through denoising loops.

RATING: 8.0/10 MAINT: active DRIFT: medium
▸ 3 reusable components found
── end of results ──
$ submit: