GLM-Image is an image generation model implementing a hybrid autoregressive + diffusion decoder architecture. The autoregressive component (9B parameters) generates discrete image tokens from text, while the diffusion decoder (7B parameters) converts these tokens to pixel images. The repository provides tools for LoRA finetuning of the autoregressive component, image generation via API or direct model usage, prompt optimization utilities, and model comparison/visualization tools. Entry points include finetune_lora.py for training, glm_image_cli.py for API-based generation, and compare.py/plot_loss.py for evaluation and monitoring.
SkinTokens is a research codebase for a novel 3D character rigging method (TokenRig) that learns a compact discrete representation (SkinTokens) for skinning weights. The system ingests 3D meshes with skeleton and skinning data (from ArticulationXL, VRoid Hub, ModelsResource), transforms them through a pipeline of augmentation, order arrangement, vertex group extraction, and sampling, then trains an FSQ-CVAE to compress skinning weights into discrete tokens. A Qwen3-0.6B-based autoregressive transformer (TokenRig) generates the full rig (skeleton hierarchy + skin tokens) as a single token sequence. The repo includes a Blender-based server for mesh loading and export, a Gradio demo, a CLI, and extensive data processing modules. The code is well-structured with dataclass-based configs, abstract interfaces, and modular design, but remains primarily a research artifact with some incomplete training implementations (e.g., TokenRig training_step raises NotImplementedError). Its hybrid nature leans strongly toward data research, as the core contribution is a learned representation and generative model for animation rigging.
This repository provides the official PyTorch implementation of MAR (Masked Autoregressive with Diffusion Loss), a research method for class-conditional image generation on ImageNet 256x256. The core contribution is an autoregressive model that operates on continuous-valued latent tokens (via a pre-trained VAE) and uses a diffusion loss instead of vector quantization. The codebase includes model definitions (MAR encoder-decoder transformer, DiffLoss MLP), training and evaluation scripts with PyTorch DDP, a VAE latent caching pipeline, and pre-trained checkpoints for base/large/huge variants. While primarily a research prototype, it contains reusable components such as the DiffLoss module, diffusion utilities, and a clean data caching pattern. The Gradio app and Colab notebook make the model accessible for interactive use.