LLaMA-Factory is a production-grade, unified framework for fine-tuning, evaluating, and serving 100+ large language and multimodal models. It provides a CLI (`llamafactory-cli`), a Gradio web UI (LLaMA Board), and an OpenAI-compatible API server. The architecture is monolithic but highly modular, built on Hugging Face Transformers/TRL/PEFT with optional integration of vLLM, SGLang, DeepSpeed, FSDP, Megatron Bridge, and hardware-specific backends (CUDA, ROCm, NPU, XPU). Training pipelines support full-parameter, LoRA, QLoRA, freeze-tuning, and alignment methods (DPO, PPO, KTO, etc.) with extensive data processing (multimodal, packing, streaming, template-based formatting). The codebase features a plugin system (v1) for kernels, quantization, distributed backends, and batching strategies, though it maintains a parallel legacy (v0) path. Reusable components include dataset processors, chat template hierarchy, multimodal plugin architecture, custom trainer callbacks, and batching strategy plugins. While the framework is actively maintained and well-tested, it suffers from some technical drift due to a dual-codebase structure, hardcoded model registries, version pinning, and fragile monkey-patching in distributed integrations.
HY-WU is a machine learning application for text-guided image editing that implements a Functional Neural Memory framework. The system generates instance-conditioned LoRA (Low-Rank Adaptation) weights on-the-fly from hybrid image-instruction representations and injects them into a frozen backbone model (HunyuanImage-3.0-Instruct) during forward pass, enabling test-time adaptation without optimization. The architecture centers around a WUPipeline orchestrator that coordinates a parameter generator, the base model with PG mixin integration, and image processing components. Key entry points include the infer.py CLI script and gradio/app.py web interface. The system processes user prompts and input images through VAE encoding, condition extraction, parameter generation, LoRA injection, and image decoding to produce edited outputs.
GLM-Image is an image generation model implementing a hybrid autoregressive + diffusion decoder architecture. The autoregressive component (9B parameters) generates discrete image tokens from text, while the diffusion decoder (7B parameters) converts these tokens to pixel images. The repository provides tools for LoRA finetuning of the autoregressive component, image generation via API or direct model usage, prompt optimization utilities, and model comparison/visualization tools. Entry points include finetune_lora.py for training, glm_image_cli.py for API-based generation, and compare.py/plot_loss.py for evaluation and monitoring.
The repository provides the official PyTorch implementation of DoRA (Weight-Decomposed Low-Rank Adaptation), a parameter-efficient fine-tuning method. It integrates with Hugging Face PEFT and includes training/evaluation scripts for vision-language and language tasks (e.g., VQA, ScienceQA, commonsense reasoning). The architecture is modular, with core components like DoRA tuners, adapter controllers, and low-rank layers. Entry points include training scripts (finetune.py, train_dora.py), evaluation scripts (evaluate.py, run_llava.py), and serving tools (gradio_web_server.py). External dependencies include PyTorch, Transformers, PEFT, bitsandbytes, and dataset-specific libraries.
llm-action is a comprehensive resource hub for large language model engineering that combines theoretical explanations with practical implementation code. It covers the full LLM lifecycle including data engineering, training (full fine-tuning and parameter-efficient methods like LoRA/QLoRA), model compression (quantization, pruning, distillation), inference serving, deployment, and evaluation. The repository contains both educational documentation and runnable code examples, with particular emphasis on Chinese-language resources and domestic AI hardware adaptation (especially Huawei Ascend NPUs). While it serves as a knowledge base, its inclusion of actual training scripts, inference servers, and utility tools makes it primarily application-oriented rather than purely research-focused.
This repository is a comprehensive collection of tutorials and code examples for deploying, fine-tuning, and integrating open-source large language models (LLMs), with a strong focus on the Chinese LLM ecosystem. It covers over 50 models (Qwen, ChatGLM, DeepSeek, InternLM, etc.) and provides step-by-step guides for setting up FastAPI services, Streamlit web demos, LangChain knowledge base assistants, and LoRA/QLoRA fine-tuning using PEFT. The repository also includes example applications such as role-playing chatbots and digital persona creation. While primarily educational, the code patterns are directly applicable to production scenarios, including model serving with vLLM/SGLang, experiment tracking with SwanLab, and deployment on diverse hardware (NVIDIA, AMD ROCm, Ascend NPU, Apple Silicon). The codebase is highly repetitive across models, with significant copy-paste, but the underlying patterns (fine-tuning pipeline, deployment scaffold, LangChain wrapper) are well-established and reusable.