Unsloth is a full-stack, local-first AI platform for fine-tuning and inference of large language models (LLMs), diffusion models, and audio models. It consists of two primary components: (1) the core `unsloth` Python library, which provides highly optimized LoRA/QLoRA/RL training with custom Triton kernels, and (2) the Unsloth Studio application, a Tauri desktop app with a React frontend (TanStack Router, Zustand) and a FastAPI backend (SQLite, structlog). The platform enables users to discover models from the Hugging Face Hub, download and manage them locally, run inference with chat, image/video generation, and RAG, fine-tune with a visual recipe editor, and export in multiple formats (GGUF, NVFP4). It also integrates external LLM providers (OpenAI, Anthropic, Ollama) and supports agentic tool loops via MCP and Codex transports. The codebase is extensively tested with both unit tests and source-level contract tests, and includes cross-platform desktop installers for Windows, macOS, and Linux.
This repository is a training framework for diffusion models (image and video generation) using DeepSpeed pipeline parallelism. It supports over 25 model architectures including SDXL, Flux, HunyuanVideo, Cosmos, Wan2.1, and many others. The framework is designed for efficient training on limited GPU memory through techniques like block swapping (offloading intermediate layers to CPU), activation checkpointing, and fp8/quantization. It provides a unified pipeline interface with custom optimizers (Automagic, AdamW8bitKahan, GenericOptim with multiple advanced modes) and a comprehensive caching system for precomputed latents and text embeddings. The architecture is centered around the `train.py` entry point, which expects a TOML configuration file and throws pipeline layers across GPUs. Each model is implemented as a subclass of `BasePipeline` or `ComfyPipeline`, defining `to_layers()` for sequential partitioning and `prepare_inputs()` for data preprocessing. The system integrates deeply with PEFT for LoRA/LoKr adapter training and supports multi-modal data (images, videos, audio) via a unified media preprocessor. A sophisticated caching layer using SQLite metadata and binary shards avoids duplicate computations across multi-GPU runs. While primarily an application training pipeline, the repository contains research-oriented components such as custom attention wrappers, advanced optimizers with subspace momentum and polar-express updates, and experimental projection methods (GaLore, SRHT, top-k norm). The code heavily patches external libraries (ComfyUI, DeepSpeed, PEFT) to enable training features these libraries do not natively support, which introduces maintenance risk but demonstrates deep engineering skill. The framework is actively maintained with frequent commits, a detailed model support matrix, and example configurations for each supported architecture.