$ account ml-explore
MLX is an array framework for machine learning on Apple Silicon and NVIDIA GPUs, developed by Apple's machine learning research team. It provides a NumPy-like API for Python and C++ with composable function transformations (autograd, vectorization, graph optimization), lazy computation, dynamic graph construction, and multi-backend support (CPU, Apple Metal, NVIDIA CUDA). The framework includes high-level neural network layers, optimizers, distributed training primitives, quantization support, and model I/O (safetensors, GGUF). It is designed for efficient on-device ML research and inference, with an emphasis on performance via custom GPU kernels, JIT compilation, and unified memory.
This repository is a collection of standalone examples demonstrating the MLX framework (Apple's machine learning framework for Apple Silicon). It covers a wide range of deep learning models including LLMs (Mistral, Mixtral, Llama, T5), image generation (Stable Diffusion, FLUX, CLIP), video generation (Wan2.1), audio (Whisper, MusicGen, EnCodec), segmentation (SAM), and more. Each example is self-contained with its own entry point (CLI or Python script), model conversion utilities, and often a training/fine-tuning script. The repository is primarily an application-focused showcase with some research elements (e.g., normalizing flows, GCN). Production entry points include `whisper/mlx_whisper/cli.py` for transcription, `flux/txt2image.py` for image generation, `video/wan2.1/txt2video.py` for video generation, and `lora/lora.py` for fine-tuning. All examples depend on the MLX library and often bundle conversion from PyTorch weights. The architecture is a flat collection of independent projects, not a unified framework, leading to some code duplication (e.g., T5 and EnCodec are copied into multiple directories). However, several components are well-crafted and reusable, notably the Whisper decoding pipeline, the LoRA adapter module, and the flow-matching samplers for diffusion models.