This repository is an unofficial PyTorch implementation of the Titans architecture from the research paper 'Titans: Learning to Memorize at Test Time'. It provides a library of neural network modules including Neural Memory, Memory-as-Context Transformer, and various attention mechanisms. The codebase consists of modular components that can be used as building blocks for sequence modeling, with training scripts demonstrating language modeling on the enwik8 dataset. The implementation focuses on test-time training mechanisms where the model learns to memorize at inference time through a neural memory module that updates its weights based on incoming sequences.
HY-WU is a machine learning application for text-guided image editing that implements a Functional Neural Memory framework. The system generates instance-conditioned LoRA (Low-Rank Adaptation) weights on-the-fly from hybrid image-instruction representations and injects them into a frozen backbone model (HunyuanImage-3.0-Instruct) during forward pass, enabling test-time adaptation without optimization. The architecture centers around a WUPipeline orchestrator that coordinates a parameter generator, the base model with PG mixin integration, and image processing components. Key entry points include the infer.py CLI script and gradio/app.py web interface. The system processes user prompts and input images through VAE encoding, condition extraction, parameter generation, LoRA injection, and image decoding to produce edited outputs.