This repository implements VTP (Visual Tokenizer Pre-training), a framework for pre-training visual tokenizers using a combination of contrastive, self-supervised, and reconstruction learning objectives. The system provides a unified model architecture that supports CLIP-style image-text contrastive learning, DINOv2-style self-supervised learning, and image reconstruction. It includes training scripts, evaluation tools for zero-shot classification, linear probing, and reconstruction metrics, as well as integration with LightningDiT for generation evaluation. The codebase features a HuggingFace-compatible model implementation, modular transformer components, and various utility functions for image processing and metric calculation.