PyGCL is a PyTorch-based library for Graph Contrastive Learning (GCL) that provides modular components for building GCL models. The library implements graph augmentation techniques, contrasting architectures, contrastive objectives, and negative sampling strategies. It features clean abstractions that separate concerns across different graph frameworks (PyG and DGL), standardized evaluation utilities, and comprehensive examples demonstrating usage. The architecture follows a modular design with distinct modules for augmentors, losses, models, evaluation, and utilities, allowing users to mix and match components to build custom GCL algorithms.
The openai/CLIP repository provides a Python library for loading and using CLIP (Contrastive Language-Image Pre-Training) models. It offers a clean API for model loading, image preprocessing, text tokenization, and computing similarity between images and text. The core implementation includes two vision encoder architectures (ModifiedResNet and VisionTransformer) and a Transformer-based text encoder, all built with PyTorch. The library is designed for research and inference, enabling zero-shot image classification, image-text retrieval, and feature extraction. While primarily a research artifact, the code is well-structured and demonstrates strong engineering practices, with reusable components such as the BPE tokenizer and model architecture definitions. The repository is stable but not actively developed, with dependencies on older PyTorch versions.
This repository implements VTP (Visual Tokenizer Pre-training), a framework for pre-training visual tokenizers using a combination of contrastive, self-supervised, and reconstruction learning objectives. The system provides a unified model architecture that supports CLIP-style image-text contrastive learning, DINOv2-style self-supervised learning, and image reconstruction. It includes training scripts, evaluation tools for zero-shot classification, linear probing, and reconstruction metrics, as well as integration with LightningDiT for generation evaluation. The codebase features a HuggingFace-compatible model implementation, modular transformer components, and various utility functions for image processing and metric calculation.