This repository is a curated collection of 93+ production-ready AI engineering projects, spanning beginner to advanced levels. It serves as a practical resource for building AI applications, with a strong emphasis on agent orchestration (CrewAI, AutoGen, OpenAI Swarm), Retrieval-Augmented Generation (RAG) pipelines, Model Context Protocol (MCP) servers, and LLM evaluation frameworks. The dominant character is application development: most projects are deployable apps using Streamlit, Next.js, FastAPI, or as standalone MCP servers. Notable sub-projects include a full visual workflow builder (open-agent-builder) with Convex backend, a multi-modal RAG pipeline (notebook-lm-clone), and a comprehensive audio analysis toolkit. While primarily application-focused, the repository also contains data/research elements such as model fine-tuning scripts (GRPO, DPO, SFT), synthetic data generation (SDV), and LLM comparison dashboards with Opik/DeepEval evaluation. The codebase is heterogeneous in quality: some projects exhibit clean architecture and reusable patterns, while others are simple demos with boilerplate code and hardcoded dependencies. Overall, it is an excellent educational resource for AI engineers seeking practical, runnable examples, but not a single cohesive product.
This repository is a companion documentation site for Zhou Zhihua's 'Machine Learning' (Watermelon Book), providing detailed step-by-step formula derivations for all chapters. It is built with VitePress, a static site generator, and deployed to GitHub Pages. The site includes 16 chapters of mathematical derivations, an errata page tracking corrections across print editions, and French translations for the first two chapters. While the content is educational and not a software application in the traditional sense, the repository functions as a VitePress project with custom theme configuration, MathJax rendering, and CI/CD deployment. It is actively maintained by the Datawhale community and serves as a learning resource for machine learning practitioners.
This repository is a comprehensive PyTorch library for person re-identification (re-ID), providing a full pipeline for training, evaluating, and deploying deep learning models. It includes a modular architecture with data managers (ImageDataManager, VideoDataManager), a large model zoo (OSNet, ResNet, DenseNet, HACNN, etc.), training engines (softmax, triplet, with video support), loss functions (cross-entropy with label smoothing, triplet with hard mining), metrics (CMC, mAP with Cython acceleration), and utilities (feature extraction, model export to ONNX/OpenVINO/TFLite, re-ranking). The codebase is well-organized into subpackages (torchreid.models, torchreid.data, torchreid.engine, etc.) and includes research projects (attribute recognition, deep mutual learning, neural architecture search). While the library is feature-rich and demonstrates strong engineering for its domain, it has not been actively maintained since mid-2022, relies on outdated dependencies (Python 3.6, torch 1.10), and contains deprecated API usage. It remains a valuable reference for re-ID practitioners but requires updates for modern environments.
This repository is a comprehensive collection of educational tutorials that implement machine learning algorithms and applications entirely from scratch using only NumPy. It covers a vast range of topics including core ML algorithms (linear regression, SVM, K-means, PCA, etc.), neural networks (CNN, RNN, LSTM, GAN, transformer), computer vision (object detection, face recognition, OCR), natural language processing (sentiment analysis, chatbots, text summarization, BPE tokenizer), time series forecasting (ARIMA, LSTM, Prophet), recommendation systems, anomaly detection, and reinforcement learning. Each tutorial is a self-contained Python script that generates synthetic data with planted structure, trains a hand-coded model, and validates against naive baselines. The code is heavily commented and designed for teaching, not production. There are no real datasets, no external dependencies beyond NumPy, and no shared library—each file is independent, leading to significant code duplication across tutorials. The repository serves as an excellent learning resource for understanding the inner workings of ML algorithms, but it is not suitable for direct reuse in production systems without substantial refactoring.
bertviz is a Python library for interactive visualization of attention in Transformer-based NLP models. It provides three complementary views: Head View (per-head attention patterns), Model View (attention flow between tokens across layers), and Neuron View (query/key interactions within individual attention heads). The library is designed for Jupyter notebooks, rendering D3.js-based interactive HTML directly in cell output. It accepts attention tensors from most HuggingFace models via output_attentions=True, and includes a vendored, modified copy of older HuggingFace transformers code to expose query/key vectors for the Neuron View on BERT, GPT-2, RoBERTa, XLNet, and similar architectures.
EchoTorch is a PyTorch-based research library for reservoir computing and echo state networks (ESNs). It implements multiple ESN variants, including a self-predicting ESN (SPESNCell), conceptor-based pattern manipulation with logic operations (AND, OR, NOT, PHI), a custom TimeTensor time-series wrapper, and supporting datasets such as Lorenz, Roessler, Mackey-Glass, NARMA, and MNIST. The repository is a library rather than an application: there are no web servers, CLIs, or service entry points; the primary interface is the Python package `echotorch` with submodules for neural network cells, datasets, transforms, costs, and utilities.
This repository is a curated collection of machine learning interview questions and answers, organized by topic (ML fundamentals, deep learning, computer vision, NLP, statistics, coding). It is primarily a documentation site, with a Python build script that generates a static website from the README.md and NLP/README.md files. The site is deployed to GitHub Pages via a CI/CD workflow. The codebase is minimal: the only executable code is the build script, which parses markdown, generates HTML pages with SEO metadata, JSON-LD structured data, sitemap, and robots.txt. The repository is not an application or data pipeline; it is a knowledge base with a static site generator. The build script is well-structured and demonstrates good practices for generating a static site from markdown sources.
This repository is a curated collection of baseline solutions for data science competitions, primarily from Chinese platforms (科大讯飞 AI开发者大赛, Tianchi, DataFountain, AIWIN, etc.) and some international ones (Kaggle). It contains hundreds of Jupyter notebooks and Python scripts covering a wide range of tasks: structured data classification/regression (LightGBM, XGBoost), computer vision (ResNet, EfficientNet, YOLO, CRNN), natural language processing (BERT, TF-IDF, Qwen), time series forecasting, and multimodal challenges. Each baseline is self-contained, providing a quick-start pipeline from data loading to submission generation. The repository serves as a practical learning resource for competition participants, demonstrating common feature engineering techniques, model training loops, and ensemble strategies. However, the code quality is uneven: many notebooks are exploratory with hardcoded paths, outdated library versions, and minimal error handling. The repo lacks centralized dependency management, environment definitions, or modular reusable libraries, making reproducibility low without manual adaptation. Despite these limitations, it offers a valuable catalog of patterns and templates that can be adapted for new competitions.
This repository is a curated list (awesome list) of AutoResearch use cases, implementations, benchmarks, and forks. It does not contain any source code, data, or executable components. The sole content is a README.md file that organizes links to external projects, each with descriptions and links to optimization traces. The repository serves as a directory for the AutoResearch community, not as a software application or data research pipeline. It is a static documentation resource with no runtime behavior, architecture, or data flows.
AutoTrain Advanced is a no-code / low-code machine learning training platform from Hugging Face, providing a unified CLI, web UI (FastAPI + Jinja2), and REST API to fine-tune models on 15+ tasks including LLM SFT/DPO/ORPO, text/image classification, object detection, token classification, seq2seq, sentence transformers, and VLM. It wraps the Hugging Face ecosystem (transformers, datasets, peft, accelerate, trl) and supports multiple backends: local GPU, Hugging Face Spaces, NVIDIA NGC, and NVCF. The project is officially deprecated as of late 2024, with the README explicitly stating no new features will be added and recommending alternatives. The codebase is architecturally well-organized with a modular trainer structure, Pydantic parameter models, abstract backend patterns, and reusable callbacks, but suffers from duplicated dataset loading logic, heavy coupling to Hugging Face API, and a sprawling single-file UI. It remains functional for users who need a turnkey fine-tuning solution with existing dependencies, but is not suitable for new projects requiring long-term maintenance.
Renate is a Python library for continual learning that provides implementations of various algorithms (Experience Replay, DER, Super-ER, etc.) to mitigate catastrophic forgetting when updating neural networks on sequential data. It features a modular architecture separating models, data handling, update strategies, memory buffers, and drift detection, enabling users to customize continual learning pipelines. The framework supports local execution and cloud deployment via Amazon SageMaker, includes hyperparameter optimization through Syne Tune, and offers benchmarking tools for evaluating continual learning methods across diverse datasets and scenarios. Key reusable components include a memory buffer system with reservoir and class-balancing strategies, Maximum Mean Discrepancy (MMD) based drift detectors for monitoring data distribution shifts, and a composable loss component system for constructing complex continual learning objectives. The library integrates with PyTorch Lightning for training and provides abstract base classes for models and data modules to facilitate extension. Although the project is explicitly archived and no longer maintained, the codebase demonstrates solid engineering practices with well-defined interfaces and decoupled components. It has been tested on vision and NLP benchmarks (CIFAR, CLEAR, DomainNet, Hugging Face datasets) and includes synthetic scenario generators for controlled experimentation. The archival status indicates that users should expect no further updates or security patches, but the core functionality remains usable for continual learning research and applications.
This repository provides the SPICE dataset, a collection of molecular structures and properties for machine learning and molecular simulation. It includes precomputed HDF5 files for amino acid ligands, the DES370K set of small organic molecules, dipeptides, ions, PubChem compounds, solvated amino acids, water clusters, and more. The accompanying Python scripts generate these datasets from raw SDF and PDB files, performing tasks such as molecular filtering, energy computation, and solvation. The repository is primarily a data resource rather than a software application, with scripts that are tightly coupled to the specific dataset generation pipeline. It lacks dependency pinning and formal testing, but the data files are directly usable for training and benchmarking molecular models.
This repository is a curated educational resource and learning roadmap for Large Language Models (LLMs), rather than a software application or data pipeline. The entire substantive content is contained within a single README.md file, which is structured into three major learning tracks: 'LLM Fundamentals' (math, Python, neural networks), 'LLM Scientist' (building LLMs, pre-training, fine-tuning, alignment, quantization), and 'LLM Engineer' (RAG, agents, deployment, optimization, security). Each section provides annotated links to external resources—notebook tutorials, blog posts, papers, videos, and tools—rather than hosting original code or data assets. There are no source code files, notebooks, data files, configuration files, or dependency manifests in this repository beyond the README and a LICENSE file. The repository links to several external Colab notebooks hosted on Google Drive (covering tools like LazyMergekit, AutoQuant, and LazyAxolotl, and tutorials on fine-tuning, quantization, and model merging), but these are not part of the repository itself. The repo functions as a reading list and structured syllabus, not as a codebase. From a data engineering or software reuse perspective, there are no reusable components within this repository—no ETL scripts, no data validation routines, no model training code, no configuration schemas, and no test suites. The value lies entirely in the curation and organization of external educational materials. The repository was last committed to in February 2026 and has no CI/CD, no package manifests, and no code-level maintenance concerns.
This repository is a curated list of resources for practicing data science with Python, organized in the style of 'awesome' lists. It contains links to libraries, tutorials, blog posts, talks, code snippets, and other resources across various data science domains including core libraries, machine learning, NLP, computer vision, and more. The repository serves as a reference guide for data scientists and practitioners rather than containing executable code or performing data processing tasks.
Petastorm is a library for loading Apache Parquet datasets into machine learning training frameworks, primarily TensorFlow and PyTorch. It provides a reader API that supports parallel I/O, row-group shuffling, predicate filtering, and on-the-fly transformations. The library also includes a Spark Dataset Converter to materialize Spark DataFrames as cached Parquet for training. Architecture: modular with worker pools (process/thread), filesystem abstraction (local, HDFS, S3, GCS), schema system (Unischema with codecs), and shuffling buffers. It features CLI tools for benchmarking, metadata generation, and dataset copying. The codebase demonstrates strong engineering practices with clear separation of concerns, but shows signs of aging: reliance on TensorFlow 1.x, Python 2 compatibility, and pinned dependencies that may cause drift. The project has a large test suite with legacy dataset fixtures for backward compatibility, but maintenance has slowed significantly with the last release (v0.13.1) and minimal recent commits.
This repository serves as the companion code for the O'Reilly book 'Practical MLOps', providing a collection of examples spanning the MLOps lifecycle. It is a hybrid repository with a dominant data research character, containing Jupyter notebooks for exploratory data analysis (e.g., COVID-19 trends, sugar intake correlations), AutoML experiments (Ludwig text classification), and model interoperability scripts (ONNX conversion). It also includes application-like components such as a Flask-based model serving container, CLI tools for CSV linting, and cloud deployment scripts for AWS, Azure, and GCP. The code is organized by book chapters and demonstrates practical MLOps patterns, though many examples are simplified for educational purposes rather than production readiness. The most reusable asset is the modularized CSV linter, which provides a well-structured CLI for data quality checks.
This repository is a comprehensive knowledge base and research platform for quantitative finance, primarily focused on Chinese A-share markets. It contains hundreds of blog posts, course materials, and technical articles covering factor investing, machine learning strategies, backtesting frameworks, and data engineering. The codebase includes reusable data pipelines (ParquetUnifiedStorage, CalendarModel), a custom backtesting framework (Moonshot), and numerous factor analysis scripts. It also hosts a sophisticated set of AI-assisted academic research skills (paper writing, review, deep research) defined as Claude skill files. The repository serves as both an educational resource and a personal research lab, with content spanning from beginner Python tutorials to advanced factor construction and model training. While the code is functional and demonstrates solid data engineering patterns, it is tightly coupled to Chinese financial data APIs (Tushare, akshare) and contains hardcoded paths, limiting portability. The repository is actively maintained but shows signs of technical drift in some dependencies and content duplication.
This repository implements an end-to-end predictive modeling pipeline for Premier League football match outcomes (home win, draw, away win). It ingests raw match statistics from the api-football.com REST API, processes JSON data into structured DataFrames, engineers features using rolling averages (5- and 10-game windows) and team-vs-opponent differentials, trains multiple classifiers (Random Forest, SVM, KNN, MLP) with hyperparameter tuning, and serves live predictions via a Flask web application. The dominant character is data research: the primary deliverable is a set of trained models and an analytical pipeline, with the web server being a secondary deployment artifact. The best-performing model is a Random Forest achieving ~50-51% test accuracy, demonstrating that football outcomes are modestly predictable from historical statistics. The codebase includes modular helper modules for feature engineering, data scaling, and evaluation plotting that are reusable for other sports or time-series classification tasks. However, the project suffers from hardcoded absolute paths, outdated dependencies (Python 3.7, sklearn 0.23.1), plain-text API keys in the repository, and a static dataset that will drift over time.
This repository is a curated reading list organized as a GitHub Pages site using Jekyll. It contains no application logic, no data pipelines, and no executable code. The entire substantive content is a single README.md file with approximately 1,500 categorized links to external articles, talks, and case studies about scalable system design. The repository's value lies entirely in its curation quality and organization, not in any software it produces. The architecture is a static Jekyll site served via GitHub Pages, configured through _config.yml with the 'jekyll-theme-modernist' theme. The only other files are standard GitHub community templates (CONTRIBUTING.md, SECURITY.md, issue templates, CODE_OF_CONDUCT.md, LICENSE, FUNDING.yml). There are no tests, no CI/CD pipelines, no package manifests, and no source code in any programming language. The last commit was in January 2026, indicating the repository is still receiving updates. The content covers distributed systems patterns across major tech companies (Netflix, Uber, Facebook, Google, LinkedIn, Pinterest, etc.) organized into categories: principles, scalability, availability, stability, performance, intelligence/ML, architecture, interview prep, organization, and talks. The breadth of coverage is impressive but the curation is entirely manual link collection with no original analysis or tooling.
This repository is a curated list of free resources and a roadmap for learning Machine Learning and Artificial Intelligence, primarily consisting of markdown files with external links. It categorizes resources such as key concepts, building blocks, courses, certifications, books, tools, research blogs, interview prep materials, newsletters, and project ideas. The repo contains no executable code, data pipelines, or software applications; it serves as a structured guide rather than a functional project. Its value lies in being a well-organized reference for learners, but it offers no reusable software components, data assets, or reproducible research.