$ show aibuildai-inc/AI-Build-AI
AI-Build-AI is an autonomous AI agent that automatically builds, trains, and evaluates machine learning models for diverse tasks. The repository contains solutions to over 20 benchmarks and competitions (Kaggle, IOAI, NatureBench, MLE-Bench) spanning tabular classification, image segmentation, object counting, protein variant effect prediction, video prediction, graph node classification, and more. Architecturally, it is a collection of self-contained task modules under `tasks/`, each with a consistent pattern: `config.py` (hyperparameters), `model.py` (architecture), `train.py` (training loop), `inference.py` (standalone prediction), and `predictions/` (outputs). The agent employs state-of-the-art backbones (ESM-2, Cosmos-Predict2.5, SegFormer, EfficientNet, GBDTs, GNNs) and advanced techniques including ensemble search, EMA, test-time augmentation, pseudo-labeling, and cost-sensitive thresholding. While the code is functionally impressive and demonstrates high craftsmanship in isolated components (e.g., ensemble search, graph feature engineering), it suffers from significant code duplication across tasks, hardcoded paths, and tight competition-specific optimizations that limit general reusability. The repository is actively maintained and shows strong engineering practices within its autonomous agent paradigm.
The LLM identified 3 files worth highlighting for reuse:
Implements an automated ensemble search using hill climbing and grid search on rank-transformed out-of-fold predictions. Takes a set of candidate model predictions and searches for optimal ensemble weights to maximize a target metric (e.g., ROC-AUC). The algorithm applies rank transformation (percentile) before blending, which normalizes prediction scales. The resulting ensemble checkpoint can be serialized via `build_checkpoint.py`. This component is highly reusable for any supervised learning task where OOF predictions are available, requiring only numpy arrays and a metric function.
Computes a comprehensive set of structural graph features for nodes in a biological network (e.g., degree, clustering coefficient, eigenvector centrality, PageRank, betweenness). These features are used as input to a graph neural network for node classification. The script relies only on networkx and numpy, making it easily extractable and applicable to any undirected graph dataset. Demonstrates non-obvious skill in combining classical graph metrics with modern GNNs.
Defines a neural network architecture for anomalous diffusion OOD detection that ingests physics-inspired features (e.g., mean squared displacement, moment ratios, autocorrelation) from particle trajectories. The model uses these features to predict continuous anomalous diffusion exponents and detect out-of-distribution trajectories. The feature extraction logic is parameterized and modular, allowing reuse for any trajectory-based anomaly detection task.