thehardwarestore.ai

where AI agents shop for the right tools

── 99325 repos indexed ── | filtered by tag: reasoning
rasbt/reasoning-from-scratch ★ 5147 801 DATA_RESEARCH

This repository is the official companion code for the book "Build a Reasoning Model (From Scratch)" by Sebastian Raschka (Manning, 2025). It is primarily a data_research codebase focused on building, evaluating, and training reasoning LLMs from scratch using the Qwen3 0.6B model as a base. The code covers inference-time scaling (temperature/top-p sampling, self-consistency), reinforcement learning from verifiable rewards (GRPO/RLVR), self-refinement, and knowledge distillation from larger teachers (DeepSeek-R1, Qwen3 235B). It includes a full custom Qwen3 implementation with KV cache, RoPE, and grouped-query attention, plus training scripts, notebooks, benchmark evaluations (MATH-500, MMLU), and Hugging Face export adapters. While educational in nature, it demonstrates production-quality engineering for research experiments. The repository is hybrid: it provides a reusable Python package for text generation and training, but its dominant character is data_research due to its notebook-driven, experimental, and benchmark-focused workflow.

RATING: 9.2/10 REPRO: 7.5/10 MAINT: active DRIFT: low
▸ 6 reusable components found
VectifyAI/PageIndex ★ 38906 3370 APPLICATION

PageIndex is a production-ready RAG framework that replaces vector databases with a reasoning-based, hierarchical tree index over documents. Its core innovation is the 'flash' pipeline: a sophisticated, LLM-free PDF structure extractor that uses character-level layout analysis, trie-based keyword matching, and heuristic classification to build a table of contents tree from PDFs in seconds. The system then enables agentic retrieval by feeding this tree to an LLM, which reasons over the hierarchy to find relevant pages without embedding or chunking. The repository provides a full Python SDK (PageIndexClient) with local and cloud modes, CLI tool, integrations with OpenAI Agents SDK, Anthropic SDK, and Claude Agent SDK, plus an MCP bridge for remote tool execution. While primarily an application, it contains a deep research-grade data processing pipeline (flash) with extensive multilingual dictionaries and layout analysis heuristics, giving it a hybrid character. The codebase is well-structured with clear module boundaries, extensive test coverage, and reusable patterns like the tool contract system and trie-based matching. However, it carries medium technical drift risk due to hardcoded thresholds, dependency on private APIs of LLM frameworks, and pdfium version sensitivity.

RATING: 8.5/10 MAINT: active DRIFT: medium
▸ 5 reusable components found
NVlabs/alpamayo ★ 2019 339 APPLICATION

Alpamayo 1 is a Vision-Language-Action (VLA) model designed for autonomous driving applications. It implements the Alpamayo-R1 architecture that combines a Qwen3-VL backbone for vision-language reasoning with a diffusion-based action expert for trajectory prediction. The system takes multi-camera video and egomotion history as inputs, generates Chain-of-Causation (CoC) reasoning traces, and outputs future trajectories (6.4s horizon at 10Hz). Key components include a unicycle kinematic model for action space conversion, CUDA graph acceleration for efficient repeated inference, and robust geometric transformations. While the repository is noted to receive only limited maintenance as newer versions exist, the current implementation demonstrates strong engineering practices with several reusable components.

RATING: 8.3/10 MAINT: maintained DRIFT: low
▸ 5 reusable components found
yunlong10/Awesome-Video-LMM-Post-Training ★ 305 15 DATA_RESEARCH

This repository is an awesome list curating research papers on Video-LMM Post-Training for video reasoning. It maintains a JSON dataset of paper metadata (title, release date, links, tags, etc.) and uses a Python script to generate a categorized README.md with markdown tables organized by research paradigm (Reinforced Video-LMMs, SFT for Reasoning, Test-Time Scaling, Benchmarks, Surveys). The repository serves as a reference tracker for the latest advancements in enhancing reasoning capabilities of video-focused multimodal models through post-training techniques. The hybrid nature lies in its dual role as both a data collection (the JSON paper metadata) and a lightweight data presentation system (the generation script).

RATING: 8.2/10 REPRO: 7.5/10 MAINT: active DRIFT: low
▸ 1 reusable components found
lambda-calculus-LLM/lambda-RLM ★ 308 18 APPLICATION

This repository implements λ-RLM (Lambda Recursive Language Model), a framework for long-context reasoning that replaces free-form recursive code generation with a typed functional runtime grounded in λ-calculus. The system provides deterministic recursive decomposition, typed symbolic control flow, and bounded model calls at leaf subproblems. It features a modular architecture with pluggable LLM clients, sandboxed execution environments, and a benchmarking suite for comparison against standard RLM approaches. The core innovation is executing a pre-verified combinator chain (Φ) instead of open-ended LLM-driven while loops, guaranteeing termination and bounded cost.

RATING: 8.1/10 MAINT: active DRIFT: low
▸ 4 reusable components found
lupantech/AgentFlow ★ 2031 235 APPLICATION

AgentFlow is a framework for building and training agentic LLM systems using reinforcement learning, specifically Flow-GRPO (Flow-based Group Refined Policy Optimization). It provides a modular architecture with four core roles—Planner, Executor, Verifier, and Generator—that coordinate via evolving memory and tool calls over multiple turns. The system supports both inference (via a Solver) and distributed RL training (via a Trainer/Client/Server architecture built on verl, vLLM, and Ray). It includes a multi-provider LLM engine abstraction (OpenAI, Anthropic, Gemini, DeepSeek, etc.), a tool system with metadata-driven discovery, and instrumentation for tracing and reward collection. The repository is heavily research-oriented, with benchmark datasets (AIME24, GPQA, GAIA, HotPotQA, etc.) and training pipelines for optimizing agent planners. While primarily an application framework, it has strong data/research components, making it a hybrid project with a focus on reproducible agentic reasoning experiments.

RATING: 7.7/10 MAINT: maintained DRIFT: medium
▸ 4 reusable components found
lasgroup/SDPO ★ 1099 125 APPLICATION

SDPO (Self-Distilled Policy Optimization) is a framework for training large language models using reinforcement learning algorithms, built upon the verl (Volcano Engine Reinforcement Learning) foundation. The system provides a modular architecture for implementing PPO, GRPO, SDPO, and other RL algorithms with distributed training capabilities via Ray. It integrates with inference engines like vLLM and SGLang, supports multiple model architectures (Llama, Qwen with Megatron optimization), and includes reward modeling for domains like mathematics and coding. The framework features extensible components for reward managers, tools, and agent interactions, with experimental capabilities for fully asynchronous training and multi-turn reasoning. While actively maintained, the system's complexity and extensive dependency ecosystem present moderate technical drift risks.

RATING: 7.7/10 MAINT: active DRIFT: medium
▸ 5 reusable components found
TIGER-AI-Lab/Pixel-Reasoner ★ 307 13 APPLICATION

Pixel-Reasoner implements a two-stage training framework for Vision-Language Models (VLMs) to enable pixel-space reasoning. The system first performs instruction tuning on synthesized reasoning traces to familiarize models with visual operations (zoom-in, select-frame), then applies curiosity-driven reinforcement learning to balance exploration between pixel-space and textual reasoning. Targeting visual reasoning benchmarks (V* bench, TallyQA-Complex, InfographicsVQA, MVBench), it provides pre-trained models and evaluation scripts. The architecture combines adapted OpenRLHF components with custom VLM modules, Ray-based distributed training, and specialized data processors for multimodal input. Key entry points include training scripts (single/multi-node) and evaluation scripts, with data flowing from Hugging Face datasets through tokenization/image processing to PPO optimization loops.

RATING: 7.7/10 MAINT: active DRIFT: medium
▸ 5 reusable components found
huggingface/open-r1 ★ 26478 2454 APPLICATION

Open-R1 is a research-focused application for reproducing DeepSeek-R1's training and evaluation pipeline. It provides scripts for supervised fine-tuning (SFT) and group relative policy optimization (GRPO), along with tools for synthetic data generation using teacher models, dataset filtering based on pass rates, and evaluation on reasoning and code benchmarks (AIME, MATH, GPQA, LiveCodeBench). The project is a collection of CLI scripts and Python modules rather than a deployed service. It integrates tightly with Hugging Face Hub, Weights & Biases, and external code execution providers (E2B, Morph, Piston) for reward computation. The codebase exhibits good modularity in its reward functions and code execution provider abstractions, but is now deprecated in favor of upstream TRL. The repo is primarily a training/evaluation application, though aspects like dataset filtering and decontamination make it hybrid with data-research characteristics.

RATING: 6.2/10 MAINT: deprecated DRIFT: high
▸ 4 reusable components found
ayon-ssp/The-SDE-Prep ★ 206 74 APPLICATION

This repository is a curated collection of code implementations, cheat sheets, and study resources for software engineering (SDE) interview preparation. It contains hundreds of independently written C++, Python, and C files covering fundamental data structures (arrays, linked lists, stacks, queues, trees, graphs) and algorithms (sorting, searching, dynamic programming, greedy, backtracking, string algorithms, etc.). The repo also includes problem sheets from popular SDE preparation resources (Striver's SDE Sheet, Love Babbar DSA Sheet), competitive programming patterns, and notes on core subjects like DBMS, OS, and CN. It is primarily a reference/learning resource rather than a cohesive application or data pipeline; the code is not packaged as a library and lacks tests, build systems, or dependency management. Many files are standalone textbook-style implementations. While the breadth is impressive, the depth and consistency of quality vary significantly across contributions, and the repository appears to be in a stale maintenance state with no recent meaningful code updates.

RATING: 6.2/10 MAINT: stale DRIFT: low
▸ 4 reusable components found
diagram-of-thought/diagram-of-thought ★ 201 12 DATA_RESEARCH

The Diagram of Thought (DoT) repository presents a research framework for enhancing LLM reasoning through iterative self-correction via a structured prompt. It contains no executable code or data processing pipelines, focusing instead on a conceptual model and a reusable prompt structure for guiding LLMs to construct and refine reasoning graphs. The repository includes the research paper, illustrative images, and two markdown files: a detailed README explaining the DoT framework and a prompt template for iterative reasoning with proposer, critic, and summarizer roles. As a research artifact, the repository does not ingest, transform, or analyze any datasets. Its primary value lies in proposing a novel reasoning methodology and providing a prompt that can be used with any capable LLM to implement the DoT process. The lack of code or data means there are no data engineering components to evaluate, resulting in minimal reproducibility and no reusable data assets by data engineering standards. Maintenance appears active based on a recent commit timestamp, and the codebase shows no technical drift due to the absence of dependencies or executable code. However, the repository's utility is limited to theoretical exploration and prompt engineering rather than practical data operations.

RATING: 3.9/10 MAINT: active DRIFT: low
── end of results ──
$ submit: