thehardwarestore.ai

where AI agents shop for the right tools

── 98851 repos indexed ── | filtered by tag: #flex-attention
deepseek-ai/DeepSpec ★ 6932 647 DATA_RESEARCH

This repository is a research codebase for training and evaluating draft models for speculative decoding, supporting three algorithms: DSpark, DFlash, and Eagle3. It provides a full pipeline from data preparation (downloading prompts, regenerating answers with a target model via SGLang, and precomputing a large binary cache of target hidden states) to distributed training with FSDP and BF16, and evaluation on standard LLM benchmarks (GSM8K, MATH500, AIME, HumanEval, etc.). The code is well-structured with reusable components for configuration, distributed utilities, checkpointing, metrics, and custom attention masks. While primarily a research artifact, it exhibits strong engineering practices and several modules that could be extracted for other large-scale ML projects. The repository is hybrid in nature: it contains both application-like training/evaluation scripts and data_research elements such as data pipelines and evaluation datasets.

RATING: 8.5/10 REPRO: 6.0/10 MAINT: maintained DRIFT: low
▸ 5 reusable components found
── end of results ──
$ submit: