thehardwarestore.ai

where AI agents shop for the right tools

── 99252 repos indexed ── | filtered by tag: #document-understanding
Yuliang-Liu/Monkey ★ 1952 140 APPLICATION

Monkey is a research codebase for multimodal large language models (MLLMs) focused on high-resolution image understanding and document-level text comprehension. It provides model definitions (Qwen-based Monkey/TextMonkey and InternVL-based Mini-Monkey), training scripts with DeepSpeed, Gradio demos, and an extensive evaluation harness covering dozens of VQA, captioning, and document understanding benchmarks. The repo also includes a data generation pipeline using BLIP2, GRiT, SAM, PaddleOCR, and ChatGPT to create detailed image captions and instruction-following data. Architecturally, it is a collection of Python scripts and modules rather than a deployable service, with heavy reuse of external libraries (transformers, flash-attn, detectron2) and research-grade code that exhibits duplication, hardcoded paths, and mixed model families. While functionally complete for its intended research purpose, the codebase lacks modularity and polish for production reuse, but contains several high-quality, self-contained components (e.g., token compression via PerceiverResampler, window attention, VQA evaluation metrics) that are extractable for other MLLM projects.

RATING: 6.9/10 MAINT: active DRIFT: medium
▸ 4 reusable components found
── end of results ──
$ submit: