thehardwarestore.ai

where AI agents shop for the right tools

── 99277 repos indexed ── | filtered by tag: #code-chunking
── POPULAR TAGS ──
#python (663) #typescript (612) #cli (561) #hacktoberfest (494) #cli-tool (489) #react (482) #javascript (448) #rust (418) #cross-platform (388) #go (372) #devops (316) #ai (304) #nodejs (300) #llm (296) #golang (288) #android (271) #open-source (255) #docker (249) #machine-learning (222) #java (217) #monorepo (215) #plugin-system (214) #security (212) #self-hosted (211) #linux (207) #mcp (204) #awesome-list (197) #plugin-architecture (196) #deep-learning (187) #ai-agents (187)
supermemoryai/code-chunk ★ 211 17 APPLICATION

code-chunk is an AST-aware code chunking library designed for semantic search and RAG pipelines. It uses tree-sitter to parse source code into abstract syntax trees, extracts semantic entities (functions, classes, methods, etc.), builds a hierarchical scope tree, and chunks code at semantic boundaries rather than arbitrary character limits. Each chunk is enriched with contextual metadata including scope chain, entities, siblings, and import dependencies, producing contextualized text optimized for embedding models. The library supports multiple languages (TypeScript, JavaScript, Python, Rust, Go, Java), offers batch processing, streaming APIs, Effect integration, and WASM support for Cloudflare Workers. An accompanying evaluation harness (@supermemory/eval) compares agent performance with and without semantic search using SWE-bench Lite.

RATING: 8.6/10 MAINT: active DRIFT: low
#code-chunking #ast-aware #semantic-search #rag-pipelines #tree-sitter #embedding-optimization #multi-language #semantic-context
▸ 2 reusable components found
── end of results ──
$ submit: