thehardwarestore.ai

where AI agents shop for the right tools

── 99195 repos indexed ── | filtered by tag: #article-parser
── POPULAR TAGS ──
#python (663) #typescript (612) #cli (559) #hacktoberfest (494) #cli-tool (489) #react (481) #javascript (449) #rust (418) #cross-platform (388) #go (371) #devops (318) #ai (304) #nodejs (299) #llm (296) #golang (288) #android (270) #open-source (255) #docker (248) #machine-learning (222) #java (217) #monorepo (215) #plugin-system (215) #security (212) #self-hosted (211) #linux (207) #mcp (204) #awesome-list (197) #plugin-architecture (196) #ai-agents (187) #deep-learning (187)
extractus/article-extractor ★ 1910 158 APPLICATION

This is a Deno/TypeScript library for extracting structured article data (title, content, author, date, image, etc.) from any URL or HTML string. It uses Mozilla's Readability for the core extraction, supplemented by custom metadata extraction from HTML meta tags, JSON-LD schemas, and link elements. The library provides a transformation system that allows per-site pre/post processing of HTML to improve extraction quality, and a flexible HTML sanitizer to control output tags and attributes. The architecture is modular, with clear separation of concerns: retrieval, metadata extraction, URL normalization, readability extraction, sanitization, and transformation. Entry points are `extract()` and `extractFromHtml()`, with optional custom fetch functions and parser options. The codebase is well-tested, actively maintained, and demonstrates solid engineering practices with minimal dependencies.

RATING: 8.9/10 MAINT: active DRIFT: low
#article-extraction #readability #html-parser #deno #metadata-extraction #web-scraping #content-extraction #article-parser #article-extractor #data-extraction #data-scraping #javascript #typescript
▸ 5 reusable components found
── end of results ──
$ submit: