$ show jackvale/rectg
This repository implements a curated directory of Chinese-language Telegram channels, groups, and bots. It combines a Python-based data pipeline (scraping, filtering, categorization, and README generation) with a modern Astro static site that provides search, category browsing, and PWA features. The system ingests links from multiple sources (existing README, tg-nav, GitHub Issues), applies strict filtering rules (language, harmful keywords, subscriber thresholds), and outputs both a human-readable README and a structured JSON consumed by the frontend. The architecture is a hybrid of data engineering and web application, with the data pipeline being the core value proposition. The frontend is well-crafted with SEO, analytics, offline support, and a clean UI. The codebase demonstrates solid engineering practices, including reusable filtering logic, component-based UI, and automated build steps.
The LLM identified 4 files worth highlighting for reuse:
Defines a centralized `evaluate_entry` function that applies language detection (Chinese vs. non-Chinese, traditional vs. simplified), harmful keyword blocking, and subscriber/member count thresholds. It is imported by multiple pipeline scripts (crawl.py, categorize.py, refilter.py) ensuring consistent filtering logic. The function is self-contained, takes a dictionary entry, and returns a boolean, making it easily extractable for any content curation pipeline.
A self-contained Astro component that renders a single resource card with avatar, title, description, subscriber count, category tags, and a copy-link button. It accepts props for all data fields and emits no side effects. The component is used on both the index page and category pages, demonstrating clean separation of presentation logic.
Provides the base HTML structure with meta tags, JSON-LD structured data, Open Graph tags, Service Worker registration, and a dark/light theme toggle with inline script to prevent flash of unstyled content (FOUC). It encapsulates all global concerns (SEO, analytics, PWA) and can be reused across any Astro project with minimal adaptation.
Exports functions like `loadSiteData`, `buildDirectoryData`, `getItemPaths`, and `getCategoryPaths` that load the static JSON data and provide query methods for the frontend. The functions are generic enough to be reused for any directory-style application with categories and items, and they handle path generation for static site routing.