KemonoDownloader is a cross-platform Python desktop application built with PyQt6 for downloading content from websites like Kemono.cr, Coomer.st, and Pawchive.pw, which aggregate content from platforms such as Patreon, Fanbox, and Gumroad. The application features a tabbed interface including modules for post downloading, creator archiving, settings management, and a built-in thumbnail downloader. It supports concurrent downloads, file deduplication via a hash database, proxy and Tor integration for anonymity, customizable file naming and folder structures, and multi-language support (English, Japanese, Korean, Chinese). A companion browser extension adds download buttons directly to the supported sites' web pages. The architecture employs a modular, tab-based design with each tab encapsulating specific functionality. Core operations such as API requests, file detection, and downloads are handled in background threads using QThread to maintain UI responsiveness. The application utilizes a SQLite-based hash database (HashDB) for efficient duplicate detection, implements robust HTTP request handling with retry mechanisms and exponential backoff, and provides thread-local session management to avoid SSL conflicts on Windows. Settings are persisted using QPlatform-specific storage, and the user interface updates dynamically for language or theme changes without requiring a restart. While the application is highly functional and demonstrates strong engineering practices in areas like concurrency control and error handling, its complexity arises from the intricate threading model and deep integration with the specific APIs of the target websites. This introduces a maintenance risk should those websites change their structure or availability. Nevertheless, the codebase exhibits clear separation of concerns, comprehensive test coverage, and reusable patterns such as the HashDB deduplication system, which could be adapted for use in other projects requiring reliable duplicate file detection.
SimpleHub is a self-hosted API aggregation monitoring and management system designed for AI relay services. It allows users to manage multiple API sites (NewAPI, Veloera, DoneHub, VOAPI, and OpenAI-compatible) from a single dashboard. The system monitors model lists for changes, tracks account balances and usage, and supports automatic daily check-in for supported platforms. It sends email notifications via Resend when model changes are detected, either individually or aggregated in scheduled batch checks. The architecture is a monolithic Node.js application using Fastify for the backend and React (with Vite) for the frontend. The backend serves the built frontend statically and exposes a RESTful API under /api. Authentication is handled via JWT tokens. Data persistence uses SQLite via Prisma ORM. The system includes a cron-based scheduler for periodic checks, with support for per-site proxy configuration (HTTP, HTTPS, SOCKS5) and automatic BunkerWeb challenge solving through proxies. External dependencies include Fastify, Prisma, Resend, node-cron, bcryptjs, and various proxy agent libraries. Key entry points are the Fastify server (port 3000), the API routes defined in routes.js, and the scheduler that manages global and per-site cron jobs. The frontend provides a modern Ant Design-based UI for managing sites, viewing model lists, checking balances, and configuring notifications. The system is designed for easy deployment via Docker or direct installation scripts, with support for alwaysdata and systemd services.
CF-Clearance-Scraper is a Python CLI tool designed to solve Cloudflare challenges (JavaScript, managed, and interactive) and extract the cf_clearance cookie for bypassing anti-bot protections. The application uses Zendriver for headless browser automation, dynamically generates realistic Chrome user agents, handles proxy authentication via CDP events, and provides output formats including raw cookies, cURL/Wget/aria2 commands, or JSON storage. The architecture is monolithic with a single entry point (main.py) featuring clean separation of concerns: argument parsing, browser orchestration, challenge detection/solving, and output formatting. Key strengths include robust user agent fallback mechanics and proxy handling, though the Cloudflare-solving logic is tightly coupled to Zendriver and challenge-specific heuristics.