This repository is the official CLI tool for Firecrawl, a web scraping, crawling, and structured data extraction platform. Built with Node.js and TypeScript, it provides a comprehensive command-line interface (CLI) using the Commander framework. In production, it allows users to scrape individual URLs, perform multi-page crawls, search the web (text, images, news), map site structures, interact with cloud browser sessions, create recurring content monitors, and use AI agents for complex extraction tasks. It also includes a research paper search feature covering ~43 million abstracts from PubMed, bioRxiv, medRxiv, and arXiv, as well as a developer index for searching GitHub issues, PRs, and READMEs. The CLI is designed for both direct human use and integration with AI coding agents via MCP (Model Context Protocol) and a skills system. Architecturally, it follows a command-per-file pattern in src/commands/, with shared utilities in src/utils/ for API client management, configuration/credential handling, output formatting, authentication (PKCE OAuth, API key, keyless free tier), and job polling. The core data flow is: user input -> command handler -> Firecrawl REST API (cloud or self-hosted) -> formatted output to stdout or file. External dependencies include the firecrawl SDK, commander, @inquirer/prompts, yaml, and zod-to-json-schema. The tool supports binary builds via Bun compile and is distributed via npm, Homebrew, and GitHub Releases with .deb/.rpm packages. It also includes interactive setup wizards, MCP server installation for coding agents, and a native skill installer. While primarily an application, the research paper search feature gives it a hybrid data-access character, but it does not contain data pipelines, notebooks, or analytical models. The codebase is well-tested (Vitest) and actively maintained, with CI/CD workflows for testing, npm publishing, and binary releases. However, the large command surface and agent-specific integrations introduce some maintenance complexity, and the reliance on the firecrawl SDK and external APIs means changes upstream could require updates.
HakuNeko is a multi-platform desktop application for downloading manga, manhwa, manhua, anime, and novels from hundreds of websites. It provides a plugin-based scraping engine that uses decorators and base templates to extract metadata (title, chapters, pages) via CSS selectors, JSON APIs, GraphQL, or protobuf-encoded data. The system includes anti-scraping evasion (Cloudflare bypass, cookie/header injection, remote browser windows for DRM-locked content), image descrambling/decryption, and export to CBZ, EPUB, PDF, or image directories. Architecturally, the repository is a monorepo with three main packages: web (engine + frontend), app/electron, and app/nw. The core engine lives in web/src/engine and defines interfaces for media containers (Manga, Chapter, Page), a plugin controller that loads ~500+ website scraper classes, a task pool for rate-limited concurrent downloads, and a platform abstraction layer that selects the appropriate implementation for Electron, NW.js, or browser runtime. Two frontends exist: a classic Carbon/Svelte UI and a Fluent Core/FAST Web Components UI, both communicating with the engine through an IPC/RPC layer. Key entry points are web/src/index.ts (bootstraps the app, registers service worker, loads frontend), web/src/engine/HakuNeko.ts (service locator), and the scraper files under web/src/engine/websites/. Data flows from website HTML/API through decorators and templates into typed Manga/Chapter/Page objects, then to the download manager which fetches images, optionally transforms them (descramble, decrypt), and writes them to disk via StorageController. The system relies on external dependencies like Chromium (via Puppeteer for e2e tests and remote browser windows), protobuf.js for binary-based scrapers, and various npm packages for crypto, archiving, and UI components. While the codebase is well-organized in its core modules and demonstrates high craftsmanship in patterns like decorator-based scraping, Observable state management, and platform abstraction, the huge number of website-specific scrapers introduces maintenance fragilityβmany depend on hardcoded selectors, API endpoints, and decryption keys. There are legacy stubs, deprecated decorator usage (experimentalDecorators), and some duplicated descrambling logic across scrapers. Overall, the repo is actively maintained (last commit in 2026, CI workflows active) but shows medium technical drift in its scraper ecosystem.
This repository manages the Interop project, a collaborative effort among browser vendors to improve cross-browser interoperability of key web platform features. It contains process documentation, focus area definitions, test lists, and a mapping of focus areas to web features. The only functional code is a Node.js script (`scripts/identify-web-features.js`) that runs as a GitHub Action to automatically identify web features referenced in focus area proposal issues and post a comment with enriched data from the web-features project. The script is well-structured, testable, and handles edge cases like moved/split features and concurrent comment creation. The repository is primarily a coordination hub rather than a traditional application or data pipeline, but the automation script demonstrates solid engineering practices.
OASIS is a CLI-first security analysis tool written in Python. It orchestrates a multi-phase LangGraph pipeline (Discover β Scan β Expand β Deep β Verify β Report) to detect vulnerabilities in source code using local LLMs via Ollama or OpenAI-compatible servers. The tool supports 25+ vulnerability types across multiple languages, produces deterministic verdicts without LLM reliance, and integrates with CI via severity-gated exit codes, suppression registries, and report diffing. It is installed via pipx or Docker and run as `oasis -i /path --models ...`.
Comedot is a Godot Engine 4.8+ framework for 2D game development that implements an Entity-Component-System architecture. It provides over 120 reusable components for gameplay mechanics including combat, movement, control, abilities, upgrades, inventory, turn-based systems, and UI elements. The framework emphasizes composition over inheritance, allowing developers to mix and match components to create entities for any 2D game genre. It includes template scenes for quick starts, editor plugins for component management, and extensive debugging tools. While actively maintained, the codebase shows signs of ongoing development with numerous experimental features and TODO comments indicating areas for improvement.
Peanut-GB is a high-speed, portable Game Boy (DMG) emulator library implemented as a single C99 header file (peanut_gb.h). It provides a complete emulation core including CPU, memory, LCD, cartridge (MBC1/2/3/5), RTC, serial link, and boot ROM support. The library is designed for easy integration into other projects via a callback-based architecture where the frontend provides ROM read, RAM read/write, error handling, and optional LCD line drawing and audio callbacks. The repository includes multiple example frontends demonstrating integration with SDL2 (full emulator with audio and controls), MiniFB (minimal X11 framebuffer), a debug CLI, a Nuklear-based GUI debugger with disassembler and VRAM viewer, and a benchmark tool. A test suite using the minctest.h framework runs Blargg's CPU instruction and timing tests as well as the dmg-acid2 LCD hash test. The library is MIT-licensed and has been used in several real-world projects (Pico-GB, CPBoy, PlayGB). While the core is well-crafted and portable, known inaccuracies exist (line-by-line LCD rendering, audio timing) and some features are incomplete (MBC6/7, camera). The build system is fragmented across Makefiles and CMake, and some examples have version drift in vendored dependencies.
This is a privacy-focused Android application for scanning and generating QR codes and barcodes, developed by the SECUSO research group (Security, Usability, Society) at TU Darmstadt. The app uses the device camera to decode codes, supports image picker scanning, and provides a QR code generator for various content types (URL, text, email, phone, SMS, WiFi, vCard, MeCard, BizCard, geo-location, product, calendar, etc.). It emphasizes minimal permissions (only camera, no internet required for scanning) and includes phishing protection by highlighting domains and requiring user confirmation before opening links. The architecture follows standard Android patterns: Activities with ViewModel + LiveData, Room database for scan history, Repository pattern, and a navigation drawer for main sections (Scanner, Generator, History, Settings, Help, About). The codebase is a mix of Java and Kotlin, uses AndroidX, Material Design, ZXing for barcode decoding, and Glide for image loading. It also integrates a backup service via a git submodule (privacy-friendly-backup-api). The app is part of the Privacy Friendly Apps suite and is licensed under GPLv3.
This is the playit.gg tunnel agent, a production-grade client-side daemon that exposes local servers (e.g., Minecraft, game servers, web services) to the internet through the playit.gg tunnel network. The system is organized as a Rust multi-package workspace comprising five main crates: `agent_core` (tunnel state machine, TCP/UDP proxying, control connection), `playitd` (background daemon with IPC server, stats, log rotation), `playit-cli` (CLI and TUI frontend using ratatui), `playit-ipc` (local IPC protocol with version negotiation), and `playitd-tray` (Windows system tray controller). It supports Linux, Windows, macOS, and FreeBSD, with platform-specific path handling (Unix sockets, named pipes, Windows service management). The architecture centers on a UDP control connection to playit.gg servers: the agent authenticates via HMAC-SHA256, receives tunnel assignments, then proxies TCP and UDP traffic between tunnel ingress points and local origin servers. The daemon runs as a background service (systemd, OpenRC, Windows service) and exposes a local IPC endpoint for the CLI/TUI to monitor logs, stats, and lifecycle status. Key entry points include `packages/playitd/src/bin/playitd.rs` (daemon binary), `packages/playitd/src/bin/playitd-service.rs` (Windows service host), `packages/playit-cli/src/main.rs` (CLI with attach/start/stop/claim commands), and `packages/playitd-tray/src/main.rs` (Windows tray application). External dependencies include tokio (async runtime), ratatui (TUI), crossterm (terminal), serde (serialization), reqwest (REST client), and ring (HMAC). The codebase demonstrates strong craftsmanship in low-level networking (zero-copy UDP packet pools, PROXY protocol, statically-sized control messages) and state machine design (connection recovery, MTU probing, address selection). However, it suffers from some production debt: panics in critical paths (UDP channel shutdown, flow invariants), duplicated code between `playitd-tray` and `playitd-windows-setup` startup shortcuts, and hardcoded configuration values (control port, protocol version). The build and release infrastructure is extensive (nfpm, WiX, Docker, Arch PKGBUILD, code signing) but shows signs of fragility (stale binary name in mac-deploy.sh, sed-based version overrides).
This repository builds and publishes Docker images tailored for use with nektos/act, a tool that runs GitHub Actions locally. The images are based on Ubuntu (22.04, 24.04, 26.04) and come in multiple variants: a base 'act' image, a 'runner' image with a non-root user, and flavour images that add specific toolchains (JavaScript, Go, Rust, .NET, Java, PowerShell, GitHub CLI, and a custom combination). The build process uses buildah for multi-architecture (amd64, arm64) container builds and pushes the resulting images to GitHub Container Registry and Docker Hub. The repository also includes a workflow to copy full runner images from an external source and re-tag them. The architecture is a set of shell scripts and Dockerfiles orchestrated by GitHub Actions workflows. The main entry point is the build-ubuntu.yml workflow, which triggers on schedule, push, or pull request. It uses a PowerShell script (build.ps1) to invoke buildah with manifest-based multi-arch builds. Installation scripts for each flavour are located under linux/ubuntu/scripts/ and are sourced by the Dockerfile. Helper scripts in linux/ubuntu/scripts/helpers/ provide reusable functions for environment variable management, download with retries, checksum verification, and OS version detection. The codebase is actively maintained (last commit within days, regular scheduled builds) and shows low technical drift. Dependencies are kept current through automated downloads of latest tool versions. The helper scripts are well-isolated and could be extracted for use in other container build projects. The overall quality is solid, with clean separation of concerns and robust error handling in the build pipeline.
FreeMote is a Windows-oriented .NET Framework 4.8 toolchain for reverse-engineering, decompiling, converting, rendering, and rebuilding E-mote (EMT) PSB game asset packages. It is primarily an application suite rather than a data/research project: five CLI tools (EmtConvert, PsbDecompile, PsBuild, EmtMake, FontBuilder-related commands) plus a WPF viewer provide user-facing workflows, while the core libraries FreeMote, FreeMote.Psb, and FreeMote.PsBuild implement binary parsing, encryption, plugin dispatch, compilation/decompilation, and platform conversion. The architecture is modular: FreeMote handles low-level container and crypto primitives, FreeMote.Psb provides the PSB object model and plugin interfaces, FreeMote.PsBuild handles JSON/PSB conversion and E-mote project generation, and FreeMote.Plugins supplies compressors, image/audio codecs, and shell handlers through MEF composition. The primary data flow is file-in/file-out: encrypted or shell-wrapped PSB containers are opened through FreeMount plugin composition, decrypted or unpacked into an in-memory PSB object graph, decompiled to JSON plus extracted resources, then optionally recompiled, re-encrypted, and packed back into shells. The reverse pipeline also supports building PSB from JSON, generating bitmap fonts, porting between Kirikiri/Windows/common/console specifications, converting motion PSB into MMO editor projects, and extracting textures/audio from archives. The code embodies deep reverse-engineering knowledge: PSB versions 1-4, trie-compressed name tables, XorShift128/MT19937 cipher handling, MDF/LZ4/Zlib shells, ASTC/BC7/DXT/TLG pixel formats, and console-specific texture swizzling. Although the repo contains research-grade format analysis, its dominant character is an application toolkit for game modding. It is actively maintained with CI packaging, tests, and a plugin ecosystem, but carries medium technical drift: legacy .NET Framework and System.Drawing dependencies, Direct3D9 interop in the viewer, reliance on external executables for some audio/image encoders, hard-coded platform heuristics, and a large monolithic Psb.cs with TODO debt. The most reusable assets are self-contained texture utilities and the generic plugin/composition pattern, not the tightly coupled PSB-specific pipeline components.
AutoClicker is a Windows desktop application built with WPF for automating mouse clicks. It allows users to configure click interval, mouse button, click type, repeat mode, and click position (current cursor or a specified location). The application runs in the system tray and can be controlled via configurable hotkeys (default F6, F7, F8) or through the GUI. Settings are persisted to a JSON file in the user's AppData directory. The architecture separates concerns into UI (Views), data models (Models), utility functions (Utils), and command bindings (Commands).
This repository provides a collection of open-source display rendering transforms (DRTs) and creative look transforms for professional color grading and compositing pipelines, specifically targeting DaVinci Resolve (via DCTL) and The Foundry Nuke (via .nk group nodes). The core functionality converts scene-referred imagery to display-referred output through a pipeline of gamut conversion, tone scale compression, hue processing, purity compression, and display encoding. It includes multiple DRT implementations (OpenDRT, Tesseract, Chromagnon, JzDT) with varying design philosophies, as well as a suite of look modification tools (ZoneGrade, NotoriousSix series, Nayatani HK, etc.) and utility transforms for gamut and log conversion. The code is grounded in color science standards (ACES, ITU-R BT.2100, CIE XYZ) and academic literature, with careful handling of edge cases through safe math functions. While the transforms are tightly coupled to their target platforms and lack automated testing, the shared header files (libDRT.h, libLMT.h) and standalone utilities demonstrate reusable patterns for color conversion and mathematical operations.
NetCoreKevin is an enterprise-level AI middleware platform built on .NET 9 with a Vue 3 frontend. It provides a multi-tenant SaaS backend with AI agent capabilities, RAG knowledge base, permission management, file storage, messaging, and code generation. The architecture follows Domain-Driven Design with modular plug-ins, featuring a generic repository pattern, base service classes, and extensive cross-cutting concerns (caching, logging, transaction management, distributed locks). The AI agent framework supports tool calling, skill management, memory, safety layers, and streaming responses. The frontend uses Ant Design Vue with multi-theme support. While the codebase is well-structured and feature-rich, it exhibits some technical debt such as static service locators, large helper classes, and raw SQL usage in places. Overall, it is a solid, production-ready application with reusable components.
This repository is a comprehensive data research project tracking the open-source Agentic AI ecosystem. It ingests data from GitHub (metadata, READMEs, stargazers), ClickHouse (OpenDigger OpenRank metrics), HuggingFace Hub (model metadata, downloads), and usage platforms like OpenRouter and ZenMux. The data is transformed through a series of Python scripts that enrich, classify, and score projects and models, producing weekly trend reports, landscape snapshots, case studies, and presentation materials. The core analytical framework uses OpenRank-based vitality scoring, a keyword taxonomy for project classification, and composite model rankings. Outputs include markdown reports, SVG charts, PPTX decks, and curated CSV datasets. While the repository is primarily a data analysis and reporting hub, it also contains agent skill definitions and change management workflows (OpenSpec), giving it a hybrid character. The codebase is actively maintained with weekly automated pipelines, but reproducibility is limited by hardcoded paths, missing Python dependency pinning, and reliance on external APIs with changing access patterns.
This repository is a Next.js application demonstrating the use of the OpenAI Realtime API via WebRTC for real-time voice interaction with a 3D solar system scene built in Spline. The application allows users to ask questions about the solar system, moons, the ISS position, and data visualizations, which trigger function calls to update the 3D scene or display charts in the UI. The architecture consists of a frontend built with React and Next.js, featuring components for the 3D scene (using @splinetool/react-spline), controls for managing the WebRTC connection, and a debug log. Two API routes proxy requests to external services: one for fetching the ISS position and another for obtaining ephemeral client secrets from the OpenAI Realtime API. The frontend establishes a WebRTC connection to OpenAI, sends audio input, and processes function call responses to trigger animations in the Spline scene or update the UI with charts. A notable reusable component is the charting system located in `components/charts/chart.tsx`, which provides a set of theme-aware, flexible charting components (Container, Tooltip, Legend) that abstract the complexity of integrating Recharts and Chart.js with Tailwind CSS. This component demonstrates a clean separation of concerns and can be adapted for use in other projects with minimal modification. The rest of the codebase is tailored to the solar system demo but follows modern React and Next.js best practices, including TypeScript strict mode, proper error handling, and modular organization. The application is actively maintained, with recent commits and up-to-date dependencies, and exhibits low technical drift, adhering to current web standards and APIs.
This is a Visual Studio Code extension providing comprehensive language support for Garry's Mod Lua (GLua). It delivers syntax highlighting, autocompletion, hover documentation, signature help, go-to-definition, find references, color picker, type hints, file previews (VTF/PNG), workspace scanning, global variable optimization, and a bytecode heatmap generator. The extension is built as a single Node.js process using the VS Code API, with a custom Lua parser (gluaparse) for AST analysis and a bundled gluac binary for LuaJIT bytecode manipulation. It downloads wiki data from a remote server and caches it locally. The codebase is well-organized into providers and commands, but is tightly coupled to the VS Code extension model and Garry's Mod-specific data sources, limiting direct reuse outside this context. A Python-based generator script for scraping the Facepunch wiki is also included as a separate tool.
MainWP Dashboard is a WordPress plugin that provides a centralized management console for controlling multiple WordPress child sites from a single dashboard. It enables administrators to perform bulk updates, backups, security monitoring, uptime checks, content publishing, user management, and cost tracking across all connected sites. The system is architected as a monolithic WordPress plugin with modular extensions (logs, cost tracker, API backups, system monitor) that each have their own database tables, admin pages, REST endpoints, and cron jobs. Key entry points include the main plugin bootstrap (mainwp.php), AJAX handlers via MainWP_Post_Base_Handler, REST API v2 controllers under /mainwp/v2/, and a new Abilities API (wp-abilities/v1/) for programmable site operations. Data flows involve periodic cron tasks that sync child site status, updates, and health metrics into custom database tables, which are then exposed through dashboard widgets, email notifications, and REST endpoints. External dependencies include the WordPress core, phpseclib for encryption, and various JavaScript libraries (jQuery, Semantic UI, DataTables, ApexCharts, Dropzone, GridStack). The codebase demonstrates professional engineering with extensive test coverage (PHPUnit for abilities, REST, and regression tests), a structured class hierarchy, and security-conscious patterns like nonce verification, capability checks, and credential encryption at rest. However, it also carries legacy complexity from years of development, including large raw SQL queries, singleton overuse, and some deprecated PHP practices.
This repository is a Chinese-language translation and expansion of the Learn wgpu tutorial series, teaching the wgpu Rust implementation of the WebGPU graphics API through a Cargo workspace of ~25 runnable example crates. The curriculum progresses from window/surface setup (tutorial1-2), render pipelines and buffers (tutorial3-4), textures/uniforms/instancing/depth (tutorial5-8), through OBJ model loading, Blinn-Phong lighting, normal mapping, camera control, compute-shader terrain generation, HDR rendering, and particle systems. Each example is a small but complete winit application that runs natively and as WebAssembly via wasm-bindgen, sharing a common utils crate that provides the WgpuAppAction lifecycle trait, node-based render abstractions (ViewNode, ComputeNode, BufferlessFullscreenNode), and buffer/bind-group helpers. A VitePress documentation site embeds live WASM demos of the examples, and showcase crates demonstrate a Pong game, offscreen GIF encoding, multithreaded model loading, and compute-shader tangent generation. Although primarily a tutorial codebase, it is genuinely hybrid: it doubles as a deployable documentation site and a reference implementation of modern wgpu patterns.
Squeezelite is a lightweight, headless Squeezebox emulator that acts as a network audio player for Lyrion Music Server (formerly Logitech Media Server). It receives audio streams via the Slimproto protocol, decodes a wide range of codecs (MP3, FLAC, AAC, Ogg Vorbis, WMA, ALAC, DSD, Opus), and outputs to local audio hardware through ALSA, PortAudio, PulseAudio, or stdout. The application is written in C with a modular, multi-threaded architecture: separate threads for network streaming, decoding, resampling, and output, all communicating via circular buffers with mutex protection. It supports high-resolution audio, DSD (DoP and native), resampling with libsoxr, visualizer export to shared memory, IR remote control, and GPIO amplifier control. The codebase is highly portable, with dedicated Makefiles for Linux, macOS, Windows, Solaris, and various ARM architectures, as well as Visual Studio project files. Build-time options (LINKALL, DSD, RESAMPLE, etc.) allow static or dynamic linking of codec libraries. The project is actively maintained with a responsive community and is widely used in embedded audio players and home automation systems.
This repository is a Home Assistant custom component for integrating Xiaomi Smart Pedestal Fans (and several other fan models) into the Home Assistant ecosystem. The code in `fan.py` defines a hierarchy of Python classes, starting from a generic `XiaomiGenericDevice` base and specializing through `XiaomiFan`, `XiaomiFanP5`, `XiaomiFanMiot`, and many model-specific subclasses (e.g., `XiaomiFanZA5`, `XiaomiFanP76`). Each subclass maps the device-specific miIO/MIoT properties to Home Assistant's `FanEntity` interface, providing controls for power, speed percentage, preset modes, oscillation angles, LED brightness, buzzers, child locks, and timer delays. The integration also includes custom service definitions (e.g., `fan_set_oscillation_angle`, `fan_set_buzzer_on`) declared in `services.yaml` and `strings.json`. The architecture cleanly separates device communication logic (MiotDevice subclasses with property mappings) from Home Assistant entity logic (FanEntity subclasses). The code is well-structured, uses type hints, follows Home Assistant best practices, and includes CI workflows (HACS validation, hassfest, mypy, pre-commit, yamllint). It targets Python 3.13 and modern HA versions (2024.8+). There are no data research or analytics elements; it is strictly an application integration.