$ show H-M-H/Weylus
Weylus is a cross-platform application that turns tablets and smartphones into graphic tablets/touch screens for computers. It operates by running a local web server that serves a web page to the tablet's browser. The web page captures pointer, touch, stylus, keyboard, and wheel events via JavaScript PointerEvents and sends them over a WebSocket connection to the server. The server then simulates these input events on the host machine using platform-specific mechanisms: on Linux it uses the uinput kernel module for full stylus/touch/mouse/keyboard support; on macOS and Windows it falls back to the autopilot library for mouse/keyboard simulation and Windows-specific synthetic pointer injection for touch/pen. Simultaneously, Weylus captures the screen (or a selected window/monitor) using platform-native APIs: X11 shared memory (XShm) on Linux X11, PipeWire/GStreamer on Wayland, CoreGraphics on macOS, and DirectX via captrs on Windows. The captured frames are encoded into a fragmented MP4 H.264 video stream using a statically linked ffmpeg (libx264) with optional hardware acceleration (VAAPI, NVENC, VideoToolbox, MediaFoundation). The video stream is sent to the browser via the same WebSocket connection and played using the Media Source Extensions API. The application provides a GUI (built with FLTK) for configuration and a headless mode for automation. It supports access codes, custom input areas, and multiple simultaneous clients.
The LLM identified 3 files worth highlighting for reuse:
Defines the complete message protocol between the web client and the server using serde for serialization. Includes enums for inbound/outbound messages, pointer events, keyboard events, wheel events, and configuration structures. The code is clean, well-typed, and completely independent of the rest of the codebase, making it reusable in any project requiring a similar WebSocket-based event protocol.
A self-contained C module that wraps ffmpeg's libavcodec, libavformat, and libavfilter to create a low-latency H.264 video encoder. It supports software encoding via libx264 and hardware acceleration via VAAPI, NVENC, VideoToolbox, and MediaFoundation. The module handles scaling, pixel format conversion, and fragmented MP4 output. It exposes a clean C API that can be called from any language via FFI, and is already used by the Rust code in src/video.rs.
Implements the InputDevice trait for Linux using the uinput kernel module. Creates virtual input devices (keyboard, mouse, stylus, touch) and sends raw input events. Handles multitouch slots, pen tilt/pressure, and high-resolution scroll wheels. Includes a workaround for X11 coordinate transformation matrix mapping. This module is largely self-contained (depends only on cerror.rs and the Capturable trait) and could be extracted for other projects needing low-level input simulation on Linux.