OpenMontage is an open-source, agentic video production platform where an AI coding assistant (Claude Code, Cursor) orchestrates the entire pipeline. It provides a library of 100+ tools (video generation, audio, graphics, enhancement, analysis, avatar, subtitles) behind a scored provider selection layer, and 10+ production pipeline manifests (animated explainer, cinematic, documentary montage, talking head, etc.) that define stage order, approval gates, and tool assignments. The core architecture is a Python framework with a BaseTool class, ToolRegistry for auto-discovery, pipeline loader, checkpoint system, and a Remotion-based video composer. It also includes a Backlot living storyboard server for live production monitoring and an Ink Theater procedural puppetry engine. While primarily an application, it contains data/research elements such as ManimGL/ManimCE educational animation examples covering transformer internals, quantum mechanics, and ML concepts, as well as a CLIP-based corpus builder for documentary montage pipelines.
This repository is a small Python demo application that turns a webcam feed into a real-time David Attenborough-style nature documentary narration. It consists of two independent processes: capture.py grabs frames from the webcam every 2 seconds, resizes them to a maximum dimension of 250 pixels, and writes them to frames/frame.jpg; narrator.py polls that file, base64-encodes it, sends it to OpenAI's GPT-4 Vision API with a snarky Attenborough system prompt, appends the response to a running conversation script, synthesizes speech via ElevenLabs, and plays the audio aloud. The two processes communicate through the filesystem, which is a simple but effective decoupling pattern for a demo. The code is functional and readable, with a few thoughtful touches: the image is downscaled before upload to reduce API cost and latency, and the narrator retries reading the frame file when it catches a transient EACCES error caused by the capture process writing concurrently. However, it is a proof-of-concept rather than a production application: there are no tests, no error handling for API failures, hardcoded paths, and the pinned dependencies are from late 2023. The OpenAI model 'gpt-4-vision-preview' and the ElevenLabs 'generate/play' API are both deprecated, so the code would need updates to run against current APIs. Despite a recent commit timestamp in the metadata, the codebase is effectively a frozen 2023 demo. The maintainer has not updated dependencies or addressed the deprecated APIs, and 41 open issues remain. It is best treated as a reference implementation or a starting point for a webcam-to-AI-narration pipeline, not as a maintained library.