MsgVault is a self-hosted, local-first personal communications archive system. It ingress messages from email (IMAP, Gmail, mbox, PST), chat (Slic, Discord, Matrix, Beeper, WhatsApp, Facebook Messenger), SMS, meeting ttranscripts (Granola, Circlback, Plaud, Muelsi), and contacts (CardDAV, vCard). It store them in SQLite or PostgreSQL with full-text and vector embeddings search, provides a rich HTTP API, a Svelte web UI, a CLI, and an MCP serve for AI tools. The system es also feature person identity matching across source, contact syn, document indexing, and telemetry. Technically, it is a monolithic Go binary with modular packages, abdecking both interactive use and automated daemon operation. While it is alpha software with frequent API changes, its architecture is well-structure, extensively tested, and includes several reusable component like robust error classification, HTTP retry logic, and cross-process cache locking. The frontend uses generated TypeScript clients from the OpenAPI spec, and the entire system is deployable via Docker or native binaries.
Promnesia is a browser extension (Chrome/Firefox) paired with a Python backend that enriches browsing history with contextual metadata from personal data sources. The backend indexes visits from browser history, bookmarks, chat logs (Telegram, Signal, etc.), social media (Reddit, Twitter, Hacker News), note-taking apps (Hypothesis, Pocket, Instapaper), and plaintext files into a SQLite database. A FastAPI server exposes endpoints (`/visits`, `/search`, `/visited`) that the extension queries to annotate visited links and display a sidebar with visit context, timestamps, and highlights. The system uses URL normalization (canonical URLs) to deduplicate visits across sources and supports user-defined filtering and hooks. The architecture is split into a Python CLI (`promnesia index` / `promnesia serve`), a TypeScript browser extension built with Rollup, and Docker containers for automated indexing. While the core is a personal data application, it also serves as a data pipeline for aggregating and querying personal activity, giving it a hybrid character.
InfoSpider is a Windows-only desktop application that aggregates personal data from over 20 online services (e.g., GitHub, JD, Taobao, Alipay, Zhihu, Bilibili) using Selenium-based browser automation and a companion Chrome extension. The user launches a wxPython GUI, selects a data source, logs in via an automated Chrome window, and the tool scrapes orders, bills, contacts, posts, and other personal information, saving it as JSON files. Some spiders also generate HTML charts (word clouds, time-series plots) from the scraped data. The repository includes a separate, experimental PyTorch LSTM model for stock price prediction in `tests/DeepAnalysis/`, which is not integrated into the main tool. The codebase is a monolithic collection of spider scripts with a simple GUI wrapper, relying on outdated library versions (Selenium 3.141.0, pandas 1.0.1) and brittle automation patterns (hardcoded selectors, sleep-based waits). It has not seen active development since 2020 and carries significant technical drift and maintenance risks.