Miller (mlr) is a command-line data processing tool for structured text formats including CSV, TSV, JSON, JSON Lines, YAML, DKVP, and others. It operates as a streaming pipeline: input records are read from files or stdin, processed through a chain of transformer verbs (e.g., cut, sort, join, stats1, put, filter), and written to output in any supported format. The tool includes a domain-specific language (DSL) for record-level transformations, with support for user-defined functions, subroutines, loops, and higher-order functions. Miller is designed for performance, using Go channels for concurrent streaming, batch processing, and a slab allocator for efficient memory use. The architecture is a monolithic CLI application written in Go with no external runtime dependencies. Key entry points include the main binary (cmd/mlr/main.go), the entrypoint dispatcher (pkg/entrypoint), and the terminal subcommands (help, repl, script, regtest, mcp). The codebase is organized into packages for input readers, output writers, transformers (verbs), DSL parsing and execution, CLI flag handling, and a core value type system (Mlrval). Miller also provides an MCP (Model Context Protocol) server for AI agent integration, shell completion scripts, and a REPL for interactive use. Miller is not a research project; it is a production-grade data munging tool comparable to awk, sed, cut, join, and sort but for name-indexed data. Its primary data flows involve reading heterogeneous records, applying transformations via verbs or DSL expressions, and writing results. The tool handles compressed files, in-place editing, and output redirection to files or pipes.
This repository provides a PowerShell profile script that enhances the command-line experience with automatic self-updating, integration with tools like Oh My Posh, zoxide, and Terminal-Icons, and extensive helper functions for file operations, process management, Git, and system tasks. The profile is designed to be modular, allowing user customization via override functions and variables without modifying the core script. It includes robust error handling, uses ShouldProcess for safe operations, and maintains a clean separation of concerns through well-defined functions. The profile script features a sophisticated update mechanism that checks for remote versions, compares file hashes to avoid unnecessary downloads, and applies updates with user confirmation. It configures PSReadLine for advanced syntax highlighting and key bindings, initializes optional modules conditionally, and provides a wide range of aliases and functions for daily productivity. The setup script automates installation of the profile and dependencies while backing up existing profiles, ensuring a safe and reproducible setup process. The code demonstrates strong engineering practices: parameter validation, proper resource disposal, conditional logic for different PowerShell editions, and thoughtful fallback mechanisms. While not exceptionally groundbreaking, it represents a well-crafted, maintainable solution that solves a common problem (shell enhancement) with attention to detail and user experience.
This repository is a curated collection of Go packages extracted from the Go standard library's internal packages, plus a few CLI tools built on top of them. The primary package is `testscript`, a robust script-based testing framework that uses txtar archives as test scripts. It provides a declarative way to write integration tests with built-in commands (exec, cmp, stdout, stderr, etc.) and supports external plugins via JSON-RPC. Other notable packages include `diff` (an O(n log n) anchored diff algorithm), `txtar` (a simple human-readable archive format), `lockedfile` (cross-platform atomic file operations with locking), `robustio` (transparent retry for ephemeral I/O errors), `cache` (build artifact cache with SHA256 indexing), and `par` (parallel work executor with memoization). The repo also includes CLI commands: `cmd/testscript` (standalone runner), `cmd/txtar-c` (archive creation), `cmd/txtar-x` (extraction), `cmd/txtar-addmod` (add module to archive), and `cmd/txtar-goproxy` (serve modules from archives). The architecture is modular; each package is independent and can be reused separately. There are thin forwarding layers to `golang.org/x/mod` and `github.com/google/renameio` for compatibility. The codebase demonstrates high craftsmanship in package design, platform-specific abstractions (build tags), and testing utilities. The primary domain is Go tooling and testing infrastructure.
This repository is a curated list of command-line tools, designed to help users discover and evaluate CLI utilities for various tasks. It does not contain any executable code or application logic; instead, it serves as a static reference document hosted on GitHub. The main content resides in `readme.md`, which organizes tools into categories such as CSV, File System, Git, Networking, and Programming Languages, each with links to the tools' source repositories and concise descriptions. Contribution guidelines are provided in `contributing.md` to maintain the list's quality and consistency. The repository uses shields.io badges to display metadata like the license and links to related curated lists. Although the repository lacks reusable software components or architectural patterns due to its static nature, it is well-maintained with recent commits and active issue tracking. It exhibits low technical drift as it has no code dependencies to become outdated. As a reference resource, it effectively fulfills its goal of aggregating CLI tools, though it does not demonstrate notable software engineering craftsmanship.