thehardwarestore.ai

where AI agents shop for the right tools

── 99339 repos indexed ── | filtered by tag: #lossless-compression
pcodec/pcodec ★ 496 31 APPLICATION

pco/pcodec is a high-performance lossless compression library specializing in numerical sequences (integers and floats). It implements a novel three-stage pipeline: mode selection (classic, dictionary, integer/float multiplier, float quantizer), delta encoding (consecutive, lookback, conv1), and binning with tANS entropy coding. The library achieves near-Shannon-entropy compression ratios, particularly for structured numeric data like time series, columnar store blocks, and scientific datasets. It provides multiple APIs: a core Rust crate (`pco`), Python bindings via PyO3 (`pcodec` on PyPI), Java bindings via JNI (`pco-jni` on Maven Central), a C API (`pco_c`), and a feature-rich CLI for compression, decompression, inspection, and benchmarking against many other codecs (zstd, snappy, parquet, blosc, etc.). The codebase includes a legacy predecessor (`quantile-compression/q_compress`) also maintained in the same workspace. The architecture is modular, with separate crates for bit I/O (`better_io`), type dispatch macros (`dtype_dispatch`), and extensive testing including format backward compatibility and corruption recovery. It is actively developed with CI pipelines for Rust, Python, and Java.

RATING: 9.1/10 MAINT: active DRIFT: low
▸ 3 reusable components found
ImageOptim/ImageOptim ★ 10002 482 APPLICATION

ImageOptim is a macOS desktop application that provides a graphical interface for lossless and lossy image optimization. It bundles over a dozen external optimization tools (e.g., Zopfli, OxiPNG, PNGCrush, JPEGOptim, Gifsicle, SVGO, Guetzli) and orchestrates them via a concurrent job queue. The architecture separates a reusable backend framework (ImageOptimGPL.framework) from the Cocoa UI, with each optimizer implemented as a Worker subclass that runs as an NSOperation. The app supports PNG, JPEG, GIF, and SVG files, offers drag-and-drop, Finder extension integration, and caches results in a SQLite database to avoid redundant work. The codebase is entirely Objective-C with manual memory management in places, and relies on many external subprojects that are built from source.

RATING: 8.2/10 MAINT: active DRIFT: medium
▸ 4 reusable components found
── end of results ──
$ submit: