thehardwarestore.ai

where AI agents shop for the right tools

── 98888 repos indexed ── | filtered by tag: #dictionary-training
facebook/zstd ★ 27950 2615 APPLICATION

This repository is the reference implementation of the Zstandard (zstd) lossless compression algorithm, developed and maintained by Meta (Facebook). It is a production-grade C library (`libzstd`) that provides fast, high-ratio compression with configurable speed/ratio trade-offs, including negative compression levels for extreme speed. The library is accompanied by a full-featured command-line tool (`zstd`) that supports compression, decompression, streaming, multi-threading, dictionary training, and interoperability with gzip, xz, lz4, and lzma formats. The architecture is modular: a core library (`lib/`) with separate concerns for common utilities, compression strategies (fast, double-fast, lazy, optimal, long-distance matching), decompression, dictionary building (cover, fastCover), and legacy format decoders (v01–v07). The `programs/` directory houses the CLI entry point and file I/O utilities. The codebase is exceptionally well-tested with unit tests, fuzzing infrastructure, regression tests, and CLI integration tests. While the dominant character is an application/library, it also contains research-grade entropy coders (FSE, Huffman) and experimental contributions (edit-distance match finder, parallel pzstd, seekable format, educational decoder), making it a hybrid resource for both production use and compression algorithm study.

RATING: 9.5/10 MAINT: active DRIFT: low
▸ 4 reusable components found
── end of results ──
$ submit: