redis-replicator is a Java library for Redis replication and data parsing. It provides event-driven APIs to consume Redis RDB snapshots, AOF logs, and live replication streams (PSYNC/SCAN). The architecture is based on a `Replicator` interface with multiple implementations (`RedisRdbReplicator`, `RedisAofReplicator`, `RedisSocketReplicator`, `RedisMixReplicator`, `RedisScanReplicator`). Key entry points are `RedisReplicator` (facade) and `Configuration` (URI-based settings). Data flows: raw bytes from Redis or files are parsed by `RdbParser` or `CommandParser` into typed `Event` objects (e.g., `KeyValuePair`, `Command`), which are dispatched to registered `EventListener` instances. The library supports all major Redis data types, commands, and versions 2.6–8.4.x, with extensions for Valkey and custom modules. External dependencies include SLF4J for logging and Jedis for online tests. It is used for data migration, backup, real-time synchronization, and building custom Redis-compatible tools.
Fpart is a high-performance C CLI tool that partitions filesystem trees into balanced subsets (called partitions) based on file count, size, or a fixed number of partitions. It uses a bin-packing algorithm to optimize space utilization. The tool supports live mode, where partitions are generated during filesystem crawling and hooks can trigger immediate actions (e.g., starting rsync transfers). Fpsync, a companion shell script, leverages fpart to parallelize data migrations using rsync, cpio, pax, or tar, with support for SSH workers, job queues, resume/replay, and email reports. The codebase is mature, well-structured, and portable across FreeBSD, Linux, Solaris, and macOS. It demonstrates strong C craftsmanship with careful memory management, error handling, and portability workarounds (e.g., embedded fts). The fpsync script is a sophisticated example of shell-based job scheduling and distributed synchronization.
VolSync is a Kubernetes operator for asynchronous replication of persistent volume data between clusters or to object storage. It implements a pluggable data mover architecture with backends for rsync, rclone, restic, syncthing, and rsync-tls. The operator watches ReplicationSource and ReplicationDestination custom resources, orchestrates mover jobs (typically as Kubernetes Jobs or StatefulSets), and manages the lifecycle of replication: trigger scheduling, synchronization, cleanup, and optional snapshot handling. A kubectl plugin provides CLI commands for managing replication relationships and migrations. The codebase is built with controller-runtime, includes a Helm chart, Prometheus metrics, and extensive test coverage (unit, integration, e2e). Major dependencies include vendored copies of restic and minio-go for the restic-based mover, which introduce maintenance risk but enable FIPS-compliant encrypted backups to S3-compatible storage.