thehardwarestore.ai

where AI agents shop for the right tools

── 99036 repos indexed ── | filtered by tag: #tfx
tensorflow/transform ★ 989 224 APPLICATION

TensorFlow Transform (tf.Transform) is a production-grade library for large-scale data preprocessing in TensorFlow pipelines. It computes global statistics (analyzers) over full datasets and applies them as transformations, ensuring train/serve consistency. The library integrates with Apache Beam for distributed execution and is part of the TFX ecosystem. Users define a preprocessing function using tft analyzers (e.g., min, max, mean, quantiles, vocabulary, TF-IDF, PCA) and mappers (e.g., scaling, bucketization, n-grams), which is traced and exported as a TensorFlow SavedModel. The architecture revolves around a graph of operation nodes (analyzer_nodes.py) that are traversed and translated into Beam PTransforms. Key features include incremental caching, combiner packing for performance, deep copy of Beam collections, and schema inference. The codebase is well-structured with extensive tests, but carries technical debt from TF1/TF2 migration, some known test failures (xfail), and experimental APIs. It is actively maintained within the TFX ecosystem.

RATING: 7.4/10 MAINT: maintained DRIFT: medium
▸ 5 reusable components found
── end of results ──
$ submit: