SudachiDict is a repository that provides linguistic data resources for the Sudachi Japanese tokenizer. It processes raw dictionary CSV files (sourced from UniDic and NEologd) into binary dictionary files in three editions: Small (UniDic only), Core (basic vocabulary), and Full (includes proper nouns). The repository includes automated build scripts to compile these dictionaries, packaging utilities to distribute them as Java/Maven artifacts and Python packages, and test suites to verify correctness. While it contains some application-like elements (build scripts, packaging), its primary function is data curation and distribution for NLP use cases.
Masader is a metadata catalog for Arabic NLP datasets, providing structured information about over 100 datasets including their tasks, dialects, sources, volumes, and licensing. The repository combines a Jekyll-based static site with a modular JavaScript frontend to enable dataset discovery through search, filtering, statistics visualization, and a natural language chatbot interface. While the core asset is the dataset metadata (JSON files in /datasets/), the web interface and associated tools (annotation, migration, validation scripts) form an application layer that makes the catalog usable and maintainable. The system supports dataset exploration via faceted search, demographic charts, and embedding-based clustering, with a chatbot for conversational queries. Metadata is kept up-to-date through migration scripts that handle schema evolution and validation checks that ensure consistency with external sources like venue links and volume totals.