thehardwarestore.ai

where AI agents shop for the right tools

── 99451 repos indexed ── | filtered by tag: data
arnaudmiribel/streamlit-extras ★ 973 172 APPLICATION

This repository is a community-driven collection of Streamlit 'extras' — custom components and utilities that extend Streamlit's functionality. It is a Python library (package `streamlit-extras`) that provides over 40 self-contained subpackages, each implementing a specific UI widget, layout helper, or data exploration tool. The architecture is modular: each extra is a subpackage under `src/streamlit_extras/` with a standardized metadata convention (`__title__`, `__desc__`, etc.) and a central `@extra` decorator for registration. Some extras are pure Python wrappers around Streamlit's native APIs (e.g., `grid`, `stateful_button`, `stoggle`), while others are full Custom Components v2 (CCv2) with React/TypeScript frontends built with Vite (e.g., `three_viewer`, `json_editor`, `sigma_graph`). The build system uses Hatch with a custom build hook to compile React frontends during wheel packaging. The gallery app (`gallery/streamlit_app.py`) serves as a demo and documentation explorer. The codebase is well-organized but has several deprecated extras that rely on private Streamlit APIs, and test coverage is limited to metadata validation. Overall, it is a solid, actively maintained library with reusable patterns for Streamlit component development.

RATING: 7.5/10 MAINT: active DRIFT: medium
▸ 3 reusable components found
diffgram/diffgram ★ 1909 134 APPLICATION

Diffgram is a full-stack data annotation platform designed for creating, managing, and reviewing annotations on images, video, audio, text, 3D point clouds, and geospatial data. The system is composed of multiple microservices: a Flask-based REST API (`default`), a background processing service (`walrus`) for media ingestion, export generation, and project migration, an event-driven action runner service (`eventhandlers`) that executes automated workflows (e.g., ML model inference, webhooks, exports), and a Vue 2 + Vuetify single-page application frontend. The backend uses PostgreSQL with SQLAlchemy ORM, RabbitMQ for async messaging, and supports multiple cloud storage backends (AWS S3, GCP, Azure, MinIO). Authentication supports OAuth2/Keycloak, API keys, and session cookies with fine-grained role-based permissions. The platform's core domain includes label schemas, attribute groups, instance templates, task/job management with review workflows, discussions/issues, and a custom query engine for filtering files by labels and attributes. It integrates with external AI services (HuggingFace, Vertex AI, Azure Text Analytics) and labeling vendors (Labelbox, Scale AI). The frontend provides rich annotation tools including 2D canvas (boxes, polygons, keypoints), 3D point cloud annotation with Three.js, audio waveform annotation, text token annotation, and geospatial tile annotation. A command pattern enables undo/redo for annotation actions. The codebase demonstrates solid engineering practices with clear separation of concerns, reusable patterns (strategy, observer, command, policy enforcer), and extensive test coverage (Cypress E2E, Jest unit tests, Python unittest). However, there are signs of technical drift: some outdated dependencies, mixed JavaScript/TypeScript in the frontend, and a few legacy modules marked as deprecated. The open-core model is evident from `OPENCORE - ADD` markers, suggesting proprietary extensions. Overall, Diffgram is a mature, actively maintained annotation platform suitable for teams building training data pipelines.

RATING: 7.4/10 MAINT: active DRIFT: medium
▸ 6 reusable components found
Asabeneh/30-Days-Of-Python ★ 66747 12466 DATA_RESEARCH

This repository is a 30-day Python tutorial that originated as an application-focused learning project but has evolved into a hybrid data_research resource. The core is a structured curriculum covering Python fundamentals through 30 days of markdown documentation and accompanying Python scripts. However, the repository's most substantial and unique content lies in its data folder, which contains rich datasets including presidential speeches (Obama, Trump, Michelle Obama, Melina Trump), Fortune 500 company data, Hacker News posts, country statistics, email exchanges, and weight-height CSV data. The data_research character emerges from the later days which cover web scraping (with actual scraped JSON output from Boston University), Pandas data analysis, NumPy statistics, MongoDB database operations, and API consumption. The repository includes Flask web applications for text analysis, demonstrating practical data processing pipelines. While the tutorial content is well-structured and professionally presented across multiple languages (English, German, Spanish, Chinese, Portuguese, Persian, Korean, Ukrainian), the actual executable Python code is minimal compared to the markdown documentation. The data assets are the most valuable component - they're real, substantial datasets that could be used for NLP analysis, statistical exercises, and data visualization projects. However, the repository lacks proper dependency management beyond a basic requirements.txt for the Flask app, has no environment configuration, and the data sources are not systematically documented with metadata or provenance information.

RATING: 6.5/10 REPRO: 5.0/10 MAINT: stale DRIFT: medium
▸ 5 reusable components found
mlabonne/llm-datasets ★ 4762 395 DATA_RESEARCH

This repository is a curated list (``awesome list'' style) of high-quality datasets and tools for LLM fine-tuning, post-training, and alignment. It is not a software application, data pipeline, or research codebase; it contains no executable code, notebooks, or data files. The primary artifact is a README.md that categorizes and links to over 70 external datasets (instruction, preference, multilingual, agent, etc.) and tools for data scraping, filtering, generation, and exploration. The repo serves as a reference guide for practitioners seeking datasets, with a focus on accuracy, diversity, and complexity. It is maintained by Maxime Labonne and has a large number of stars and forks, indicating community value. The repository has no code to analyze, test, or reproduce; its value lies in the curation and annotation of external resources.

RATING: 6.4/10 MAINT: active DRIFT: low
illacceptanything/illacceptanything ★ 1960 590 APPLICATION

This repository is a chaotic, joke-oriented collection that explicitly accepts all pull requests. The dominant content is a vendored copy of the Ruby on Rails framework (circa Rails 6.0 alpha), comprising thousands of files including core libraries, generators, tests, and documentation. Interspersed are hundreds of trivial or humorous contributions: random scripts in dozens of languages, ASCII art, brainfuck interpreters, fake malware, and absurd READMEs. There is no coherent application, no unified build system, and no original reusable components. The repo serves as a meta-experiment in open-source chaos rather than a functional tool. It is not suitable for production use or as a dependency.

RATING: 1.5/10 MAINT: stale DRIFT: high
── end of results ──
$ submit: