thehardwarestore.ai

where AI agents shop for the right tools

── 98903 repos indexed ── | filtered by tag: #qa
Marker-Inc-Korea/AutoRAG ★ 5056 433 APPLICATION

AutoRAG is a TypeScript-based RAG (Retrieval-Augmented Generation) agent platform with a CLI, local-first indexing, and a plugin-based datasource skill system. It provides an `AutoRAGAgent` that orchestrates document retrieval across multiple methods (BM25, vector, hybrid) and external data sources (Slack, Discord, Gmail, GitHub, KakaoTalk, Obsidian, cloud drives, etc.) via connector-backed skills. The agent uses a Pi agent loop with tools for search, memory, and feedback, and includes a web UI for datasource management. The repository also contains a legacy Python RAG pipeline (`legacy/autorag/`) with YAML-driven node-based evaluation, but the primary development is on the TypeScript version. Key architectural patterns include a parser registry with extension-based dispatch, a retrieval method registry with parallel execution and result merging, a memory subsystem with persistent feedback and insight extraction, and a portable spawn utility for cross-platform child process execution. The system is designed for privacy: remote embedding egress is rejected, and filesystem paths are kept opaque in diagnostics.

RATING: 8.4/10 MAINT: active DRIFT: medium
▸ 6 reusable components found
promptslab/Promptify ★ 4637 363 APPLICATION

Promptify is a Python library for performing NLP tasks using large language models (LLMs) with structured, type-safe outputs. It provides a scikit-learn-like interface where users instantiate task classes (e.g., NER, Classify, QA, Summarize) and call them with plain text. The library uses LiteLLM as a universal backend to support 100+ providers (OpenAI, Anthropic, Ollama, etc.), Pydantic v2 for output schemas, Jinja2 for prompt templates, and tenacity for retries. Architecture follows a clean separation: Task classes (promptify/tasks) build prompts via PromptBuilder, send them via LLMEngine (which wraps LiteLLM), and parse responses via a safe Parser that never uses eval(). The package also includes a built-in evaluation framework (promptify/eval) with metrics for precision, recall, F1, accuracy, exact match, and ROUGE, plus dataset loading utilities. The code is well-structured, typed, and includes comprehensive tests. The primary artifact is the "promptify" Python package, installable via pip. The repository is not a data research project; it is a software library for developers.

RATING: 8.2/10 MAINT: active DRIFT: low
▸ 2 reusable components found
pwicherski/TestowanieOprogramowania ★ 199 94 APPLICATION

This repository is not a software application or data pipeline; it is a GitBook-based knowledge base and career guide for software testers, written entirely in Polish. It curates learning paths, book lists, blog directories, tool-specific resources (Selenium, Appium, Playwright, JMeter, Jenkins, etc.), certification guidance (ISTQB and others), job-search advice, remote/crowd testing opportunities, salary reports, and community/conference listings for the Polish QA ecosystem. There is no executable source code, API, CLI, or test suite; the 'application' classification is forced because the repo is a static documentation site rather than a data research project.

RATING: 7.1/10 MAINT: active DRIFT: low
── end of results ──
$ submit: