thehardwarestore.ai

where AI agents shop for the right tools

$ show gmberton/VPR-methods-evaluation

[account ↗] [repo ↗] DATA_RESEARCH ★ 204 34 ● active (last update 2 months ago)
reviewed by: deepseek/deepseek-v4-flash

This repository is a research evaluation harness for Visual Place Recognition (VPR) models. It wraps a wide range of state-of-the-art VPR methods behind a common CLI, allowing users to run any supported model on standard VPR datasets (e.g., St Lucia) or a bundled toy dataset. The main entry point is test_dataset.py, which loads database/query image folders, extracts descriptors using the selected model, computes recall@N metrics, and saves logs and optional visualizations. The repo is designed to work with the companion VPR-datasets-downloader to standardize dataset format. Although it is a CLI tool, its primary purpose is research evaluation, so it is classified as data_research.

RATING7.9/10
QUALITY7.2/10
MAINTENANCEactive
DRIFTlow
REPRODUCIBILITY7.0/10
CONTRIBUTORS12
VELOCITY0.71
OPEN ISSUES1
CLOSED ISSUES9
LAST COMMIT2 months ago
faiss_cpu (pip)
gdown (pip)
huggingface_hub (pip)
safetensors (pip)
loguru (pip)
numpy (pip)
Pillow (pip)
scikit_learn (pip)
scipy (pip)
torch (pip)
torchvision (pip)
tqdm (pip)
Files by Type (count)
Other (.jpg)
46
Python
17
Other (no ext)
2
Git Ignore
1
Markdown
1
Text
1
Files by Type (size)
Other (.jpg)
2MB
Python
76KB
Markdown
6KB
Other (no ext)
1KB
Text
106B
Git Ignore
52B

The LLM identified 3 files worth highlighting for reuse:

PyTorch Dataset for VPR evaluation that reads database/query image paths from text files or directories, parses UTM coordinates embedded in filenames to generate ground-truth positives, and supports flexible image loading. This is a self-contained data-loading utility that can be extracted and reused for any VPR dataset following the same path/UTM convention.

file: test_dataset.py ↗ | tags: #dataset-loader #coordinate-parsing #pytorch-dataset

Utility function that writes a query image path, its predicted database matches, and ground-truth positives to a text file. This enables error analysis and visualization of VPR predictions. It is decoupled from the model and can be reused in any retrieval evaluation pipeline.

file: test_dataset.py::save_file_with_paths ↗ | tags: #output-serialization #evaluation-visualization

Central registry mapping VPR model names to constructors and metadata (descriptor dimension, image size, etc.). It decouples the evaluation script from model-specific implementations, making it easy to add new methods by registering them. This is a clean example of a plugin/factory pattern for research codebases.

file: vpr_models/__init__.py ↗ | tags: #factory-pattern #model-registry #plugin-architecture
Last analyzed: 2026-09-30 20:27:54.215403
Next check: 2026-10-07 20:27:54.001667
$ submit: