$ show shmilylty/OneForAll
OneForAll is a comprehensive subdomain enumeration and reconnaissance tool designed for security researchers and penetration testers. It aggregates subdomains from over 60 passive sources (certificate transparency logs, DNS datasets, search engines, threat intelligence feeds, and web crawlers), performs active brute-forcing via massdns, and enriches results with DNS resolution, HTTP probing, CDN detection, wildcard filtering, and subdomain takeover risk assessment. The tool is built as a modular Python CLI application, with each data source implemented as an independent plugin inheriting from base classes in `common/`. Output is stored in a SQLite database and can be exported to CSV, JSON, XLSX, and other formats. While primarily an application, the repository also includes curated data files (subdomain wordlists, CDN CIDR ranges, cloud service fingerprints) that are valuable for security research.
The LLM identified 3 files worth highlighting for reuse:
A self-contained tabular data library that handles multi-format export (CSV, JSON, XLSX, etc.). It provides a clean API for creating, manipulating, and serializing table-like data, and can be extracted and reused in any Python project needing structured data output without external dependencies.
Implements a DOM tree similarity algorithm used to detect wildcard DNS responses. It compares HTML page structures by computing a similarity score based on tag hierarchy and attributes, enabling reliable identification of wildcard subdomains. This algorithm is standalone and can be applied to any web scraping or content comparison task.
A robust HTTP client wrapper with built-in proxy rotation, retry logic, timeout handling, and session management. It supports random proxy selection from a provided list and is designed for high-throughput scraping. The module is self-contained and can be reused in any project requiring resilient HTTP requests with proxy support.