webscanner
Run Web Scanner on your computer
The command-line tool runs the same scan as this website, from your own machine. Without the website's limits, it lists every host and URL it finds, however many there are, and saves them as JSON and CSV files. It is free and needs nothing else installed.
Install
Linux and macOS
curl -fsSL https://raw.githubusercontent.com/anandhuremanan/Web-Scanner/main/cli/install.sh | sh
Windows (PowerShell)
irm https://raw.githubusercontent.com/anandhuremanan/Web-Scanner/main/cli/install.ps1 | iex
With a package manager
brew install anandhuremanan/tap/webscanner
scoop install https://github.com/anandhuremanan/Web-Scanner/releases/latest/download/webscanner.json
The installer downloads the latest version for your system, checks it against the published checksums, and adds webscanner to your path. Prefer to download it yourself? Pick the file for your system on the releases page. The program is not signed, so your system may warn you the first time you run a file downloaded with a browser.
Scan
webscanner example.com
Shows progress while it runs, then a summary, and saves the results to a folder named after the domain. Press Ctrl-C to stop and keep what was found so far.
More examples
webscanner -mode passive example.com
webscanner -mode full -pages 1000 example.com
webscanner -print urls -no-files example.com > urls.txt
webscanner -help
Browse a result
webscanner -serve example.com
webscanner view webscanner-example.com-20261015-101500
Opens the result in your browser with hosts, URLs, a site map, hosting networks and DNS records, like the results on this website. The page is served from your own computer only and stops when you press Ctrl-C; nothing is uploaded.
Modes
- passive
- Public sources only: certificate logs, subdomain databases, the web archive and DNS. Never contacts the site.
- standard
- Also checks which hosts are live and reads their robots.txt and sitemaps. The default.
- full
- Also follows links on each live host (-pages and -depth set how far).
What you get
- result.json
- Everything the scan found, with where each item came from.
- hosts.csv
- One row per host: whether it resolves and answers, addresses, network, certificate.
- urls.csv
- One row per URL: type, status, sources, when it was first archived.
- scan/
- The scan's database, which webscanner view reads.
Limits
The website shares one small server, so it limits how much each scan may do. The command-line tool has none of those limits: no queue, no time limit, and no ceiling on hosts or URLs.
What protects the sites you scan, and the public sources it reads, stays fixed: at most 5 requests per second to any one host, one web archive request every 3 seconds, and no guessing of pages or names, form submission or port scanning.
Requests come from your computer and your internet address. Only scan domains you own or have permission to inspect; the Terms of Use apply.
Scan on the website insteadSource code and full documentation