Web Scanner

webscanner

Run Web Scanner on your computer

The command-line tool runs the same scan as this website, from your own machine. Without the website's limits, it lists every host and URL it finds, however many there are, and saves them as JSON and CSV files. It is free and needs nothing else installed.

Install

Linux and macOS

curl -fsSL https://raw.githubusercontent.com/anandhuremanan/Web-Scanner/main/cli/install.sh | sh

Windows (PowerShell)

irm https://raw.githubusercontent.com/anandhuremanan/Web-Scanner/main/cli/install.ps1 | iex

With a package manager

brew install anandhuremanan/tap/webscanner
scoop install https://github.com/anandhuremanan/Web-Scanner/releases/latest/download/webscanner.json

The installer downloads the latest version for your system, checks it against the published checksums, and adds webscanner to your path. Prefer to download it yourself? Pick the file for your system on the releases page. The program is not signed, so your system may warn you the first time you run a file downloaded with a browser.

Scan

webscanner example.com

Shows progress while it runs, then a summary, and saves the results to a folder named after the domain. Press Ctrl-C to stop and keep what was found so far.

More examples

webscanner -mode passive example.com
webscanner -mode full -pages 1000 example.com
webscanner -print urls -no-files example.com > urls.txt
webscanner -help

Browse a result

webscanner -serve example.com
webscanner view webscanner-example.com-20261015-101500

Opens the result in your browser with hosts, URLs, a site map, hosting networks and DNS records, like the results on this website. The page is served from your own computer only and stops when you press Ctrl-C; nothing is uploaded.

Modes

passive
Public sources only: certificate logs, subdomain databases, the web archive and DNS. Never contacts the site.
standard
Also checks which hosts are live and reads their robots.txt and sitemaps. The default.
full
Also follows links on each live host (-pages and -depth set how far).

What you get

result.json
Everything the scan found, with where each item came from.
hosts.csv
One row per host: whether it resolves and answers, addresses, network, certificate.
urls.csv
One row per URL: type, status, sources, when it was first archived.
scan/
The scan's database, which webscanner view reads.

Limits

The website shares one small server, so it limits how much each scan may do. The command-line tool has none of those limits: no queue, no time limit, and no ceiling on hosts or URLs.

What protects the sites you scan, and the public sources it reads, stays fixed: at most 5 requests per second to any one host, one web archive request every 3 seconds, and no guessing of pages or names, form submission or port scanning.

Requests come from your computer and your internet address. Only scan domains you own or have permission to inspect; the Terms of Use apply.

Scan on the website insteadSource code and full documentation