tomnomnom/waybackurls

Fetch all the URLs that the Wayback Machine knows about for a domain

4,570

13 commits

updated May 1, 2024

README

waybackurls

Accept line-delimited domains on stdin, fetch known URLs from the Wayback Machine for *.domain and output them on stdout.

Usage example:

▶ cat domains.txt | waybackurls > urls

Install:

▶ go install github.com/tomnomnom/waybackurls@latest

Credit

This tool was inspired by @mhmdiaa's waybackurls.py script. Thanks to them for the great idea!

Project health

Go module

github.com/tomnomnom/waybackurls

Latest release

v0.1.0 · Apr 5, 2022

Releases this year

Significant stargazers

(top 24 of 25)

Aindriú Mac Giolla Eoin

44 followers · starred Jan 2024

Christophe Tafani-Dereeper

727 followers · starred Dec 2022

Santos Gallegos

534 followers · starred Nov 2024

Maximilian Hils

856 followers · starred Apr 2020

Similar repos

tomnomnom/assetfinder

Find domains and subdomains related to a given domain

3,682

same org

lc/gau

Fetch known URLs from AlienVault's Open Threat Exchange, the Wayback Machine, and Common Crawl.

5,121

jsvine/waybackpack

Download the entire Wayback Machine archive for a given URL.

3,231

projectdiscovery/urlfinder

A high-speed tool for passively gathering URLs, optimized for efficient and comprehensive web asset…

918

xnl-h4ck3r/waymore

Find way more from the Wayback Machine, Common Crawl, Alien Vault OTX, URLScan, VirusTotal,…

2,765

mvdan/xurls

Extract urls from text

1,266

hakluke/hakrawler

Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web…

5,141

lc/subjs

Fetches javascript file from a list of URLS or subdomains.

862