Spider - Web Crawler and Wordlist / Ngram Generator
-
Author:
cyclone
URL:
https://github.com/cyclone-github/spider
Description:
Spider is a web crawler and wordlist/ngram generator written in Go. It crawls specified URLs to create wordlists and/or ngrams which are sorted by frequency. Users can customize the crawl depth, output file, and specify ngram creation options. This tool is ideal for web scraping and building custom wordlists for hashcat or John the Ripper.