Favorite Tools

[cyclone]

duplicut -- quickly dedupe massive wordlists:
https://github.com/nil0x42/duplicut

gramify -- Create n-grams of wordlists:
https://github.com/0xVavaldi/gramify

hashgen -- hash generator and wordlist processor:
https://github.com/cyclone-github/hashgen

pipal -- the password analyser:
https://github.com/digininja/pipal

PACK -- Password Analysis and Cracking Kit:
https://github.com/Hydraze/pack

rling -- wordlist sorting and/or dedupe:
https://github.com/Cynosureprime/rling

[v1cvap0r]

Main difference(s) betwen duplicut vs rling ?
I see rling awesome but when using to dedupe a very large file against a small one, if there are zero deduped lines, and zero removed lines, rling still writes a new file. Why ?!

[cyclone]

@v1cvap0r

• duplicut - dedupes a single wordlist without changing its order:
  • ./duplicut wordlist.txt -o dedup_wordlist.txt
• rling - similar capability to duplicut:
  • ./rling wordlist.txt dedup_wordlist.txt
  • but also can remove dups from multiple files and save the dedup output to file like the example below from the GitHub page:
  • ./rling big-file.txt new-file.txt /path/to/old-file.txt /path/to/others/*