VulnerabilityAssessment.co.uk

lynx.

Lynx is a text only web browser. This tool displays no images so web pages load very quickly indeed. It is fairly extensible and allows a pen tester to create a full list of all available pages within a specific website.

Lynx is available from here.

Installation:

Just extract the zip file.

Usage:

lynx [options] startfile

startfile

is the file or URL that Lynx will load at start-up.

If startfile is not specified, Lynx will use a default starting file and base directory determined during installation.
If a specified file is local (i.e., not a URL) Lynx displays that file and uses the directory in which that file resides as the base directory.
If a URL is specified, the file will be retrieved, and only the server base directory will be relevant to further accesses.

popular options

-crawl

with -traversal, output each page to a file.
with -dump, format output as with -traversal, but to stdout.

-dump

dumps the formatted output of the default document or one specified on the command line to standard out. This can be used in the following way:
lynx -dump http://www.vulnerabilityassessment.co.uk/

-traversal

traverse all http links derived from startfile. When used with -crawl, each link that begins with the same string as startfile is output to a file, intended for indexing. See CRAWL.announce for more information.

Example output:

The traversal of my website is saved to a file: traverse.dat

----Abridged-----------------------------

http://www.vulnerabilityassessment.co.uk/

http://www.vulnerabilityassessment.co.uk/index.htm

http://www.vulnerabilityassessment.co.uk/cisco.htm

http://www.vulnerabilityassessment.co.uk/database.htm

http://www.vulnerabilityassessment.co.uk/enum.htm

http://www.vulnerabilityassessment.co.uk/exploit.htm

http://www.vulnerabilityassessment.co.uk/links.htm

http://www.vulnerabilityassessment.co.uk/passwords.htm

http://www.vulnerabilityassessment.co.uk/ports.htm

http://www.vulnerabilityassessment.co.uk/vuln.htm

http://www.vulnerabilityassessment.co.uk/unix.htm

http://www.vulnerabilityassessment.co.uk/vmware.htm

http://www.vulnerabilityassessment.co.uk/win.htm

http://www.vulnerabilityassessment.co.uk/Threats.htm

http://www.vulnerabilityassessment.co.uk/compliance.htm

http://www.vulnerabilityassessment.co.uk/ciscopack.htm

http://www.vulnerabilityassessment.co.uk/cge.htm

http://www.vulnerabilityassessment.co.uk/metasploit.htm

http://www.vulnerabilityassessment.co.uk/meterpreterswf.html

http://www.vulnerabilityassessment.co.uk/msfcliswf.html

http://www.vulnerabilityassessment.co.uk/win32_execswf.html

Also the file traverse2.dat:

http://www.vulnerabilityassessment.co.uk/ Home - VulnerabilityAssessment.co.uk

http://www.vulnerabilityassessment.co.uk/index.htm Home - VulnerabilityAssessment.co.uk

http://www.vulnerabilityassessment.co.uk/cisco.htm Cisco Information

http://www.vulnerabilityassessment.co.uk/database.htm Database Security

http://www.vulnerabilityassessment.co.uk/enum.htm Enumeration

http://www.vulnerabilityassessment.co.uk/exploit.htm Exploit Engines

http://www.vulnerabilityassessment.co.uk/links.htm Links Page

http://www.vulnerabilityassessment.co.uk/passwords.htm Passwords

http://www.vulnerabilityassessment.co.uk/ports.htm port listing

http://www.vulnerabilityassessment.co.uk/vuln.htm Vulnerability Scanners

You will notice the actual title of the page is displayed alongside the URL.

The file reject.dat lists all the links and non-html documents held within the site: