Websites and Directorys Questions

A place where newbies can post without (much) fear of reprisal. All mission posts should still go in the applicable forum.
Forum rules
Older HTS users: Be nice to the new people.

NEW USERS: This is NOT the place to post about missions! Refer to "Missions" category.

Websites and Directorys Questions

Post by Veos on Fri Nov 18, 2011 5:31 am
([msg=62958]see Websites and Directorys Questions[/msg])

Hey guys,

Have just been wandering if there was a way to find all the webpages a website has to offer? Or is there a way to view the websites folder structure, not to do anthing bad just want to know if there is a way of doing this. If yes what do you sugest I read or lookup to work this out?

Thanks.
Veos
New User
New User
 
Posts: 26
Joined: Mon Oct 17, 2011 2:04 pm
Blog: View Blog (0)


Re: Websites and Directorys Questions

Post by mShred on Fri Nov 18, 2011 1:39 pm
([msg=62960]see Re: Websites and Directorys Questions[/msg])

There's a few different ways. If you find a vulnerability, you could probably get a directory listing. But for just random sites, you could use Google hacks. Site:example.org and see what that gets. You could try looking into the robots.txt file to see what directories they don't want crawlers seeing.
User avatar
mShred
Addict
Addict
 
Posts: 1899
Joined: Tue Jun 22, 2010 4:22 pm
Blog: View Blog (2)


Re: Websites and Directorys Questions

Post by smithmetal on Fri Nov 18, 2011 6:03 pm
([msg=62961]see Re: Websites and Directorys Questions[/msg])

You could also try to smartly bruteforce the filenames and/or repositories of the web server. It's more like a script-kiddie way but if you know what you're doing these tools are often highly customizable and you could save some great amount of time using them.

Here's some examples of tools made to achieve this goal :
  • https://github.com/initnull/tachyon
  • http://sourceforge.net/projects/dirbuster/
  • http://cirt.net/nikto2
Image
User avatar
smithmetal
New User
New User
 
Posts: 22
Joined: Sun Apr 13, 2008 9:09 pm
Blog: View Blog (0)


Re: Websites and Directorys Questions

Post by tremor77 on Wed Nov 23, 2011 2:58 pm
([msg=63024]see Re: Websites and Directorys Questions[/msg])

you could also apply this to images/files other than just served pages... also, determining if a website is built using a specific editor or CMS you can get inherent knowledge of directory structure to locate more things.
User avatar
tremor77
Addict
Addict
 
Posts: 1098
Joined: Wed Mar 31, 2010 12:00 pm
Location: New York
Blog: View Blog (0)



Return to NZone

Who is online

Users browsing this forum: No registered users and 0 guests