Direcory Listing / Spider

Is there any kind of software that lets you type in a domain, and returns a list of direcories and files?

And then you can download the files?

Thanks.

I wrote something to that effect earlier on.

Seems to be taking an awful long time to load - FireFox Says that its looking up w3bdevil.com.....no IE7 on this comp....

Oh there we go.. h/o....

Seems cool - but that does it for that local webserver right?

I'm talking about a remote server that you may not have ftp to...

Mabye I'm not using correct terminology - something along the lines of WebReaper.

anthq11 wrote:

Seems cool - but that does it for that local webserver right?

I'm talking about a remote server that you may not have ftp to...

Mabye I'm not using correct terminology - something along the lines of WebReaper.

Why not use WebReaper then?

Is there some specific feature you require?

I hate to say it, but right now I'm on an eMac at school...

anthq11 wrote:

Seems cool - but that does it for that local webserver right?

Yeah, it's just lists the contents of a given directory when the webserver is configured not to.

anthq11 wrote:

I'm talking about a remote server that you may not have ftp to...

Mabye I'm not using correct terminology - something along the lines of WebReaper.

I was looking for that program earlier, but I couldn't find it and ended up using SuperBot.

anthq11 wrote:

I hate to say it, but right now I'm on an eMac at school...

Get a Terminal Server like myself

Hm...WebReaper is only showing the PAGES, not directories - is there anything to do this?

Just view directories?  Kindof like - Anonymous FTP..

Or would something like this be easy enough to make?

anthq11 wrote:

Hm...WebReaper is only showing the PAGES, not directories - is there anything to do this?

Just view directories?  Kindof like - Anonymous FTP..

Or would something like this be easy enough to make?

Doubtful, that would be a massive breach of webserver security.

Besides, remember: Resource Paths (the bit in URLs between the fragment identifier and the hostname) are completely aribtrary.

Take my Zeo Competition blog, this URL points to "/news/ParserinProgress", yet there is no directory on the server called "/news/".

Oh - so it could all go screwy...

anthq11 wrote:

Oh - so it could all go screwy...

Hence why its better to follow links rather than assume those directories actually exist.

anthq11 wrote:

Is there any kind of software that lets you type in a domain, and returns a list of direcories and files?

And then you can download the files?

Thanks.

Something about this makes me feel uneasy!

I used an early version of Frontpage that let you point to a domain and download the website structure, it was the only thing it was good at.