Forums

This topic is locked

Web Crawling software

Posted 10 May 2005 17:08:21
1
has voted
10 May 2005 17:08:21 Dan Slade posted:
Hi All,

Does anyone know of any (free) software that can crawl a website I have created? I just need to produce a text file of all the pages on this site for seo purposes.

It's not a problem to type it all into notepad, but as there are many pages I thought I'd ask the question here to see if I could save time.

I've had a look on the net, but can't seem to find anything useful.

Any ideas would be very welcome.

Many thanks,

Dan.

---------------------------------------------
If I knew what I was doing, I'd be dangerous...

Replies

Replied 11 May 2005 05:43:43
11 May 2005 05:43:43 Chris Charlton replied:
On windows I found a context-menu script that uses an old DOS trick to print a file listing to a TXT file! Was very handy, do a little Googling on that.

~ ~ ~ ~ ~ ~ ~
Chris Charlton <i>- DMXzone Manager</i>
<font size=1>[ Studio MX/MX2004 | PHP/ASP | SQL | XHTML/CSS | XML | Actionscript | Web Accessibility | MX Extensibility ]</font id=size1>
Replied 11 May 2005 11:18:44
11 May 2005 11:18:44 Dan Slade replied:
Hi Chris,

Many thanks. Googled it and there it was.

Seeing how useful this is, it amazes me that windows doesn't have something like this by default.

If anyone else is interested in this, I found the instructions here:

hacks.oreilly.com/pub/h/611

Thanks again Chris, you've saved me a mountain of typing!!!

Dan.

---------------------------------------------
If I knew what I was doing, I'd be dangerous...

Edited by - Danski on 11 May 2005 11:20:42

Reply to this topic