Have you tried HTTrack? http://www.httrack.com/ -off > i'm testing wget on a test site.. i'm using the recursive function of wget > to crawl through a portion of the site... > it appears that wget is hitting a link within the crawl that's causing it to > begin to crawl through the section of the site again...