Using wget to Mirror Whole Web Sites

By:

on

February 22, 2006

The following should all allow you to mirror an existing site from the Internet to your hard drive (if you are using a Mac or Linux):

wget --convert-links --mirror http://www.slashdot.org

 

wget -r -k -R .pdf -Dslashdot.org http://www.slashdot.org

 

wget -r -l5 -k -Dslashdot.org http://www.slashdot.org

It can be a useful way to migrate a script from an old server (which you may no longer have access to) to a new one.

About The Author

Mike Gifford is the founder of OpenConcept Consulting Inc, which he started in 1999. Since then, he has been particularly active in developing and extending open source content management systems to allow people to get closer to their content. Before starting OpenConcept, Mike had worked for a number of national NGOs including Oxfam Canada and Friends of the Earth.