Results 1 to 2 of 2

Thread: how to make a mirror of your site

  1. #1
    Join Date
    Aug 2009
    Location
    narnia, wonderland, uk
    Beans
    35
    Distro
    Ubuntu 9.04 Jaunty Jackalope

    how to make a mirror of your site

    so, ever needed to make a mirror of your site??? wondered how??? there is a way of using wget that ignores the robots file to make a new mirror its really easy too

    just type

    wget -e robots=off --mirror --random-wait --user-agent="Mozilla/5.0 (X11; U; Linux i686; pl-PL; rv:1.9.0.2) Gecko/20121223 Ubuntu/9.25 (jaunty) Firefox/3.8" http://nameofsite.com/

    so long as it is HTML it should make a file with the structure of your site this could theoretically be used to check for open directories - a possible security issue...

    (tip: doing this to try downloading google to your 160gb hdd is a BAD idea besides it is java script so... wont work after the first page)
    Cogeto, ergo sum

  2. #2
    Join Date
    May 2008
    Location
    Baker, OR USA
    Beans
    887
    Distro
    Ubuntu Development Release

    Re: how to make a mirror of your site

    Does this get files that have no links to them anywhere else?
    I don't want to Live in a Life without Walls-too many viruses get in...
    Ubuntu user 23101 Linux user 472132
    Two ways to live: the choice we all face

Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •