Results 1 to 3 of 3

Thread: Wget, JavaScript

  1. #1
    Join Date
    Sep 2013
    Beans
    6

    Wget, JavaScript

    I am trying to download a couple of pages from this publicly available website:
    http://lt.morningstar.com/gay09rt8h3...k/default.aspx

    As you can see it is a list of funds. Downloading the first page is easy, but I would like to do 2 things:
    - first change the number of rows to 500 (as with the drop down box near the bottom of the list)
    - download all available pages (like clicking the next button)

    As these buttons are coded with JavaScript I have no clue how to do this, but if might be handy if i could tell wget to click this buttons for me. Is there a possibility to do such a thing?

  2. #2
    Join Date
    Nov 2011
    Location
    /dev/root
    Beans
    Hidden!

    Re: Need help with wget

    Welcome to the Ubuntu Forums

    I don't think wget will click buttons for you. It is a command line program. Maybe you can do it with xdotool in combination with a GUI browser, for example Firefox.

  3. #3
    Join Date
    Sep 2006
    Beans
    8,627
    Distro
    Ubuntu 14.04 Trusty Tahr

    Re: Need help with wget

    wget will spider pages for you, but you have to be careful that you don't bog down the remote site with unecessary requests and that you don't harvest more than you need.

    See the following options in the wget manual page:

    --mirror
    --no-parent
    --wait=s

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •