Results 1 to 5 of 5

Thread: wget to download page/data generated by php

  1. #1
    Join Date
    Oct 2013
    Beans
    3

    wget to download page/data generated by php

    Hi,

    I have an interesting issue, I am trying to tackle. Consider this link

    http://app.quotemedia.com/quotetools...tsym=qm_symbol

    I need to the output of the data ie. values of open,high,low,close, vol, chg, et. et. in a text or csv file, doesn't matter.

    I tried several options however I am not able to get the data in a file, this is one of the several commands i used.

    wget –user-agent=”Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.3) Gecko/2008092416 Firefox/3.0.3″ -O sample.csv “http://app.quotemedia.com/quotetools...sym=qm_symbol”

    Any inputs will be appreciated.

    Thanks.

  2. #2
    Join Date
    Apr 2007
    Beans
    10
    Distro
    Kubuntu 14.10 Utopic Unicorn

    Re: wget to download page/data generated by php

    It could be the formatting of some of the quotes in that statement.. I am able to get there with the following but the page with /quotetools...does not actually exist...
    wget -U="Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.0.3) Gecko/2008092416 Firefox/3.0.3" -O sample.csv "http://app.quotemedia.com/quotetools...sym=qm_symbol"

    I grabbed one of their other pages and got data back.. Hope it helps.

  3. #3
    Join Date
    Oct 2013
    Beans
    3

    Re: wget to download page/data generated by php

    @Cbjaxx

    Looks like when i posted, the link was automatically formatted by the forum page. This is the link hopefully it doesn't auto format it again ( i have added hyphen in the beginning)

    --"http://app.quotemedia.com/quotetools/clientForward?action=showHistory&symbol=BLC&target URL=http://www.quotemedia.com/results.php&targetsym=qm_symbol"

    I get the page (code) however not the actual data(open, high,low,close,vol) in txt or csv file.

    Thanks,
    Walter.
    Last edited by wsjalerts13; October 2nd, 2013 at 11:48 PM.

  4. #4
    Join Date
    Apr 2007
    Beans
    10
    Distro
    Kubuntu 14.10 Utopic Unicorn

    Re: wget to download page/data generated by php

    Hey Walter,
    That one is beyond me with wget. I tried several different variants. Perhaps someone will pop along who has used it more often with some insight or better information... Not sure if you are looking for several historical stock prices or just to pull one. There is a sourforge project written mostly in python that will pull stock information but it was built towards yahoo. Not sure how far down that rabbit whole you are looking to go though....The below two links pull off topic of wget, but i figured they might help add some additional momentum. It might still be possible with wget but I searched around and could not find a definate answer for what you are looking for.

    http://sourceforge.net/projects/yss/
    http://stackoverflow.com/questions/1...le-finance-api

  5. #5
    Join Date
    Oct 2013
    Beans
    3

    Re: wget to download page/data generated by php

    Hi Cbjaxx,

    I am looking for just the ones displayed on the page - nothing fancy, as I can process once i have it in txt/csv format. Yes, you right I searched quite a bit before posting unfortunately nothing popped up. Anyways I will go through the link and see if something shows up or atleast some clues.

    I tried this as well but same effect no data, only code

    wget -e robots=off -m -r --level=inf --append-output=sample.csv --convert-links "app.quotemedia.com/quotetools/clientForward?
    action=showHistory&symbol=BLC&targetURL=http://www.quotemedia.com/results.php&targetsym=qm_symbol";

    Appreciate your time and efforts.

    Thanks,
    Walter

Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •