View Full Version : Python interact w/ website

November 27th, 2007, 07:54 PM
How would I make a script in Python to interact with a javascript page? Specifically, it needs to activate a radiobox and a button. The site below has a generator of Freerice.org that works similarly to what I am trying to do, but I can't understand the code.


November 27th, 2007, 08:16 PM
I'm not 100% but I think that ruby on rails can do this? Not sure if python can or can not. but pretty sure that ruby can.

Hope this helps..

November 27th, 2007, 08:20 PM
You probably don't want to make it "click" things on the page, you want it to submit data as a request. Look at the page and see how the form is being submitted.

November 27th, 2007, 08:31 PM
http://docs.python.org/lib/node578.html shows how to do GET and POST HTTP actions in python.

there are programs that let you simulate using websites, but they are mostly designed for testing sites. http://en.wikipedia.org/wiki/Selenium_(software)

November 29th, 2007, 05:58 AM
well, i wrote ricemaker, so i can tell you how it works :)

basically, i get the page, parse the sourcecode for the elements i need using beautifulsoup, and then create a POST request and do a urllib2.urlopen() with it.

so basically, look at your target page sourcecode, see what form elements you need to submit to where, and do a urllib2.urlopen() with first argument being the url, second argument being a urlencoded dictionary of your POST data.

another alternative is to use the http://wwwsearch.sourceforge.net/mechanize/ module to automate browsing.

December 2nd, 2007, 10:27 PM
From Python you cannot interact with Javascript on the page - and it does not make much sense, AJAX is just to change how the page is presented to the visitor, which is non-existent.

Instead, check what JS does, and issue the same action, using GET or POST, to target website.