Re: Search an entire state for homes - Is a Web Crawler the right way to go?
You have to bring back the data to filter it...there's no magical way you can run an algorithm on data you don't have. Typically you capture the page as an XML and mine the xml for the data you want. If you don't know how to program at all, learning and getting this u to date could take weeks.
...But no real need to use a web crawler for this...
Alot of these real estate sites have APIs which allow you direct access to their listing if you register with them as a developer. You can use the api to direct pull what you want.
Just be aware that no matter what path you do gown is most likely to take you much, much longer than just going and searching every major city in florida.
Desktop
Antec 300 Illusion, Athlon II X4 640, 8GB DDR3 1333, EarthWatts430W, Radeon HD 6670 1GB
Laptop
Lenovo Thinkpad Z61T, T7200@2.00GHz, 2GB DDR2, 100gb HD, TPM Encryption
Bookmarks