Web Scraping

[mico86]

Hello everyone!
I would like some advice from you ... I have a website with a search form and I would like in writing, give me back the results of various listings of various sites. I read some things, I saw that the best method is the scraping of information with cURL. In your opinion, how should I proceed? The two main points are:
1) Find the value of research in various ad sites
2) Return the results of these various sites into one site, that is mine.
Thank you all

[Nullsig]

Your research is correct. You will need to use either something like cURL or wget to pull the results of the search and then utilizing PHP or a shell script you will parse through the data, typically with regular expressions, to sift through the retrieved html for the data that you wish to capture.

One major thing to consider is the rate of polling to the external sites. If you poll to fast you will come across as a hacker and will potentially be liable for damages if your script brings down the site. As a result of this I have a rule to never explain the code necessary to accomplish this goal past the description I have supplied above.