Php web scraper

Php web scraper

Description: Creating a Php web scraper framework. This tool was used to gather data from websites. 2 xml files were in charged with configuring the scraper, the rest of the jobs were done automatically:
creation of the tables, follow the links, etc. Nodes (pages) were stored as a graph in
a Mysql database.
Tools: Php, Mysql, Xml
Skills: Graph theory
Date: 2006