new project: web based data scraper
I decided to go ahead with a new project that is a web based data scraper.
It will allow users the freedom of scraping their own data and downloading it in various formats VS having to post on third party sites like Scriptlance or GetAFreelancer.
It will be a web 2.0 app styled site, very clean and easy to use.
The steps a user will take to use the system are the following:
Step 1: User will import a page by entering a url into a form and clicking “fetch page”
Step 2: Now that the page is imported into our system the user will be able to click and name categories and sub categories and set rules for the data scraper.
Step 3: The user will see projection sample and approve for the scraper to run free on the site.
Step 4: The user will select which format to download the data (can download in many shopping cart pre-formatted data structures, or basic CSV) then pay to download results at a price per result ex: 0.02/per row.
The project is expected for release early to mid September 2008.