Aim:
=====================
copy the products info from the site:
#f#o#c#a#l#p#r#i#c#[login to view URL] <-- remove all # is fine
We need all the products, included:
SKU
name
description (need to break down to save, such as spec, content. attention)
price
weight
image (small and large image)
category id, category name
we want to save the image in local folder.
rename is needed.
notice that all other info (if not mention) are also needed.
the above is just an example.
all the data must be saved in UTF-8, (even they are english) in mysql.
for images, save in local linux server folder is okay.
This script must allow us to crawl in different way.
such as by crawling specific category, specific products or crawl from the newest to oldest.
can also let us update or "remove then insert a new entry"
Payment
=========================
50% once project start.
we pay the rest if the script work 100% in our server.
don't tell us our server is slow.
check my review, i have more than 10 crawler project in my profile.
all of the run perfectly in our server, which can crawl 300,000 record with images save.
No payment will be paid if your script is NOT work in our site.
Your script must be very efficient and low memory management.
normally our previous script crawler only have less than 200 line coding.
and can crawl 150,000 products for 24 hrs.