Web scraping of 200 websites needed

I will build a Java application to scrape data from websites. Here is the complete description of the application. The application will: 1. Crawl website and extract all the product URL's. 2. Save all these URL's into the database. 3. Get each URL from the database(with a 10 second interval), navigate to the URL and extract all necessary data. Ex: Category, sub category, description, product name, images, size, color, price etc 4. Save all the data extracted from website into a database. 5. Save the product brochures on the file system. 5. Dump the entire data into a spreadsheet (csv format)(optional). And also Script file with website as an argument to scrape data of that particular website. Note: It is good to use proxy for scraping these sites. To automate the process, we deploy this application on a remote server and set up cron jobs to trigger the application to scrape a particular website. I will design the database schema to save the scraped data in a structured manner. I built a price comparison tool in the past to compare products across 21 e-commerce websites. I scraped all the websites data and compared prices of the products. Contact me to discuss more about my proposal.

Hello there, I have gone through your job details and yes we can HELP YOU IN THIS as we have an Expert and Experienced team for Web and App Development. Can we discuss the REQUIREMENTS in detail? We are the leading IT Company in India. We have huge experience and mastery in App and Web development, App and Web designing, backend, cloud services, and enterprise solutions. We have spent more than 6 years in Designing and developing. We work hard to produce the highest quality, effective, innovative, timeless, designs for my clients. I will invoke some following features in your website * Design new layout of website. * Add new interactive images. * Make professional in terms of design and contents * Make more interactive and user-friendly. * Add new modules if required. Delivery on time of the responsive and customized website with quality is promised. Customers 100% satisfaction is the top Most Priority. We give the full satisfaction to the client by maintaining the accuracy and delivering of the project in given time and at the reasonable price. When you want to start this job. We can start immediately Do you have any strict deadline for this job ? Looking forward to have a healthy working relation with you. Thanks Navneet