Project Detail

Description

We are looking to have a scraper written and executed by you on your machines.

We need to have the following data scraped From EACH product listing of http://www.speedycarparts.com/catalog/

The following needs to be scraped:

1. Header Text ( Can be found under <div class="ProductName"> )

2. Fit Note ( Can be found under <div class="ProductAvailability"> <li> )

3. Type ( Can be found under <div class="ProductAvailability"> <li> )

4. Location ( Can be found under <div class="ProductAvailability"> <li> )

5. Material ( Can be found under <div class="ProductAvailability"> <li> )

6. Series ( Can be found under <div class="ProductAvailability"> <li> )

7. Part Number ( Can be found under <div class="ProductAvailability"> <li> )

8. MFR# ( Can be found under <div class="ProductAvailability"> <li> )

9. Product Description ( Can be found under <div class="ProductFits" style="overflow: auto;"> )

10. This product fits the following Vehicles ( Can be found under <div class="ProductFits"> ) * We will need the <strong> tag and ALL <li> tags.

11.Brand Image ( Can be found under <div class="ProductImg"> )

12. Product Thumbnail Image ( Can be found under <div class="ProductImg"> )

One the scraper is written, YOU will need to execute the scrape. There are a total of 3,160,863 products.

There is an option to set the page to 50 products per page (found here: <select id="Npp" class="selectNum" onchange="formaction();" name="Npp">) meaning this will only be scraping 60,000+ pages. If the scrape is spread across multiple machines, it should not take very long.

I appreciate and will anticipate your bids.

Thanks.