Project Detail

Price Grapper Crawler on 5 sites   Refundable $5 fee paid

Price Grapper Crawler on 5 sites is project number 499371
posted at Freelancer.com. Click here to post your own project.

 

| More Free Trial For New Buyers
 

Status: Frozen
(Awaiting action from bidder)

Selected Providers: -

Budget: $30-250

Created: 09/01/2009 at 1:35 EDT

Bid Count: 18

Average Bid:
$ 267

09/08/2009 at 1:35 EDT

Project Creator: ssp711
Employer Rating: 10/1010/1010/1010/1010/1010/1010/1010/1010/1010/10 (3 reviews)

Bid On This Project
 

Description

We need to crawl few information from 5 sites: (we can pm to you if you request)

===========================
We need to crawl the products price from 5 sites.

some of the sites is very simple, as they have product ID in the URL.
e.g. http://www.test.com/index.php?productid=1

so, you can do it very easily.


We only need to store
1. list price
2. special price (if any)
3. sku / item code
4. product id (if any)
5. product title
6. product weight (if any)
7. product URL
8. site ID, to indicate which site you store
9. product image, just the small listing image is fine.
10. any other field that you may need to store in order to let your program run, such as last crawl date, flag, hash, etc

All the data is stored in MySQL 5.x db. (the image file is store in local folder)

We use those data to compare the price (you DO NOT need to write this part, just store the data format as we request is enough),so, no need to store other information.
but if you think that storing other information, such as category is helpful, you can store it.
we don't mind.

Pay attention:
===========================
All the product price should be in USD.

The script must be able to run in cron job OR manually.

If the product is crawled before, update the exist record.

It should allow us to input a product URL or product ID range, so that we can crawl some product
manually. it is mainly use to fix some products which is timeout during crawl.

It should allow us to set which site to be crawl in the "web submit form", just like a normal web form.

The project must be written in module, so that we can add extra CRAWL site php file, say the 9th site:
9thdomain.com.php in the module/ folder.

then your script will auto load that file and we need to change nothing in the php files.

the auto crawl setting should be store in db, so, please give us a web form so that we can modify it.
such as when to crawl, which site to crawl
don't request us to do it in phpmyadmin. a normal end user don't know how to use phpmyadmin.

After crawl the product, it is needed to update the mysql LOG so that we can check which NEW product is added and which product price is changed.

We allow this project to be done within 10 days. (included holidays)

Our Sever:
===========================
Redhat Linux, Apache 2.x, php 5.3.x


Payment:
===========================
We will ecrow 50% of the payment once you are accepted to do this project.
you need to send us the code to test on our server or you can show us in your server.

Once we got your working code (at least 90% work), we will escrow another 50% to you.

The payment will be released to you if any only if after we TESTED and WORKED without problem in our server.

Normally the test takes about 1-2 days, it depends on how fast is your script can crawl.
it don't makes send s for us to test for 1 day if your script need 10 days to crawl, right?

Bonus will be given if your script is fast, clean and well communication.
normally we pay extra 10%-20% depends on your work.

Deadline is super important for us, if we can't finish it in the period you stated.
We have the right to cancel this project and you CANNOT argue on that.

If you DO NOT agree or DO NOT understand what we said, please DO NOT bid this project.

Messages Posted:0 View project clarification board Post message on project clarification board

Bid On This Project
 

If you are the project creator or one of the bidders Log In for more options

 

250

7 days

09-01-2009 01:49 EDT

Hello,Please refer your PMB.Thank you.

help

 

200

3 days

09-01-2009 03:15 EDT

Hello sir. I can help you with this project. I've done this kind of projects before. Regards, Sphinks!

help

 

250

5 days

09-02-2009 01:57 EDT

waiting for more details

help

 

150

7 days

09-01-2009 02:06 EDT

Hi, would you please read your messages. I need to clarify something. Thank you. Regards, DrTech76

help

 

175

5 days

09-01-2009 13:42 EDT

Check PM please.

help

 

450

10 days

09-01-2009 04:43 EDT

Please view PMB

help

 

550

15 days

09-01-2009 03:36 EDT

Check your PMB for details!!!

help

 

600

7 days

09-01-2009 01:58 EDT

Hi. I just built such a price comparison application. I will need the 5 URLs you wish to scrape. Please check PM for details. Regards.

help

 

190

5 days

09-02-2009 07:56 EDT

Please check PM

help

 

250

5 days

09-04-2009 06:21 EDT

Hi,please check PM.

help

 

150

1 day

09-01-2009 04:41 EDT

Hi, Please check PM.

help

 

150

3 days

09-07-2009 05:35 EDT

Hi. I can help you with this project. I am sure i am the right person because i have a good experience in data grabbing from website. I will send you a pm with some of my projects.

help

 

210

8 days

09-01-2009 01:46 EDT

(No Feedback Yet)

Hi we have years of experience and expertise in PHP. with our experienced and expert people we can assure you accurate,creative and timely results,according to your requirements.

help

 

250

24 days

09-02-2009 01:59 EDT

(No Feedback Yet)

Lets start...................send the complete project requirement

help

 

500

10 days

09-02-2009 08:03 EDT

(No Feedback Yet)

Over 3 years of experience in PHP/MySQL. I believe I can do this. Looking forward to your response.

help

 

150

3 days

09-02-2009 08:07 EDT

(No Feedback Yet)

lets do this asap

help

 

150

25 days

09-02-2009 08:21 EDT

(No Feedback Yet)

Hi I am basically a perl programmer and like to scrape sites using perl. I can do it in php though but i think perl would be a better choice as it is fast. Please accept my bid Thanks

help

 

180

4 days

09-03-2009 04:13 EDT

(No Feedback Yet)

Please check PMB

help


    Bid on this Project