Project Detail

Web Crawler  

Web Crawler is project number 352830
posted at Freelancer.com. Click here to post your own project.

 

| More
Free Trial For New Buyers
 

Status:

Selected Providers: agiorlando

Budget: $30-250

Created: 12/04/2008 at 2:05 EST

Bid Count: 14

Average Bid:
$ 171

12/09/2008 at 2:05 EST

Project Creator: jamesqh
Employer Rating: 10/1010/1010/1010/1010/1010/1010/1010/1010/1010/10 (17 reviews)

Bid On This Project
 

Description

Dear web programmers,

This should be an easy task for a programmer who know what s/he's doing:

I need a web crawler that will crawl Australian websites (all websites ending in .au) making a record of whether or not each website:

- has a custom favicon (first look for <link rel="shortcut icon"...> in the HTML and then look for the /favicon.ico file)

- works as www.domainname.com but not domainname.com (a comparison of the HTML served will need to be done)

- has a <title> (verses no title or one that includes "Untitled")

- has a meta description and meta keywords

- uses Google Analytics


The results will be stored in a mysql database.

The script should be able to pick up where it left off if it is stopped/interrupted.

I would prefer it to be written in PHP

When you bid, please begin your comment with "I am an experienced programmer from [enter your country]" so that I know that you have read the above requirements.

Job Type

Messages Posted:0 View project clarification board Post message on project clarification board

Bid On This Project
 

If you are the project creator or one of the bidders Log In for more options

 

200

3 days

12-04-2008 02:50 EST

hi, please see your PMB. Thanks.

help

 

250

7 days

12-04-2008 02:34 EST

pl check pmb.

help

 

250

21 days

12-04-2008 11:42 EST

Can help... check my reviews... costs more...

help

 

250

5 days

12-04-2008 02:19 EST

Hi, "I am an experienced programmer from INDIA".I'm really interested in your project. Check please PM for more details. Thanks.

help

 

95

2 days

12-04-2008 17:34 EST

I am an experienced programmer from Ukraine. I can do your project.

help

 

120

2 days

12-04-2008 02:29 EST

Hi, "I am an experienced programmer from VIETNAM". Please check PMB

help

 

150

5 days

12-05-2008 20:56 EST

I am an experienced programmer from china,please check pmb, thank you

help

 

200

3 days

12-04-2008 08:14 EST

I am an experienced programmer from India. Please check your PMB.

help

 

250

5 days

12-04-2008 14:56 EST

Hi! I am an experienced programmer from Ukraine. Ready to develop the solution you need, it will query the whois and parse the sites one by one storing the data grabbed to database. Regards, Igor.

help

 

150

4 days

12-04-2008 04:48 EST

Please check PMB

help

 

150

2 days

12-04-2008 21:09 EST

I am an experienced programmer from California, USA. PM sent. :)

help

 

150

5 days

12-04-2008 02:54 EST

(No Feedback Yet)

Experts on Web related development with having experiance in Latest technologies of web 2.0, having hands full of experience in Linux and Network related projects from past 4years. "More info please logon to "fugenx dot COM"

help

 

100

2 days

12-04-2008 09:06 EST

(No Feedback Yet)

I am an experienced programmer from india. i have lots of experience in crawlers. i can do this job easily for you. thanks

help

 

80

2 days

12-08-2008 22:36 EST

(No Feedback Yet)

I am an experienced programmer from the United States. I have most of this code already written from a crawler I recently finished. A few slight code modifications and I can have exactly what you want.

help


    Bid on this Project