Project Detail

Web Crawler

Web Crawler is project number 352830
posted at Freelancer.com. Click here to post your own project.

| More

Status:

Selected Providers: agiorlando

Budget: $30-250

Created: 12/04/2008 at 2:05 EST

Bid Count: 14

Average Bid:
$ 171

12/09/2008 at 2:05 EST

Project Creator: jamesqh
Employer Rating: 10/10 10/10 10/10 10/10 10/10 10/10 10/10 10/10 10/10 10/10 (17 reviews)

Description

Dear web programmers,

This should be an easy task for a programmer who know what s/he's doing:

I need a web crawler that will crawl Australian websites (all websites ending in .au) making a record of whether or not each website:

- has a custom favicon (first look for <link rel="shortcut icon"...> in the HTML and then look for the /favicon.ico file)

- works as www.domainname.com but not domainname.com (a comparison of the HTML served will need to be done)

- has a <title> (verses no title or one that includes "Untitled")

- has a meta description and meta keywords

- uses Google Analytics

The results will be stored in a mysql database.

The script should be able to pick up where it left off if it is stopped/interrupted.

I would prefer it to be written in PHP

When you bid, please begin your comment with "I am an experienced programmer from [enter your country]" so that I know that you have read the above requirements.

Report Violation

Job Type

Messages Posted:0

If you are the project creator or one of the bidders Log In for more options

PMB

200

3 days

12-04-2008 02:50 EST

9.9414/10
(324 reviews)

hi, please see your PMB. Thanks.

pgcoding

250

7 days

12-04-2008 02:34 EST

9.7826/10
(46 reviews)

pl check pmb.

ranganathp

250

21 days

12-04-2008 11:42 EST

9.7931/10
(29 reviews)

Can help... check my reviews... costs more...

gopalde

250

5 days

12-04-2008 02:19 EST

9.2083/10
(24 reviews)

Hi, "I am an experienced programmer from INDIA".I'm really interested in your project. Check please PM for more details. Thanks.

zhukaster

2 days

12-04-2008 17:34 EST

9.6471/10
(17 reviews)

I am an experienced programmer from Ukraine. I can do your project.

pdah

120

2 days

12-04-2008 02:29 EST

10/10 10/10 10/10 10/10 10/10 10/10 10/10 10/10 10/10 10/10
(14 reviews)

Hi, "I am an experienced programmer from VIETNAM". Please check PMB

bullfrogliu

150

5 days

12-05-2008 20:56 EST

10/10 10/10 10/10 10/10 10/10 10/10 10/10 10/10 10/10 10/10
(8 reviews)

I am an experienced programmer from china,please check pmb, thank you

prashant29

200

3 days

12-04-2008 08:14 EST

10/10 10/10 10/10 10/10 10/10 10/10 10/10 10/10 10/10 10/10
(7 reviews)

I am an experienced programmer from India. Please check your PMB.

TeleSoftSG

250

5 days

12-04-2008 14:56 EST

9.25/10 9.25/10 9.25/10 9.25/10 9.25/10 9.25/10 9.25/10 9.25/10 9.25/10 9.25/10
(4 reviews)

Hi! I am an experienced programmer from Ukraine. Ready to develop the solution you need, it will query the whois and parse the sites one by one storing the data grabbed to database. Regards, Igor.

bzizanovic

150

4 days

12-04-2008 04:48 EST

10/10 10/10 10/10 10/10 10/10 10/10 10/10 10/10 10/10 10/10
(1 reviews)

Please check PMB

agiorlando

150

2 days

12-04-2008 21:09 EST

10/10 10/10 10/10 10/10 10/10 10/10 10/10 10/10 10/10 10/10
(1 reviews)

I am an experienced programmer from California, USA. PM sent. :)

siri20

150

5 days

12-04-2008 02:54 EST

(No Feedback Yet)

Experts on Web related development with having experiance in Latest technologies of web 2.0, having hands full of experience in Linux and Network related projects from past 4years. "More info please logon to "fugenx dot COM"

eugeek

100

2 days

12-04-2008 09:06 EST

(No Feedback Yet)

I am an experienced programmer from india. i have lots of experience in crawlers. i can do this job easily for you. thanks

chapwaretech

2 days

12-08-2008 22:36 EST

(No Feedback Yet)

I am an experienced programmer from the United States. I have most of this code already written from a crawler I recently finished. A few slight code modifications and I can have exactly what you want.

Bid on this Project

WHAT IS FREELANCER.COM?

Freelancer.com is a global outsourcing solution and freelance jobs website. Here you can find freelance coders, writers, programmers, designers, marketers and more. You can also outsource projects and save a lot of money in the process. Getting the best web design, professional programming, custom writing or affordable marketing has never been easier!

We have thousands of satisfied clients from every corner of the world. Would you like to outsource your next project? Would you like to find freelance jobs and make money online? Just sign up to get started! Outsourcing jobs is the process of hiring an outside company or individual to complete your projects. We have created a safe environment for both service buyers and service providers via our secure payment system. You outsource the project and don't release any money until you're satisfied! Try outsourcing for free today! Don't forget to bookmark our homepage for your next project or job.