Project Detail

Crawler Development  

Crawler Development is project number 538504
posted at Freelancer.com. Click here to post your own project.

 

| More
Free Trial For New Buyers
 

Status:

Selected Providers: Aoogoo,
pgcoding

Budget: $250-750

Created: 10/28/2009 at 19:16 EDT

Bid Count: 28

Average Bid:
N/A

11/07/2009 at 19:16 EST

Project Creator: SvenAbels
Employer Rating: 10/1010/1010/1010/1010/1010/1010/1010/1010/1010/10 (26 reviews)

Bid On This Project
 

Description

We need a crawler library for Java which performs the following:

-It should visit 7 different download websites that we will provide you.

-From those download websites it should grab the list of new software added today (from the What's new list of those sites).

-Based on this, it should visit the details for the programs and collect them in a java class (program name, description, link to screenshot, size, etc.). We have already created an interface for the details and will send you on project start or after bidding

-For 2 download sites we need an extended version that crawls all programs and returns them to us.

-Some notes on the sites:
-We will provide them to you after bidding
-Some of them have RSS and maybe you can use it
-4 of them are in German langauge but we can provide you help if you need to translate some parts.
-If a page is slow or not available, thenm you need to have a timeout


Regarding your solution:

-We need pure Java
-We need clean code + documentation

Messages Posted:1 View project clarification board Post message on project clarification board

Bid On This Project
 

If you are the project creator or one of the bidders Log In for more options

Bids are hidden by the project creator. Log in as the project creator or as one of the bidders to view bids. You will not be able to bid on this project if you are not qualified in one of the job categories. To see your qualifications click here.


    Bid on this Project