Project Detail

Description

Download manager

Experienced developers only... please be sure to verify your experience if at all possible. Thanks...

I need an experienced developer to create a Windows Download Manager for us that can do the following:

Take a list of at least 100,000 internet links from a text file, and download them to a specific location on our network, and append the HOST NAME to the directory structure.

We will need to be able to specify the download location, such as x:\downloads123, for example.
We will need to be able to specify the file list being downloaded.
We will need to be able to see the progress.

For example; a file with the link “www.loctite262.com/template/ying/pdf/docs/3466-EN.PDF” will download the file “3466-en.pdf”, and put it in the directory “www.loctite262.com”

second example: a file with the link “www.megamaintenance.com/img/msds/CCC01.pdf” will download the file “ccc01.pdf”, and put it in the directory “www.megamaintenance.com”.

The program must be able to:
1. Keep the host file date
2. Ignore the file download if the file name AND file date are identical
3. Download and rename the file (1) or (2) etc if the filename is the same, but the date is different.

As each file is processed, the link will be removed from the download list, and placed in either a success list if downloaded, a failed list if the file could not be downloaded, or a duplicate list, if the file and file date existed and the file was not downloaded.

The list of files will be in a text file.

For example: a list with the name “files1.txt” will contain the following files, one per line:
www.mgk.com/pdfs/MSDS%202668%205-2-2005%20(EPA%20No.%201021-1645).pdf
www.mgk.com/pdfs/MSDS%202781%208-9-2004%20(EPA%20No.%201021-1738).pdf
www.mgk.com/pdfs/MSDS%202783%208-10-2004%20(EPA%20No.%201021-1739).pdf
www.mgk.com/pdfs/MSDS%207067%2010-13-04%20(EPA%20No.%201021-1199).pdf
www.mgk.com/pdfs/MSDS%2074401%204-30-2004%20(EPA%20No.%201021-1798).pdf
www.mgk.com/pdfs/MSDS%2074406%203-30-2004%20(EPA%20No.%201021-1800).pdf
www.mgpolymers.com/CTF-TURBO.pdf
www.mgpolymers.com/CTF8006-2MSDS.pdf
www.mgsp.msu.edu/Cropping_Systems/CAS%20for%20Greenhouses.pdf
www.mh.state.oh.us/oss/warehouse/safety-sheets/sanitizer.pdf
www.mh.state.oh.us/oss/warehouse/safety-sheets/sludge.pdf
www.mhchem.com/ehtml/file/MSDS/Pro-Cr_Com/MH.BN.05.pdf
www.mhchem.com/ehtml/file/MSDS/Pro-Cr_Com/MH.R.95.pdf
www.mhchem.com/ehtml/file/MSDS/Pro-Cr_Com/MH.Y.KK.pdf
www.mhchem.com/ehtml/file/SPEC/Pro-Cr_Com/BLACK%2004.pdf

Speed is very important. We have more than 1 million files to download. The download manager must be able to process each file as it gets to it on the list, compared to processing all files before it begins the download.

You have one week to finish the project.

Please provide any thoughts you have for this project in a private message.