Project Detail

Description

i need something created to scrape from a financial website. there is a site that has exactly what we need. here is an exact example of what i need done: http://bit.ly/tUZwX

ignore the "thumbs up / thumbs down" application and the "Get our full report on... BUY NOW" section. the rest of the info is what i need scraped from a financial website (i wil tell you in private the name of the website) and then populated on my joomla site. yes, my site is 100% joomla...not sure if that matters or not.

once you visit the above link, you will notice at the end of the web address, there is a 4 letter symbol. that is a stock symbol for a u.s. publicly traded company. The way his system works, is that each day it goes out to the financial website around midnight and grabs information for a list of symbols he has on his sitemap page. We will need to have this sitemap page created as well. It then places the information in a database on his server and then displays it accordingly when the symbol is requested by a user and by search engines.

this website is very successful with google results. if you search for vtss for example on google, they are on the second page of results. for most of the stock symbols, they are listed on the first page.

The image on the page is also unique. The actual image stays the same, but the image description and text on the image changes according to what symbol is requested. This also goes for the keywords on the page and the description of the page.

For example: if someone searched for XYZ symbol, the page that shows up has the meta title, meta description, meta keywords, image description and image text change to match the company they searched for. This works great for search engines as they feel the page has good info on that symbol, thus resulting in good page rank. This all has to be done on the fly (live). At least I think it does. The programmer should know how this is done.

If I have 5,000 symbols, there doesn't need to be 5,000 new pages created. It should just create one page and then this page changes according to what is requested.

I will also need the programmer to implement this on to my site. So this doesn't just mean the programmer will create the product, but it will also have to be implemented on my site.

Here is what is needed (I believe this is what is needed. Programmer might need more than this):
1 - create sitemap page with all symbols
2 - create script to grab data from financial website each day for each symbol and save on our server
3 - create script that populates a page dynamically with company info (includes all the title, description, keywords and image description/text)
4 - integration of all scripts on our website
5 - needs to work exactly like this site: http://bit.ly/tUZwX


I have a Joomla site running the following:

PHP built On: Linux
Database Version: 5.0.22-log
PHP Version: 4.4.9
Web Server: Apache/1.3.41 (Unix) PHP/4.4.9 mod_log_bytes/1.2 mod_bwlimited/1.4 mod_auth_passthrough/1.8 FrontPage/5.0.2.2635 mod_ssl/2.8.31 OpenSSL/0.9.8b
WebServer to PHP interface: apache
Joomla! Version: Joomla! 1.0.15 Stable
User Agent: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.8) Gecko/2009032609 Firefox/3.0.8 (.NET CLR 3.5.30729)


Additional files submitted:
RAC_DOC_NameCryptedToProtectYourPrivacy_X200932492358603521637550760622150403662408308368571450240727348684700.gif