Project Detail

Description

I placed budget at $250 max, but in your PM if this is not enough to cover the cost PM me your bid amount.

Elements (database structure, included as attachment. Structure not 100% set in stone, if you have a better structure please let me know)


I need a PHP script to scrape the following websites and save the properties to a database file each day. The script should be run via a cron job. It should update the database as needed for each site. The data should be stored in a MySQL database file. I do have duplicate sites listed in this list. I just copied it from an old project. The script should be “EASY” to modify to make it work with changes to the format of the websites it’s scraping data from. Even though there is a large list here this project should be relatively easy and quick for an experienced website scraper to complete.

The database will eventually need to be exported to our real estate website application, this will be a future project.

Places to get ideas on how to get info:

Not limited to the following, but they are a place to get some ideas from.
http://simplehtmldom.sourceforge.net/
http://blog.dougalmatthews.com/2008/08/html-dom-and-easy-screen-scraping-in-php/
http://www.merchantos.com/makebeta/php/scraping-links-with-php/
http://www.bradino.com/php/php-screen-scraping/





I need these sites Real Estate data scraped:
IndyMac Bank REO:
http://apps.indymacbank.com/individuals/realestate/search.asp

Ocwen Financial REO:
http://www.ocwen.com/reo/home.cfm

JP Morgan Chase Bank REO:
http://mortgage.chase.com/pages/other/co_properties_landing.jsp

M&T Bank REO:
http://services.mandtbank.com/personal/bank_owned_prop.cfm

Wells Fargo REO:
https://www.pasreo.com/reo/

Washington Mutual REO (WAMU):
http://www.wamuproperties.com

American Home Mortgage REO:
http://www.ahmhomes.com

Wachovia REO:
http://reo.wachovia.com/

SunTrust REO:
http://www.suntrustmortgage.com/reo.asp

Compass Bank REO:
https://www.compassbank.com/appforms/properties/index.jsp

Fannie Mae REO:
http://www.mortgagecontent.net/reoSearchApplication/fanniemae/

Freddie Mac REO:
http://www.homesteps.com/hm01_1featuresearch.htm

HUD REO:
http://www.hud.gov/homes/index.cfm

HomeSales.gov

Regions Bank Properties
http://realestate.regions.com/servlet/Ore/ForeclosedPropertySearch.jsp

Citibank REO
http://www.citimortgage.com/Mortgage/Oreo/SearchListing.do

SBA Properties
http://app1.sba.gov/pfsales/dsp_search.html

FDIC Real Estate Owned
http://www4.fdic.gov/DRRORE/

Sallie Mae Financial Services Properties
http://www.grpcapital.com/properties/index.html

BB&T REO (Branch Bank and Trust)
http://www.bbt.com/applications/specialassets/search.asp

Beal Bank Commercial REO
http://www.bealbank.com/Content.aspx?ID=13

GRP Financial Services Properties
http://www.grpcapital.com/properties/index.php

People's Bank REO
http://www.peoples.com/im/cda/multi_elements/0,,1355,00.html

National City Mortgage REO
http://www.ncmcreo.com/

Taylor Bean REO
http://www.taylorbeanhomes.com/

Downey Savings & Loan
http://www.downeysavings.com/bank-owned-properties

AmSouth Bank
http://www.amsouth.com/property/Search.asp

Bank Of America
http://bankofamerica.reo.com/search/

Beal Bank
http://www.bealbank.com/Content.aspx?ID=13

BB&T
http://www.bbandt.com/applications/specialassets/search.asp?p=1

Citibank
http://www.citimortgage.com/Mortgage/Oreo/SearchListing.do

Compass Bank
http://www.compassweb.com/properties/

Countrywide Home Loans
http://www.countrywide.com/purchase/f_reo.asp

Downey Savings
http://www.downeysavings.com/ffs/properties

Fannie Mae
http://www.mortgagecontent.net/reoSearchApplication/fanniemae/reoSearch.jsp

FDIC
http://www2.fdic.gov/drrore/

Fidelity National Financial
http://www.buybankhomes.com/Default.asp?_URL_=/PropSearch/PropSearch.asp

First National Bank of Alaska
http://www.fnbalaska.com/243.cfm

First Preston
http://www.firstpreston.com/

Freddie Mac
http://www.homesteps.com/hm01_1featuresearch.htm

Fremont Investment & Loan
http://www.1800fremont.com/REO/ReoProperties_Available.asp

GMAC
http://www.gmaccm.com/gmaccm/RealEstateAssetManagement/reo/search.asp?img=3

GRP Financial (Sallie Mae)
http://www.grpcapital.com/properties/index.html

HMB
http://www.hmbireo.com/listing.php

Home Loan Bank
http://www.hlbsales.com/index.htm

HSBC
http://www.banking.us.hsbc.com/HICServlet?cmd_PropertySearchDefault=cmd_PropertySearchDefault

HSBC Commercial
http://www.us.hsbc.com/1/2/3/business/borrowing/real-estate/for-sale

HUD
http://www.hud.gov/offices/hsg/sfh/reo/homes.cfm

Indy Mac Bank
http://apps.indymacbank.com/individuals/realestate/listings.asp?PType=ALL&City=&State=ALL&Zip=&BedroomMin=0&BedroomMax=NOMAX&BathroomMin=0&BathroomMax=NOMAX&PriceMin=0&PriceMax=NOMAX&submit1=SEARCH+CRITERIA+::

Integrated Asset Services
http://www.iasreo.com/search/home4sale.asp

JP Morgan Chase Bank
http://mortgage02.chase.com/alt/altdel/REOSearch.jsp

Kennedy Funding
http://www.kennedyfunding.com/for_sale.html

Kentucky Housing Corporation
http://www.kyhousing.org/apps/REO/

Keystone Asset Management
http://www.keystonebest.com/reo/reo_inventory.asp

Lenders Asset Management
http://www.lendersreo.com/2020applications/propertylistings.asp

Lexington State Bank
http://www.lsbnc.com/property_for_sale.asp

M&T Bank
http://services.mandtbank.com/personal/mortgage/reomort.cfm

Mortgage Lenders Network
http://www.mlnusa.com/realestate/listings.asp

National Bank of Arizona
http://www.nbarizona.com/BusinessBanking/CommercialRealEstate/BankOwnedProp.htm

New South Federal Savings Bank
http://www.newsouthfederal.com/reo/

Ocwen Financial
http://www.ocwen.com/reo/home.cfm

PNC Bank
http://www.realtyservices.pnc.com/

People's Bank
http://www.peoples.com/about/community/0,8397,1355,00.html

Premiere Asset Services (Wells Fargo)
http://www.pasreo.com/consumerSvlt/nav/ConsumerNavL1.jsp/requestPage/consumer/PropertySearch.jsp

Private Financial Services (Bank of OK)
http://www.bokproperties.com/realestate/search.asp

Regions Bank
http://realestate.regions.com/servlet/Ore/ForeclosedPropertySearch.jsp

REO Nationwide
http://www.reonationwide.com/prop_list.asp

REO Trans
http://www.reotrans.com/

Security National
http://www.snsc.com/ReoProperties.aspx

Small Business Administration (SBA)
http://app1.sba.gov/pfsales/dsp_search.html

Texas State Bank
http://www.texasstatebank.com/property_listing.html

T R.E.O
http://www.treonet.com/PropertyDB/Listings_list.asp

U.S. Department of Agriculture
http://www.resales.usda.gov/

U.S. Government Home Sales
http://www.homesales.gov/homesales/mainAction.do

Unity Bank
http://www.unitybank.com/foreclosures/index.cfm

US Bank
https://customercare.fnfismd.com/usbankhomemortgage/reo/reoReport.asp


Virginia Housing Development
http://www.vhda.com/vhda_com/Template_app.asp?VHDA_COM_PAGE_NAME=REOSearch

Wells Fargo Commercial
http://www.wellsfargo.com/com/cgi/properties

Western Bank
http://www.wbpr.com/En/RepossessedProperties.asp

Wilshire Credit Corp.
http://www.wfsg.com/realestate/realestate.aspx

Zions Bank
http://www.zionsbank.com/foreclosed_properties.jsp?leftNav=specialty_fore&topNav=sbanking

Canada Mortgage and Housing Corporation
http://www.cmhc.ca/en/moinin/prsain_/

Some of the sites, may be down, or not have current listings due to the current banking issues in the US.


Additional files submitted:
Property Webscrape Project.doc