Project Detail

Web scraper using ASP.NET, C# & SQL Server

Web scraper using ASP.NET, C# & SQL Server is project number 299699
posted at GetAFreelancer.com. Click here to post your own project.

Status: Closed
(Selected Service Provider)

Selected Providers: Mohitkatariya

Budget: $30-250

Created: 08/18/2008 at 20:59 EDT

Bid Count: 14

Average Bid: $ 201

08/25/2008 at 20:59 EDT

Project Creator: apergiel
Employer Rating: (No Feedback Yet)

Description

Web scraper using ASP.NET, C# & SQL Server
This is for my own learning. 1st time I have posted a project.
The following is also attached in the file "spec.doc"

SPECIFICATION
Three (3) tables to be used
1st_Table) URL
Field Example_Data
----- ------------
ID 1
URL http://news.google.com
ARGUMENT /news?source=ig&hl=en&um=1&tab=wn&q=
REGEX (?<=baboutbs*)[0-9]*(?=s*b forb)

2nd_Table) TERM
Field Example_Data
----- ------------
ID 1
TERM radon

3rd_Table) RESULT
Field Example_Data
----- ------------
ID 1
URL http://news.google.com
ARGUMENT /news?source=ig&hl=en&um=1&tab=wn&q=URL_ARGhttp://news.google.com/news?source=ig&hl=en&um=1&tab=wn&q=radon
REGEX (?<=baboutbs*)[0-9]*(?=s*b forb)
TERM radon
RESULT 553
DATETIME August 05, 2008 4:00PM
COUNT 1

Loop through combinations of 2 tables (URL & TERM), get the regular_expression and append it (and other data) into the 3rd table (RESULT)

1st_Step) Get bring the 'source' of URL into a text file

2nd_Step) Parse this text using Regex
//c# EXAMPLE
Regex regex = new Regex(@"(?<=baboutbs*)[0-9]*(?=s*b forb)",RegexOptions.IgnoreCase);
// The above is from table URL field REGEX --> ---------------------------------------------
// Run regex parsing on matches
MatchCollection matches = regex.Matches(text);

3rd_Step) Save findings and other info to "RESULT" table

Note:
1) The attached example code "almost" works for a single URL, I got stuck on matchcollections
2) Liberal use of comments is appreciated.
3) The "ID" field is a Identity field that self increments, but is not used for anything now
4) I would like the use of REGEX & Matchcollection, unless a better method is known.
5) A simple ASP.NET page allowing the add/edit/delete of the 3 tables will be needed
5a) two buttons one to import & on to export to a excel file is needed for all three tables

Additional files submitted:
Default.aspx
Default.aspx.cs
spec.doc

Report Violation

Messages Posted: 2

If you are the project creator or one of the bidders Log In for more options

PMB

250

10 days

08-22-2008 15:03 EDT

9.80/10 9.80/10 9.80/10 9.80/10 9.80/10 9.80/10 9.80/10 9.80/10 9.80/10 9.80/10
(5 reviews)

Hello Sir, We are interested. Please check PMB

namrom

200

5 days

08-18-2008 23:40 EDT

(No Feedback Yet)

www.thuedia.com

pradyuman

250

8 days

08-19-2008 00:11 EDT

(No Feedback Yet)

we are india based website and software development firm, please have a look at our website www.gnwebsoft.com for ore information.

cleric138

230

6 days

08-19-2008 00:50 EDT

(No Feedback Yet)

i can do it,see your PM.

titonmoy

200

5 days

08-19-2008 02:56 EDT

(No Feedback Yet)

HI, This is Tonmoy, I have seen your job posting, I may fit for this job. Please see PM for the details. Thanks. Regard, Tonmoy

Harryjassal

150

3 days

08-19-2008 07:15 EDT

(No Feedback Yet)

Hello Sir, Here this is Randhir singh from India.I am very much interested to do your work. i have 5 years of experiance in asp.net,ajax,HTML/CSS,flash communication server. i have experience in e-commerce, content management systems, picture galleries, web chat,screen scraping, community,audio and video recording. my portfolio is following: http://www.shiplanes.com/ http://www.ucgsga.net/ http://www.medicalab.co.in http://59.94.224.240/dogsinbritain/LogIn.aspx http://59.94.224.240/Supery/User/frmHomePage.aspx I look forward to hearing from you. Thank you for your consideration.

ryannerd

250

20 days

08-19-2008 16:16 EDT

(No Feedback Yet)

This is easily done. Let me know when to start! BTW, How can something like this: (?<=baboutbs*)[0-9]*(?=s*b forb) be called Regular?!?

mrugesh4

200

5 days

08-20-2008 08:51 EDT

(No Feedback Yet)

we are interested and ready to develop this application as soon as possible..as per your requirements and convenience.

Bagdady

180

3 days

08-20-2008 10:12 EDT

(No Feedback Yet)

i am ready to start working.trust me.

amitstech

150

8 days

08-20-2008 11:22 EDT

(No Feedback Yet)

HI, I am interested in your job posting. This may be my first project, as i m new to freelance world:) Regard, Amit

Inny

150

2 days

08-21-2008 06:34 EDT

(No Feedback Yet)

I will write this scraper for you.

sanalyst

202

30 days

08-23-2008 03:22 EDT

(No Feedback Yet)

Dear Sir, I am having 4 years of experience in Microsoft Technologies. In this span I have developed various intranet and web based projects using ASP.NET/C#/AJAX/cuyahoga framework/NHibernate and MS Sql Server as backend.Also created static and dynamic design models. Having excellent analytical, logical and programming skills, I'm capable of analysing problem domain and provide a very firm solution which could be maintained with your business agility. I have my group who can work with me to complete this project on time. My candidature matches with the applied job. Expertise: ASP.NET 2.0,3.5,C#,AJAX,cuyahoga framework,NHibernate,SQL Server 2005/2008,UML Regards, Atul Chaturvedi

Mohitkatariya

150

10 days

08-24-2008 04:04 EDT

(No Feedback Yet)

I have 2 year of experience in .net technologies and programming. As a freelancer i had done two web scrapping projects, so i have good exposure how to use Regex and other .net classes for scrapping. I had done a web scrapping project which was basically a more like a reversr engineering project, in which i have to extract data and create a atabase from that. i have a hand on experience of e-commerce based web site and desktop application in microsoft tech.

mianrizwanali

250

30 days

08-24-2008 10:45 EDT

(No Feedback Yet)

Please View PM.

Bid on this Project

WHAT IS GETAFREELANCER.COM?

Get A Freelancer is a global outsourcing solution and freelance jobs website. Here you can find freelance coders, writers, programmers, designers, marketers and more. You can also outsource projects and save a lot of money in the process. Getting the best web design, professional programming, custom writing or affordable marketing has never been easier!

We have thousands of satisfied clients from every corner of the world. Would you like to outsource your next project? Would you like to find freelance jobs and make money online? Just sign up to get started! Outsourcing jobs is the process of hiring an outside company or individual to complete your projects. We have created a safe environment for both service buyers and service providers via our secure payment system. You outsource the project and don't release any money until you're satisfied! Try outsourcing for free today! Don't forget to bookmark our homepage for your next project or job.