Extract data from Web Page

Question

Extract data from Web Page

BanOcto

Say Hey Kid

Points: 680
More actions
August 31, 2006 at 6:25 pm

#192087

Is there a way of using SSIS to extract data from a web page? Or is there a way of using SSIS to extract data from a html file?

Cheers
BanOcto

Viewing 5 posts - 1 through 4 (of 4 total)

You must be logged in to reply to this topic. Login to reply

gibsonrobert SSC Veteran Points: 237 More actions · Answer 1

Web services were created to end web scraping, because web scraping is very fragile... Don't scrape the web if you can avoid it. Content moves and you get bad data or none. Try to find another solution.

Hans Lindgren SSChampion Points: 10496 More actions · Answer 2

Agreed. Screen (web) scraping is bad, very fragile solution and most often generates ugly and unmaintainable code.

Try to contact the content provider and see if they can offer you any other way of retrieving the data. (Scraping is usually not seen well upon by the content providers)

BanOcto Say Hey Kid Points: 680 More actions · Answer 3

Thanks for the advice. I'll seek alternatives.

Cheers

JBroderick SSC Rookie Points: 47 More actions · Answer 4

Do you have web scraping tasks that need attention, but you don't have the attention to give them?

Give us a try @ ScrapeGoat.

We build custom scraping bots that grab the data you need and store it conveniently in sql format, csv format, excel, and many others.

We only do legitimate work. No content theft will be entertained.