Screen scrapping(url) from Stored Proc

  • Hello Team,

    I need to do a screen scrapping from a stored prc(sql 2005)

    Through DTS we can do this using activex script 'xmlhttp" component, but I don't want to go for a dts pkg. It is basically an url(http://companyxml?id=999) contains some xml data. I want to extract the xml content thru' a sql command. From there I"ll manipulate the xml content and store it to table. Any help wld be highly appreciatable. many thx in advance.

    Regards,

    Maruthi

    Regards,
    Maruthi

  • Can't you just have the proc return a recordset/output param with the XML data in it? Wouldn't that be easier?

    - Gus "GSquared", RSVP, OODA, MAP, NMVP, FAQ, SAT, SQL, DNA, RNA, UOI, IOU, AM, PM, AD, BC, BCE, USA, UN, CF, ROFL, LOL, ETC
    Property of The Thread

    "Nobody knows the age of the human race, but everyone agrees it's old enough to know better." - Anon

  • It is an external url from where I"ll be retrieving the xml content. as it is not in my access reach can't ask in specific formats. when I execuet the url, I"ll get the xml content in a webpage. I want to scrap the entire content and process it in my SQL side. Doing it in DTS pkg wld be easier but again I hv to initiate the DTSpkg from TSQL which I want to avoid. Looking out for any command line utility or advanced SQL 2005 TSQL methods to do such screen scrapping so that it is easy to handle within the proc itself. appreciate ur response.

    Regards,
    Maruthi

  • Unless the data is actually in a gif or a jpeg, you should not have to screen scrape a web page to get the text. HTML is by definition plain text. It is pretty easy in C# to return the stream from a URL. If you are not aware of how to do this, I would suggest you get some help from a developer.

  • Yep, I know itz pretty simple code in c#. but again I hv to depend on a .Net component to execute this piece. my problem is, am in a middle of a proc and just need those xml data. instead of a c# code, I can read the webpage content thru' an activex script from DTS. itz all increases the dependency either I hv to kickoff the pkg or execute such .net exe. in order to avoid all these, am looking out something within TSQL reach. if nothing works out then will hv to write a simple .net exe and call it thru' xp_cmdshell. appreciate ur response.

    Regards,
    Maruthi

Viewing 5 posts - 1 through 4 (of 4 total)

You must be logged in to reply to this topic. Login to reply