How to manipulate web page using SSIS

Question

How to manipulate web page using SSIS

Mark F-428640

Hall of Fame

Points: 3659
More actions
March 6, 2009 at 11:46 am

#155385

Does anyone know how to use SSIS to manipulate entry into a web page and retrieval of information. What I am attempting to do is navigate to a specific web page then enter a user login and password. Once this is done I wish to complete the download of a zip file -- the zip file file down load dialogue page pops up after entering the login criteria.
Has anybody done anything like this.
I appreciate the help thanks.

Viewing 5 posts - 1 through 4 (of 4 total)

You must be logged in to reply to this topic. Login to reply

Tim Mitchell SSCoach Points: 15685 More actions · Answer 1

You *might* be able to do this, but it's unlikely. For example, if the website allowed the passing of user ID and passwords in the URL string, you could automate the connection, but in doing so you'd be sending your credentials across the wire in an insecure manner. The download of the file would be a bit easier, assuming a standard naming convention, but the login would be difficult to get around.

Does the vendor or website proprietor expose any other services, such as FTP or web services? You'll have better luck with those than trying to authenticate through HTTP.

hth,

Tim

Tim Mitchell
TimMitchell.net | @tmitch.net | Tyleris.com
ETL Best Practices

Mark F-428640 Hall of Fame Points: 3659 More actions · Answer 2

Thanks Tim,

Judging by the number of responses I am getting it doesn't seem like there is an easy way to do this. Yes the vendor we are picking the list up from most likely won't allow us to pick the file up via FTP or using a web service but I have asked our project manager to ask. I was hoping to automate the pick up process.

Appreciate the response.

Ed Zann SSCrazy Eights Points: 8694 More actions · Answer 3

Here is a small vbscript I use to login to a site and click a button on a subsequent form. I run it from a scheduled task, not from SSIS. Maybe it will be helpful in your situation.

dim IE, d

dim READYSTATE_COMPLETE

READYSTATE_COMPLETE = 4

Set IE = CreateObject("InternetExplorer.Application")

IE.visible = true

IE.Navigate "https://www.somesecuresite.com/logon.asp"

While IE.ReadyState < READYSTATE_COMPLETE

'loop

Wend

IE.document.logonForm.UserName.value = "userid"

IE.document.logonForm.Password.value = "password"

IE.document.logonForm.submit.click

While IE.busy

'loop

Wend

wscript.sleep(6000)

IE.document.parentwindow.frames(1).document.AnotherForm.SubmitButton.click

While IE.busy

'loop

Wend

wscript.sleep(6000)

IE.Quit

Mark F-428640 Hall of Fame Points: 3659 More actions · Answer 4

Mark F-428640

Hall of Fame

Points: 3659

March 10, 2009 at 7:48 am

#956788

THanks I will give this a try...