January 9, 2012 at 2:59 pm
There is a public site that has csv files on the site and i need to get all of the files and then the next file each day where it does not exist in a folder. I have tried to pass a wildcard variable but I am failing at that. I have added 2 variables to my script task RemoteUri and a LocalFolder. Can anyone assist. Here is a link to the site as it is public. Thanks for you assistance http://www.pseg.com/rsu/com.integ.rsu.RSOFinalProfilesServlet
January 10, 2012 at 1:04 am
This was removed by the editor as SPAM
January 11, 2012 at 2:30 am
+1 for the "for each" solution - I've used it a lot with csv files as we get them delivered by ftp. Processed files are then moved to a "done" folder using a file system task as the last item in the for each.
If you download all of the files then process you can use that system. Otherwise you'll need to use the script task in the loop and check each file's date attribute to find the current ones.
January 11, 2012 at 5:23 am
I wanted to provide an update, I ended up utilizing SSIS and created a webcrawler script, I am checking if date exists in our library of information and if it does not; to scrape the data and import it. It took sometime but this is successfully running, the one issue I had was parsing out the string as I negelected to remember Char(10), after that I was able to have a successfull run with the desired output. Thank you for each of your comments and suggestions. Long Live SSC!
Viewing 4 posts - 1 through 3 (of 3 total)
You must be logged in to reply to this topic. Login to reply