What transformations will I need?

  • Hi all, we are rewriting a large number of DTS packages, I have done a quick sample audit of the packages, typically they involve any combination of the below;

    1) Deletion of existing files,

    2) Running a SQL statement or batch file,

    3) Connecting to a SQL/Excel source/destination, importing or exporting data to or from it;

    4) Sending emails indicating which of the previous elements failed, or overall success.

    There are several packages containing ActiveX Scripting, though they SEEM only to either check whether a csv/txt file exists, rename it, or make a copy of it to a network drive and delete the original.

    What are transformations in SSIS I need to create the packages?

    Thanks,

    JB

  • 1. File System Task

    2. Execute SQL Task (SQL) or Execute Process Task (batch)

    3. Data Flow with corresponding sources and destinations.

    4. Send Mail Task

    The SSIS development team really did their best to choose logical names for the components 😉

    ActiveX --> Script Task.

    Need an answer? No, you need a question
    My blog at https://sqlkover.com.
    MCSE Business Intelligence - Microsoft Data Platform MVP

  • For the deletion of the files you could also use a Script Task. I find it to be more useful than the File system task in some cases.

    If you wanted to get real tricky, you could do most of that stuff via Script tasks (delete the files, execute stored procs or adhoc queries and send mail) you'd just have to be a bit more adept at the programmatic means rather than the GUI. 😀

    Jason...AKA CirqueDeSQLeil
    _______________________________________________
    I have given a name to my pain...MCM SQL Server, MVP
    SQL RNNR
    Posting Performance Based Questions - Gail Shaw[/url]
    Learn Extended Events

  • Cheers guys!!

    Another question, I have a LOT of these to build, typically I'll only need 2-3 tasks and a couple of connections...

    Is it possible/worthwhile using the Wizard to create?

  • IMHO - I wouldn't use the wizard.

    Jason...AKA CirqueDeSQLeil
    _______________________________________________
    I have given a name to my pain...MCM SQL Server, MVP
    SQL RNNR
    Posting Performance Based Questions - Gail Shaw[/url]
    Learn Extended Events

  • Jake Shelton (2/5/2014)


    Cheers guys!!

    Another question, I have a LOT of these to build, typically I'll only need 2-3 tasks and a couple of connections...

    Is it possible/worthwhile using the Wizard to create?

    If you have a lot of similar packages to create then you might want to look into using BIML via BIDSHelper http://bidshelper.codeplex.com/wikipage?title=Biml%20Package%20Generator&referringTitle=Documentation. With this small changes can be made and packages generated without having to drag-drop-edit over and over again.

    Or with clever use of variables and looping you may be able to keep the entire task down to one package*

    As for having only a couple of connections you can use project level connection managers and just call these in each package. 🙂

    *pure speculation seeing as I don't know the exact needs of your environment 😉


    I'm on LinkedIn

  • How about creating SSIS template ? and using it while creating all the packages

  • chetan.deshpande001 (2/6/2014)


    How about creating SSIS template ? and using it while creating all the packages

    Indeed, but can it store connection information, so as well as commonly repeating tasks, can the template store repeating sources/destinations?

  • If you are creating a lot of them, you might want to check out BIML:

    http://bimlscript.com/

    It takes a wee while to learn how to drive it, but once you do, you can create templates and produce the SSIS packages that way.

Viewing 9 posts - 1 through 8 (of 8 total)

You must be logged in to reply to this topic. Login to reply