Loading Flat file into SQL server 2005 using SSIS

  • Hi All,

    I have a flat file generated by Business Object (BO). It is FTP'ed to the FTP server. I have created an SSIS package that includes following:

    1. FTP task to get the file.

    2. Data flow task

    A) a. Flat file source

    b. OLEDB destination as Staging table

    B) a. OLEDB Staging table as source

    b. Look up table (looking for the ID in destination and comparing with the source table, and the error output (difference/new rows) are loaded into base/live table)

    c. OLEDB destination as Base/Live table.

    3. Execute SQL task --Staging table Cleanup task.

    The problem is that the package when executed first time does not load the data into the base table.

    But when executed second time or third time loads the data into the base table.

    Can anyone help me out !!!

    Thanks in advance,

    \\K 🙂

    ______________________________________________________________________________________________________________________________________________________________________________________
    HTH !
    Kin
    MCTS : 2005, 2008
    Active SQL Server Community Contributor 🙂

  • "First time" after what? What do you do that resets it?

    [font="Times New Roman"]-- RBarryYoung[/font], [font="Times New Roman"] (302)375-0451[/font] blog: MovingSQL.com, Twitter: @RBarryYoung[font="Arial Black"]
    Proactive Performance Solutions, Inc.
    [/font]
    [font="Verdana"] "Performance is our middle name."[/font]

  • RBarryYoung (6/2/2009)


    "First time" after what? What do you do that resets it?

    Hi,

    I am not resetting the package. But when I run from BIDS for first time, no data gets loaded, but running 2nd or 3rd time loads the data.

    Same happens with the package scheduled as a job in SQL server.

    I dont know what is happening ?

    Thanks,

    \\K

    ______________________________________________________________________________________________________________________________________________________________________________________
    HTH !
    Kin
    MCTS : 2005, 2008
    Active SQL Server Community Contributor 🙂

  • Do you have Logging turned on? What does it say is happening?

    [font="Times New Roman"]-- RBarryYoung[/font], [font="Times New Roman"] (302)375-0451[/font] blog: MovingSQL.com, Twitter: @RBarryYoung[font="Arial Black"]
    Proactive Performance Solutions, Inc.
    [/font]
    [font="Verdana"] "Performance is our middle name."[/font]

  • RBarryYoung (6/3/2009)


    Do you have Logging turned on? What does it say is happening?

    Hi,

    The package runs OK in BIDS. It does not give me any errors, but I am concerned that during the first run, I do not see any data loaded inmy live table. I suspect that this may be due to the lookup task. But I am not sure.

    Let me know your input.

    Thanks,

    \\K

    ______________________________________________________________________________________________________________________________________________________________________________________
    HTH !
    Kin
    MCTS : 2005, 2008
    Active SQL Server Community Contributor 🙂

  • SQL_Quest (6/3/2009)


    RBarryYoung (6/3/2009)


    Do you have Logging turned on? What does it say is happening?

    Hi,

    The package runs OK in BIDS. It does not give me any errors, but I am concerned that during the first run, I do not see any data loaded inmy live table. I suspect that this may be due to the lookup task. But I am not sure.

    OK. Do you have Logging turned on? What does it say is happening?

    [font="Times New Roman"]-- RBarryYoung[/font], [font="Times New Roman"] (302)375-0451[/font] blog: MovingSQL.com, Twitter: @RBarryYoung[font="Arial Black"]
    Proactive Performance Solutions, Inc.
    [/font]
    [font="Verdana"] "Performance is our middle name."[/font]

Viewing 6 posts - 1 through 5 (of 5 total)

You must be logged in to reply to this topic. Login to reply