Load only new files

• UnionAll

  SSCrazy

  Points: 2102

  More actions

  November 17, 2009 at 2:27 pm

  #216816

  Hi,

  I have folder name FolderA and it has 10 text files one for each month.

  I loaded all the text files into a table using for each loop container.

  Now, when i get a new text file for the month of november i sould load only this file into the table

  like an incremental load.

  How is this possible?

  Thanks,

• ravikanth.

  Hall of Fame

  Points: 3472

  More actions

  November 17, 2009 at 5:29 pm

  #1080629

  I have batch file to run as second step in Job which runs SSIS package.This step will dump the loaded files to Processed folder and the next time SSIS package runs it will only have new files.

• Jack Corbett

  SSC Guru

  Points: 184394

  More actions

  November 18, 2009 at 8:14 am

  #1080933

  I would add a second step within the 4 each file enumerator and move the processed files to an archive folder.

  Jack Corbett
  Consultant - Straight Path Solutions
  Check out these links on how to get faster and more accurate answers:
  Forum Etiquette: How to post data/code on a forum to get the best help
  Need an Answer? Actually, No ... You Need a Question

• UnionAll

  SSCrazy

  Points: 2102

  More actions

  November 18, 2009 at 8:42 am

  #1080958

  This helps,

  Thanks!

• hussain27syed

  Ten Centuries

  Points: 1191

  More actions

  November 18, 2009 at 9:34 am

  #1081004

  If you do not wish to archive the files, you can use a log table or a log file to store the name of the files already imported. Use a script task to exclude files that have been already imported.