Check if File Exists?

Question

Check if File Exists?

Charmer

SSChampion

Points: 14903
More actions
October 8, 2012 at 5:58 am

#265500

Hi Firends,
I have a folder containing 30 text files(each file is different in structure)....i have 30 data flow tasks to pull the data from the text files to SQL server. If files exists then the respective data flow taks alone must be executed else no action. how to do this? please gimme your suggestions, friends...I use ssis 2008
Any suggestions would be really appreciated
Thanks,
Charmer

Viewing 8 posts - 1 through 7 (of 7 total)

You must be logged in to reply to this topic. Login to reply

Phil Parkin SSC Guru Points: 246993 More actions · Answer 1

Are you doing the imports in parallel or in series?

A no-code solution could utilise FOREACH containers - the container just does not execute if the file is not there and no error is thrown.

The absence of evidence is not evidence of absence.
Martin Rees

You can lead a horse to water, but a pencil must be lead.
Stan Laurel

Charmer SSChampion Points: 14903 More actions · Answer 2

Phil Parkin (10/8/2012)
Are you doing the imports in parallel or in series?
A no-code solution could utilise FOREACH containers - the container just does not execute if the file is not there and no error is thrown.

Yes Phil, i am doing it in parallel....

So ForEach containers does not help ?

Thanks,
Charmer

SGT_squeequal SSCertifiable Points: 7167 More actions · Answer 3

Do you have a list of file names? you could use master.dbo.xp_fileexist to determine if they exist or not

***The first step is always the hardest *******

Phil Parkin SSC Guru Points: 246993 More actions · Answer 4

Charmer (10/8/2012)
Phil Parkin (10/8/2012)
Are you doing the imports in parallel or in series?
A no-code solution could utilise FOREACH containers - the container just does not execute if the file is not there and no error is thrown.
Yes Phil, i am doing it in parallel....
So ForEach containers does not help ?

Not ideal.

But if you put a Foreach container around each dataflow, for the specific file which that dataflow is processing, it should work.

The absence of evidence is not evidence of absence.
Martin Rees

You can lead a horse to water, but a pencil must be lead.
Stan Laurel

Charmer SSChampion Points: 14903 More actions · Answer 5

SGT_squeequal (10/8/2012)
Do you have a list of file names? you could use master.dbo.xp_fileexist to determine if they exist or not

yes, i have the file names...so...?

Thanks,
Charmer

Charmer SSChampion Points: 14903 More actions · Answer 6

Phil Parkin (10/8/2012)
Charmer (10/8/2012)
Phil Parkin (10/8/2012)
Are you doing the imports in parallel or in series?
A no-code solution could utilise FOREACH containers - the container just does not execute if the file is not there and no error is thrown.
Yes Phil, i am doing it in parallel....
So ForEach containers does not help ?
Not ideal.
But if you put a Foreach container around each dataflow, for the specific file which that dataflow is processing, it should work.

So using seperate container is the only option if we do in parallel? or any other better idea Phil..? could you suggest me..?

Thanks,
Charmer

Phil Parkin SSC Guru Points: 246993 More actions · Answer 7

Charmer (10/8/2012)
Phil Parkin (10/8/2012)
Charmer (10/8/2012)
Phil Parkin (10/8/2012)
Are you doing the imports in parallel or in series?
A no-code solution could utilise FOREACH containers - the container just does not execute if the file is not there and no error is thrown.
Yes Phil, i am doing it in parallel....
So ForEach containers does not help ?
Not ideal.
But if you put a Foreach container around each dataflow, for the specific file which that dataflow is processing, it should work.
So using seperate container is the only option if we do in parallel? or any other better idea Phil..? could you suggest me..?

Can't think of anything that is possible without a load of dev. and introducing quite a bit of complexity. I might be missing something - anyone else got any ideas?

If you were prepared to run things serially, your package design could be much more elegant - though probably at the expense of performance.

The absence of evidence is not evidence of absence.
Martin Rees

You can lead a horse to water, but a pencil must be lead.
Stan Laurel