So you suggesting to load the data i handle in in memory?
just need to keep synchronized but it may work

The problem is that i need to get the data ready for users to handle the job problems in max 1 hour. At this moment i am barely over the water...

The 6k+ files slowly arrive during the whole day.

The files contain an hierarchical structure
Route
-> Stops
      -> Jobs
           -> Items

I wrote the software in c#. It's kinda simple, it just deserialize the xml file check if the data already exists. It it does update it otherwise insert it. After...

it's 3 different XML files. I wrote a software that does some calculations and insert/update files. I never used SSIS before. is it flexible (and fast) so i can write...

Hi Anthony

Thanks for the replay. But lets see the case of TotalOutersShort column

Null Values = 125175
Total Rows = 185567

So 125175 / 185567 = 0.67...