Is there any pattern to which rows are missing? For instance, is it skipping every other row?

Try Post #805312.

The sort task is very slow and only suitable for small files.

If the data is coming from a database, you could use the order by command to sort...

You could build the header and trailer separately from the detail rows. Then append the files together.

You can write a file as delimited or fixed width with...

Thanks for the update. It looks very clear and easy to understand.

Kay

You could use a derived column task and have one new field for each edit. A script component could be used to write out rows to the error file...

Set up a variable to hold the latest file so far. In your script task inside the for each loop container, compare the current file to the file in...

Try converting your dates to MM/DD/CCYY.

One approach is to use a script task. This is the most straightforward approach but requires knowing the script task language.

Another possibility is to use a data flow task....

On the Collection tab of the Foreach Loop Editor and on the right side, not the left, expand Expressions (Expressions occurs twice on the screen). Look for CollectionEnumerator. ...

If you are certain SourceTable does not have duplicate keys (Fname and phone), you can do the following:

In the data flow task, add a flat file source for SourceTable and...

I assume a row coming in is a duplicate if it matches on Fname, Lname, phone, and address.

How do you determine that an incoming row should cause an update to...

Happy to help!

Set FileCount to the value in varFileCount. Then add one to it. Your present approach keeps adding 1 to zero.

What about using an execute sql task that contains the insert code, since the view and table are on the same server?

The command would be of the form

insert into...