I may do a write up on this as it seems to generate several good remarks and approaches!

I think there are 2 real ways to address this:

1....

Appreciate the replies. I'll have to keep these in mind when we get to design a new system in place (hopefully I won't need to if I can convince them...

This is definitely possible and the table I do load it in to is a "staging" table of sorts (with interface status columns, date loaded, filename loaded, etc).

The issue with...