I believe these will help.

http://www.bimonkey.com/2009/08/the-derived-column-transformation/

http://sqlyoga.com/2010/01/sql-server-ssis-derived-column-data.html

Does the data exist somewhere else or can it be imported? If so you could build an insert based on this data source.

INSERT INTO IndustryAss

SELECT

CompanyId,

IndustryID

FROM Some_Other_Table_...

The SELECT statement by...

Other options:

-encrypt the file(s) and transfer via ftp

-transfer the files via secure ftp

In any scenario you probably want to look at compressing the file(s) unless you have a small amount...

It looks like a single employee can have multiple records.

1 virginia usa

1 texas usa

1 new york usa

Can an employee have more than one record in the same state?

If you can...

Can you join and compare?

SELECT

emp#

FROM Production P

INNER JOIN Staging S

ON P.emp# = S.emp#

WHERE P.Address <> S.Address OR P.country<> S.country

Once you have the identified the changed employess you...

Thanks Dan. The relevant piece of information provided here is that I will not be able create a SSIS package in VS 2008 and then publish this to my my...

You would use an update statement to set the fields to NULL

UPDATE YourTABLE

SET YourField = NULL

WHERE YourField = 'unassigned'

Don't forget your WHERE statement!

Then you can use COALESCE to return 'unassigned'...

My preferred method for this is to allow the users to insert a request record in a table.

Then I run a job continuously, say every five minutes. The job looks...

This is powerful stuff. I still haven't fully committed to going down this rabbit hole.

I like the idea about splitting the numeric and character values.

The attribute 2 or subdatatype as...

Actually the SessionID would probably just be useful for tracking the insertion time of the data so I might have driven off the track a bit there.

My model is largely...

http://www.sqlservercentral.com/articles/Database+Design/62386/

Here the article I have been looking for.

>>If you can avoid this I would. There are times things like this are necessary, but you would

typically prefer to avoid them.

How would I avoid them? Could I have...

Yes I did mix up my descriptions as you noticed. Your terms make a lot more sense.

You concerns are definitely valid. How much data? A thousand rows of current...

You could try to import each file into a one column staging table. Then write a select against the table to exclude rows, you will probably need to use LIKE....

Are you replacing a process that is based on paper forms? If so, collect examples of all the existing forms.