I have partially answered my own question. If I check by
If
source.Inventory_Item_Id = destination.Inventory_Item_Id
AND
source.Creation_Date = destination.Creation_Date
AND
source.Last_Updated_Date <> destination.Last_Updated_Date
That won't take into account deleted records. So I guess I'll have to do a script task that gets a source rowcount and a destination rowcount and compares the two. Am I on the right path?