March 11, 2010 at 12:32 pm
Ok so I figured out how to modify the Advanced SQL on my last question, thanks to anyone who replied. But I have a larger issue....
We currently receive over 100 flat files from varying companies, all in the same format. I have created one Connection Manager with the format of the files, and anticipated being able to switch to the other files and the processing would take place without a hitch. However, I've noticed two things I do not understand after I switch to another of the flat files by editing the connection manager:
1. The number of records exported from the flat file to my Derived Column field is a lot less than what it has. About 29,000 records aren't being passed out. How do I find out why?
2. The other data is then passed to a lookup functionality where I pull in values based on criteria. This works with the original file, but after I manually switch to the next flat file it doesn't find any matchs (and yes there are matches)
I've added watches in between each process and the data appears to be flowing properly. Any help would be greatly appreciated!
March 12, 2010 at 12:59 pm
I ran into a similiar problem once and while all the data to the eye appeared to me exactly the same I discovred through much hair pulling and then dumb luck that there was actually a space in front of each field. The two source files were in fact one character apart. This may not apply at all in this case but it is I know somehting that is easily missed.
Dan
If only I could snap my figures and have all the correct indexes apear and the buffer clean and.... Start day dream here.
Viewing 2 posts - 1 through 1 (of 1 total)
You must be logged in to reply to this topic. Login to reply