Hi,

Thanks for the answer. The issue I have is that the data is not processed in order when it reaches the conditional split. If my data comes in the order...

Very interesting. I remember the "table insertion" trick pointing to a view but the other tricks you describe here are interesting.

Thanks,

Greg

Now, that is a brilliant idea!

I think with minimal changes to your long posts and maybe with a couple of "technical" details (as much as is possible given the...

Hi John,

Thanks for the info. Yes, your comment does point out my fear so I'm pretty sure that while I might experiment with it, it won't make it into the...

Hello John,

Again thanks for the long reply. I have read your post in and out a few times. Here are my impressions.

I think your point regarding the message reading/staging is...

Hi,

I'm going to take a bit of time to read your post but I definitely want to thank you for taking the time and effort to describe the process you...

Hello,

I had actually spent a bit of time this morning replacing the ForEach with a custom For Loop that uses an Array built from my recordset and, as you say,...

Hello,

No worries, I appreciate your time. Looking forward to your comments on this one. The process I described is pretty much "per the book" but the actual implementation is not,...

I appreciate the time you are taking, it really helps because it makes me look at things from a higher perspective too 🙂

In the application, the ODS as Kimball would...

Hello,

Thanks for the reply. Well, there is not much more to it than what I have described. Originally, we were having a java MDB perform this operation using a JaxB/EJB...

Hello,

No I have not. the main reason behind this is that I wanted to use this to understand really how packages work, data flows etc. I understand the SCD transform...

Hello and sorry for the late reply. We ended up finding out what that the problem was related to an environment variable that was registered under the user section. When...

Hi there,

I ended up not waiting and doing a test for that large table by dropping the clustered index first and then re-creating it. My log "only" grew to about...

Mmh... Coming to think of it, it's a bit more complicated than just disabling my clustered indexes like I already do for the nonclustered ones... If I disable it I...

Hi,

I've read the link topic you are referring to. Here's what I got:

- Replication: Not used in that case

- 1 batch per table: yes (there's an explicit GO between each...