huishi.ca (3/19/2012)

---

awesome article , however, I have a different scenario. What about the source and target tables are really large?

close to 1 billion records? I am not sure if...

I will do a little more testing on it during this long holiday weekend and see what I might be able to come up with.

One thing you could try is...

I've noticed that sometimes in certain character fields this can be a problem. The best solution I've found, and what I'm currently using in my environment is the SSIS...

pravasis (7/14/2010)

---

Its really a nice artice, but I think can fail in the following scenario.

1)There are more than two columns

2)Atleast two records are there.

3)Alternately each column has null values...

Nadrek (6/14/2010)

---

Brett Flippin (6/10/2010)

...

Also with a traditional truncate/load ETL process you lose the ability of the ETL process to fail gracefully and still retain your data in the destination. ...

da-zero (6/10/2010)

---

The Truncate/insert method will only work if your source data also keeps history. If not, you're stuck with incremental load.

Furthermore, at the beginning truncate/insert will surely work faster than...

aruzhans (6/9/2010)

---

Excellent article! Ready to use to mentor development team!

Great elegant use of Conditional Split in Incremental loads

Have you compared the performance of this method with more traditional checksum method....

Todd McDermid (6/8/2010)

---

Great article, Brett. I have a half completed one in my pipe similar to this - but directed solely at how to use a hash to speed...

UMG Developer (6/8/2010)

---

Great article thanks! I can see where it might be able to speed things up, but only if you are constrained on your writes. In my current ETL...

Great discussion so far. I wanted to chime back in and say that I agree with the recommendations for using SHA-1, but by using the ID plus the Hash to...

That was the one thing I knew I was missing going forward with this article. Unfortunately...

Adam Aspin (6/8/2010)

---

Really interesting and well-written article, thank you.

As a matter of interest, is it any faster (or in any other way better or worse) to create the hash value...

da-zero (6/8/2010)

---

Nice article. Although I would have used a temp/staging table to store my updates, instead of using the OLE DB Command. That way you can use a set based...

rcooke (6/7/2010)

---

i like the hash approach - to save time you could just use the konesans checksum algorithm add in to calculate the crc value. Combined with the conditional split...

You need to get read up on the theory behind data warehousing first before tackling SSAS.

I recommend Kimball's Data Warehouse Toolkit Classics, then if you want to follow it up...