February 13, 2009 at 6:23 am
Hi,
We run parallel feeds (this process includes data extraction from huge data files, putting them in staging table and then after applying the business rules the records goes to final destination tables - the staging and destination tables resides in the same DB under different schemas) every day. We use SSIS and SPs to do this.
I wanted to speed up the execution of a particular SSIS package, and so modified the default packet size from 4 kB to 32 kB (the maximum limit). I noticed significant decrease in execution time...the feed which was taking 15 minutes took 9 minutes after I changed the parameter.
What is the impact of keeping a high value of Packet Size on a OLEDB connection manager? I just want to know that if it runs parallel to some 3-4 heavy duty feeds, would there be any palpable consequences. FYI the hosting hardware has more than 16 GBs of RAM.
Also, if I modify the packet size of ADO.NET Connection Manager (we always use OLEDB, ADO.NET or both in our packages) to some higher value, in addition to an enhanced packet size of OLEDB Connection Manager, will it disrupt the smooth running of other feeds?
Thanks,
Sayan
July 4, 2013 at 12:45 am
I think the communication is under local network in your case, if the communication is in WAN then the scenario is different,
I am in the same situation but my networks is using WAN so the sync has communication error some times... I am looking forward to change the SSIS Connection's default 0 to 4096 that should improve initially, as SQL Server's default is 4096.
If you are changing them both the performance will improve further, as in network communication packet switching takes more time if the size is different of packets.. so make sure at each point the packets are of same size, the communication will be smooth and failure will be lesser,
As network buffers will be free, and sending packets without modifying its packets size, just the destination will be changed to forward it...
I hope this will clear a part..
Viewing 2 posts - 1 through 1 (of 1 total)
You must be logged in to reply to this topic. Login to reply