September 8, 2008 at 8:31 am
I have a SSIS job that is taking forever to finsih. It imports data from an oracle database and one of the table has about 21 million records. which I need to import every nite.
I have similar package in dts on a sql 2000 and it imports the data within 2 hours.
before a memory upgrade on sql 2005 using ssis I was able to import the data within two hours . however after a memory upgrade from 8 GB to 48GB on the box its taking forever. so far i am ending up killing it after 6 hours.
any idea whats going on here?
thanks
September 8, 2008 at 8:46 am
Could you post the steps you are using to import the data?
Are there any other processes accessing the table that the data is being imported into?
Jack Corbett
Consultant - Straight Path Solutions
Check out these links on how to get faster and more accurate answers:
Forum Etiquette: How to post data/code on a forum to get the best help
Need an Answer? Actually, No ... You Need a Question
September 8, 2008 at 9:16 am
its a stand alone table. i am using a data flow task.. which is pretty basic in design. it has a ole db source and ole db destination. nothing out of ordinary use.
September 8, 2008 at 9:39 am
What are the properties of the oledb destination?
Jack Corbett
Consultant - Straight Path Solutions
Check out these links on how to get faster and more accurate answers:
Forum Etiquette: How to post data/code on a forum to get the best help
Need an Answer? Actually, No ... You Need a Question
September 8, 2008 at 10:10 am
attached is a screenshot..
September 8, 2008 at 10:43 am
I meant what you get when you open the OLEDB Destination for edit, but this actually gave me what I was interested in, since you are outputting errors to a flat file. Are anticipating that there will always be insert errors? If not, you may want to change the destination to Table or View Fast load will the table lock hint.
Which step is taking the longest time, retrieving the data from Oracle or inserting into SQL Server?
Jack Corbett
Consultant - Straight Path Solutions
Check out these links on how to get faster and more accurate answers:
Forum Etiquette: How to post data/code on a forum to get the best help
Need an Answer? Actually, No ... You Need a Question
September 8, 2008 at 11:55 am
how do i find out whats taking long, read from oracle or insert into sql? and yes i am writing bad records to a flat file.
September 8, 2008 at 12:12 pm
when the memory was upgraded was the server platform upgraded as well from 32 bit to 64 bit?
September 8, 2008 at 1:56 pm
it was 64bit to begin with.
September 8, 2008 at 3:12 pm
Shahab , Just a Thought............
Why don't use a export and import wizards to do it and also save it as a dtsx package and see how it works. Later once you know it works then configure ur error output into flat file.
I don't belive it should take mopre than couple of hours if u r just loading without any transformations.
Thanks
Viewing 10 posts - 1 through 9 (of 9 total)
You must be logged in to reply to this topic. Login to reply