March 7, 2014 at 3:22 am
Hi,
Currently, I am using CSV file as input. A data flow task will read this file and fill a table for me.
But generating CSV file is very time consuming activity.
In SSIS, is there any way where I just specify the total rows I want and then some derived column for each iteration and then will able to fill the table out of it.
Please let me know if such solution is feasible.
Thanks in advance
Dheeraj Marwaha
March 7, 2014 at 4:14 am
Yes you can do but i would suggest to test these options before you think for other
1.Pushing data into an indexed table will take much more time than pushing the data into an empty table
and then rebuilding indexes afterwards so
•Drop all indexes on destination table
•Push data (perform ETL operations)
•Create all indexes on destination table
2.Enable Bulk Operations on the SSIS Login :-
This recommendation has to be in synergy with utilizing the fast load data access mode in the Destination component of the SSIS’s Data Flow, which allows SSIS to utilize the BULK INSERT statement.
You can use Table lock if you have other transaction whic are using same table
March 7, 2014 at 4:18 am
March 7, 2014 at 4:53 am
Actually, I want a dynamic input generator in SSIS package instead of reading from CSV file.
I need any control for which, I feed necessary inputs and it generate recordset.
March 11, 2014 at 4:17 am
Please define what you mean by 'dynamic input generator'.
The absence of evidence is not evidence of absence
- Martin Rees
The absence of consumable DDL, sample data and desired results is, however, evidence of the absence of my response
- Phil Parkin
March 13, 2014 at 7:40 am
It sounds like you need Redgate's SQL Data Generator.
Viewing 6 posts - 1 through 5 (of 5 total)
You must be logged in to reply to this topic. Login to reply