SSIS: use 2 different connections managers in one datasource

Question

Post reply

SSIS: use 2 different connections managers in one datasource

Vera-428803

SSCrazy

Points: 2439
More actions
July 9, 2013 at 3:11 am

#275881

Hi,
I'm using SSIS to fill a datawarehouse. Until now I used to truncate the tables and refill them every night. Since this job is taking too long, I don't want to empty the tables anymore but only add new records. To do that, I have a column in a table that contains the LastUsedNumber. This is not a primary key column.
Now that I have the lastusednumber I need to select the new records.
The script will look like this:
SELECT * from table1
WHERE recordnumber > LastUsedNumber
Nothing strange until now.
The problem that I have is that the data source of the select is a table of an AS400 system (DB2) and that the data source of the LastUsedNumber is SQL Server .
Since I want to write a SQL Command as data access mode, how can I use 2 different connection sources in one SSIS Data Flow Source because I can define only one connection manager in the source.
I would appreciate it if someone has a solution for me or an way to get around this.
Many thanks.
Vera Van Boxel

Viewing 6 posts - 1 through 5 (of 5 total)

You must be logged in to reply to this topic. Login to reply

larskandersen Ten Centuries Points: 1232 More actions · Answer 1

Workaround:

Fetch the LastUsedNumber in your control flow, store it in a variable, and either:

A) pass it into your data flow source as a parameter

B) Create the SQL statement as an expression with a second variable

Koen Verbeeck SSC Guru Points: 259105 More actions · Answer 2

A little more detail.

1. Use an Execute SQL Task to retrieve the LastUsedNumber and store the result in a variable (let's call it @LastUsedNumber :). See this article on how to do that: Execute SQL Task.

2. Create a string variable called @SQLStatement. Put the EvaluateAsExpression property to true and enter the following expression for the value property:

"SELECT * from table1 WHERE recordnumber > " + (DT_STR,10,1252) @[User::LastUsedNumber]

3. In your OLE DB Source, choose the SQL command from variable option and pick the @SQLStatement variable.

Need an answer? No, you need a question
My blog at https://sqlkover.com.
MCSE Business Intelligence - Microsoft Data Platform MVP

Vera-428803 SSCrazy Points: 2439 More actions · Answer 3

Thanks, I'll give it a try and will keep you uptodate on how it goes.

Vera-428803 SSCrazy Points: 2439 More actions · Answer 4

The problem is that I cannot use an OLE DB Source, it's a connection to DB2 on AS400 system, I need to use ADO.NET source and there is no option to use SQL statement with variables.

Vera-428803 SSCrazy Points: 2439 More actions · Answer 5

I used a workaround with a linked server and stored procedure.

Thank you for taking time to watch into this.