Yes You are correct the values are from functions , but those are just hardcoded / default values due to business constraint i am unable to post entire code here...

• This reply was modified 3 years, 10 months ago by  yuvipoy.

Thanks Phil. As suggested by you i could see buffer setting has already changed 50% more from default, fast load option is already enabled, table lock to destination table is...

Any suggestions on the above, still the issues persists. the time consumed here is more. Below is the reads and writes and time taken for the query to complete.

Run time...

Once again thanks for your time.

Yes you are correct on the observation on

"how ever having the cte as is may even be giving you duplicate records if there are multiple...

CTETableB is needed as we are having the not null condition [OR c.[ColumnID] IS NOT NULL OR d.[ColumnID] IS NOT NULL] in the query.

TableA [ColumnID] is clustered index and Date...

First I would thanks for spending time my problem and valuable suggestion.

There are around ~10K partitions in the table with average of 15MB size and highest begin 97 MB with...

Yes. Based on the SSISDB monitor (the link below)only i got operation_message table.

https://docs.microsoft.com/en-us/sql/integration-services/view-reports-for-the-integration-services-server?view=sql-server-2014 

I was still wondering how and what base i am getting those errors. There were no issue...

Have used SSISDB as suggested.

Select * from [SSISDB].catalog.operation_messages where message_type in (130,120)

Message_type is seen below.

https://docs.microsoft.com/en-us/sql/integration-services/system-views/catalog-operation-messages-ssisdb-database?view=sql-server-ver15

message_type message_source_type message

130 40 Script Task Name:The task, 'Script Task Name', failed.

120 40 Script Task...

Nope .

While seeing the operation log found that it is getting failed on "OnPostExecute"step.

We have 3 retry option for that package. Interval between retries are 10 mins.

On 3rd retry sometimes...

Below are the following steps involved in the task execution

OnPreExecute

OnPreValidate

OnPostValidate

OnPostExecute

Got error on "OnPostExecute" step ,

Currently it is in production for years now, for past 6 months we are getting the...

Thanks , but how about 2 data sources in data flow task , used one data source as ADO.net for Azure SQL database stage table, which data component to use...

Once again thanks for time & suggestion!

So in this case , we need to create 2 data flow task to achieve? One to insert data in stage table , on...

Thanks !

How about using the stored proc and merging the output ? Merge the output from SP and stage table, how can we achieve this ?

Thanks Steve ,

Here is the code i have tried. Knew that it can be done in better way.

create table #CalendarSales (salesamount decimal(20,4),Calendaryear int,Employee int)
create table #CalendarSales_final (salesamount...

Thanks !

Tried creating left join , but did not work as expected.

Second tried with tally table with running number in it and found the missing record, but it did not...