May 14, 2011 at 7:52 pm
I have to load monthly data in sql. Data comes from flatfile and loading in staging sql table through SSIS.there are 16 tables. I don;t know relation with each table.
the main purpose of these tables to create reports and
there is no relation ship in staging table.
need right direction.....
Now I want to load data from staging to Production ....so
1.I need to created relation with each table?? like primay key and foreign key then load the data ???
need right direction.....
2.Data comes every month so it will be duplicate so ...how can i load duplicate record ??.,,,,,I want duplicate data......so like any solution to create composite primary key is the right solution.?????liek create another column and year and make as a composite primary key .,,????
May 15, 2011 at 3:42 am
If you don't know the relationship of the data, ask the person providing it or ask someone in your organization to explain the business case you're dealing with. It might be possible to find the relationship based on the data (it would help a lot if the data model is normalized) but based on what we know so far it's guessing. It might not even be required to add a primary/foreign key relationship to the staging tables. Indexing is a different story though...
You're talking about 16 tables to load but just one staging table. Please explain more detailed.
The fact the data need to be loaded every month does not imply there will be duplicates. Please explain more detailed.
Don't take me wrong but it sounds like you would benefit much more from a few days of consulting than from an answer you might get on a web forum.
May 15, 2011 at 7:39 am
Thanks for replying me,
Yes,,,I have created One staging database. In This staging database, I have all 16 tables.
The thing is that ,,,,,,,i know normalization is helpful but,,,,in my case,,,,we do not want normalization...
I have loaded only one month data in staging.....now i want to load the data in production,,,but before that ,,,,you said ,,,, I have to create relation with all tables.. ..Ok I will contact business person for that.
once one month data will load in production...then load second month data.......but data will duplicate ... And I want duplicate data.....I don't want remove duplicate data because of reporting is req.......Please let me know....How to do that ....
Thanks
May 15, 2011 at 7:51 am
Like I said before: I recommend to get a consultant in for a day or two. It'll be much more efficient than using a forum. Based on the information currently available it's almost impossible to help you any further.
As a side note: you might want to ask for a new keyboard (comma and period keys seem to hang occasionally) ;-);-)
May 16, 2011 at 2:27 am
i will send lutzm. i also feel that you are incomplete with requirement.
First gather the requirement regarding relationships or duplicacy of data.
second before pushing any thing on production first do the testing on testing server (staging) you might get performance related issues there.
-------Bhuvnesh----------
I work only to learn Sql Server...though my company pays me for getting their stuff done;-)
May 17, 2011 at 11:45 am
LutzM (5/15/2011)
Like I said before: I recommend to get a consultant in for a day or two. It'll be much more efficient than using a forum. Based on the information currently available it's almost impossible to help you any further.
+1 to that. Lots of different ways to go here depending on lots of different parameters.
Best,
Kevin G. Boles
SQL Server Consultant
SQL MVP 2007-2012
TheSQLGuru on googles mail service
Viewing 6 posts - 1 through 5 (of 5 total)
You must be logged in to reply to this topic. Login to reply