add 200 million new products

Question

add 200 million new products

gchappell

SSC Eights!

Points: 845
More actions
January 8, 2013 at 7:27 am

#268477

my company wishes to add 200 million new products in the next 10 days. Does sql server 2012 have any limits as to how much data can be added at a time to a databae? If so any ideas how we can accomplish this task

Viewing 7 posts - 1 through 6 (of 6 total)

You must be logged in to reply to this topic. Login to reply

Sean Lange SSC Guru Points: 286590 More actions · Answer 1

gchappell (1/8/2013)
my company wishes to add 200 million new products in the next 10 days. Does sql server 2012 have any limits as to how much data can be added at a time to a databae? If so any ideas how we can accomplish this task

There is no limit but 200 million rows is not going to get added quickly. With that much data you should do this in batches and use BULK INSERT http://msdn.microsoft.com/en-us/library/ms188365.aspx

_______________________________________________________________

Need help? Help us help you.

Read the article at http://www.sqlservercentral.com/articles/Best+Practices/61537/ for best practices on asking questions.

Need to split a string? Try Jeff Modens splitter http://www.sqlservercentral.com/articles/Tally+Table/72993/.

Cross Tabs and Pivots, Part 1 – Converting Rows to Columns - http://www.sqlservercentral.com/articles/T-SQL/63681/
Cross Tabs and Pivots, Part 2 - Dynamic Cross Tabs - http://www.sqlservercentral.com/articles/Crosstab/65048/
Understanding and Using APPLY (Part 1) - http://www.sqlservercentral.com/articles/APPLY/69953/
Understanding and Using APPLY (Part 2) - http://www.sqlservercentral.com/articles/APPLY/69954/

gchappell SSC Eights! Points: 845 More actions · Answer 2

gchappell

SSC Eights!

Points: 845

January 8, 2013 at 8:08 am

#1574842

Thanks Sean I will relay the message

GSquared SSC Guru Points: 260824 More actions · Answer 3

SQL 2012 doesn't have any limits on that, but your hardware certainly will. CPUs, RAM, I/O busses, etc., can only push so many bytes per second.

Most likely, I/O will be the main bottleneck on that kind of thing. It's usually the slowest piece of the server.

- Gus "GSquared", RSVP, OODA, MAP, NMVP, FAQ, SAT, SQL, DNA, RNA, UOI, IOU, AM, PM, AD, BC, BCE, USA, UN, CF, ROFL, LOL, ETC
Property of The Thread

"Nobody knows the age of the human race, but everyone agrees it's old enough to know better." - Anon

gchappell SSC Eights! Points: 845 More actions · Answer 4

gchappell

SSC Eights!

Points: 845

January 8, 2013 at 9:30 am

#1574900

Thanks GSquared

Grant Fritchey SSC Guru Points: 398882 More actions · Answer 5

You'll need to monitor the size of your logs and possible the tempdb. Make sure you have enough disk space for all the additional information.

"The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood"
- Theodore Roosevelt

Author of:
SQL Server Execution Plans
SQL Server Query Performance Tuning

ChrisM@Work SSC Guru Points: 186127 More actions · Answer 6

gchappell (1/8/2013)
my company wishes to add 200 million new products in the next 10 days. Does sql server 2012 have any limits as to how much data can be added at a time to a databae? If so any ideas how we can accomplish this task

Just out of curiosity, what are these products? Mobile phone tarriffs? :hehe:

^{“Write the query the simplest way. If through testing it becomes clear that the performance is inadequate, consider alternative query forms.” - Gail Shaw}

For fast, accurate and documented assistance in answering your questions, please read this article.
Understanding and using APPLY, (I) and (II) Paul White
Hidden RBAR: Triangular Joins / The "Numbers" or "Tally" Table: What it is and how it replaces a loop Jeff Moden