group records by week

Question

group records by week

Jeff Moden

SSC Guru

Points: 1004340
More actions
February 11, 2022 at 3:26 am
Answer
#3981792

If you use a compressed backup of a single table database, you wouldn't have to worry about zipping anything and you wouldn't have to worry about doing it in "off hours". The same holds true with BCP because of it's incredible speed especially in the native format and especially compared to CSV.
It's your code, your machines, and your network but, using CSV is just the wrong way to do this, IMHO.
--Jeff Moden
RBAR is pronounced "ree-bar" and is a "Modenism" for Row-By-Agonizing-Row.
First step towards the paradigm shift of writing Set Based code:
________Stop thinking about what you want to do to a ROW... think, instead, of what you want to do to a COLUMN.
Change is inevitable... Change for the better is not.
Helpful Links:
How to post code problems
How to Post Performance Problems
Create a Tally Function (fnTally)

Viewing 5 posts - 61 through 64 (of 64 total)

You must be logged in to reply to this topic. Login to reply

Jeff Moden SSC Guru Points: 1004340 More actions · Answer 1

p.s. And, the files will be smaller because INTs will actually only take 4 bytes and dates will only take a maximum of 8 and could be as little as 3 bytes each. That also means smaller files to transmit and smaller is also faster and BCP is so fast that it'll yawn at just 100,000 rows even if it had to do 20 such files in rapid succession.

And, yeah... you can call it with PowerShell but... really?

--Jeff Moden

RBAR is pronounced "ree-bar" and is a "Modenism" for Row-By-Agonizing-Row.
First step towards the paradigm shift of writing Set Based code:
________Stop thinking about what you want to do to a ROW... think, instead, of what you want to do to a COLUMN.

Change is inevitable... Change for the better is not.

Helpful Links:
How to post code problems
How to Post Performance Problems
Create a Tally Function (fnTally)

Jeff Moden SSC Guru Points: 1004340 More actions · Answer 2

Another way of doing it is to create a small special purpose, single table database that you write the "export' data to as a real table. Then do a compressed backup, send it to the other side or give them access to it, and let them restore the small database in seconds. Then they can do an INSERT INTO from that small database and, when done, simply drop the database.

--Jeff Moden

RBAR is pronounced "ree-bar" and is a "Modenism" for Row-By-Agonizing-Row.
First step towards the paradigm shift of writing Set Based code:
________Stop thinking about what you want to do to a ROW... think, instead, of what you want to do to a COLUMN.

Change is inevitable... Change for the better is not.

Helpful Links:
How to post code problems
How to Post Performance Problems
Create a Tally Function (fnTally)

Bruin SSCrazy Points: 2058 More actions · Answer 3

my reply must have go t lost...

The Data will increase and don't have to tie up any Network Traffic, so the route of csv would be I could zip the 3 files and move them across Network, and apply at Destination in off hours.. Using P/S(script) would be easier maintain since it would be outside SQL Mgmt

and visible by possible log file to show process.

Thanks again...

Bruin SSCrazy Points: 2058 More actions · Answer 4

I choose the single table solution.

Many thanks for replies and suggestions.