Considerations for bulk-loading BLOBs?

  • We're doing a bulk load of data from an older system to a brand new system, and the old system contains several BLOBs (about 90kb-200kb) for each parent record (around 20 million). Someone had mentioned that doing this all at once could make SQL Server react in a weird/unexpected way, mainly as how it pertains to paging allocations. My google-fu is apparently not that good, as I couldn't find a whole lot about this, but in thinking of the issue, I did start to wonder if it might be something to at least confirm we have a bulletproof approach for.

    The database in question will be living on a managed EMC VNX unit, so if it were a question of fragmentation, random reads, etc., I'm not all that concerned.

    Thanks in advance.

  • Since you're moving to a new system, this would be a good time to doublecheck that you've got some best practices involved in self defense.

    In particular, for the concern you raised, make sure that the BLOB data has its own filegroup and your tables are setup to send the BLOB data there. The headaches that reduces is phenomenal, at least it has been for me.

    Past that, what are you using to do the transfer?


    - Craig Farrell

    Never stop learning, even if it hurts. Ego bruises are practically mandatory as you learn unless you've never risked enough to make a mistake.

    For better assistance in answering your questions[/url] | Forum Netiquette
    For index/tuning help, follow these directions.[/url] |Tally Tables[/url]

    Twitter: @AnyWayDBA

  • Yeah, putting them in their own filegroup was part of the plan. We don't really have anything fleshed out as far as the details of the transfer yet, as it's still over a year off.

  • Then I wouldn't worry too much about it until you get down to brass tacks. In general, though, I would recommend an incremental load just to reduce log usage and the like. There's no particular issues with the data transfer that you wouldn't already be dealing with in the original system.


    - Craig Farrell

    Never stop learning, even if it hurts. Ego bruises are practically mandatory as you learn unless you've never risked enough to make a mistake.

    For better assistance in answering your questions[/url] | Forum Netiquette
    For index/tuning help, follow these directions.[/url] |Tally Tables[/url]

    Twitter: @AnyWayDBA

  • Thanks. Much appreciated.

Viewing 5 posts - 1 through 4 (of 4 total)

You must be logged in to reply to this topic. Login to reply