SAP Core DB Backups taking twice as long out of the blue

  • Sunday night, our core SAP instance database backup took almost 8 hours to run, normally it runs in under four hours. Last night it ran about 15 minutes longer. How do I begin troubleshooting this? Nothing changed on this server, anywhere, or on the SAN that it is connected to.

  • Well, there's not enough information here to give anything but generic troubleshooting advice, but I'd start by:

    1) Throwing out the idea that nothing's changed, it has.

    2) Check the following areas (not exhaustive):

    Has the database size increased? Check the backup sizes from the msdb backup history tables over a few weeks to see if there's been a significant increase

    Have the backup options changed?

    Location of backups, compression options etc. - all available from the backup history tables

    Is it backing up locally, or to a network location?

    If locally, you'll need some historic monitoring of I/O and server activity during the backup. Also SAN level monitoring to see if your SAN was under pressure from other activity external to that server.

    If network, then you need historic stats from the network layer or to set some up for the next backup, plus doing the same I/O monitoring for the server/SAN hosting the network location as for the local SQL Server.

    If you have SQL 2008 (Enterprise Edition only) or SQL 2008 R2+ (Standard or higher), if you're not already using backup compression, I find it can massively reduce backup time (obviously at the expense of some CPU)

  • Has the database size increased? Check the backup sizes from the msdb backup history tables over a few weeks to see if there's been a significant increase

    --> No dramatic increase. We grow 150 gigs a month but this would be a gradual increase, not an overnight increase in duration...

    Have the backup options changed?

    Location of backups, compression options etc. - all available from the backup history tables

    --> Nothing changed there.

    Is it backing up locally, or to a network location?

    --> SAN. Nothing has changed on there, unless we have a ton of drives going bad.

    If locally, you'll need some historic monitoring of I/O and server activity during the backup. Also SAN level monitoring to see if your SAN was under pressure from other activity external to that server.

    --> Will look into perfmon. I assume a SAN healthcheck is in order?

    If network, then you need historic stats from the network layer or to set some up for the next backup, plus doing the same I/O monitoring for the server/SAN hosting the network location as for the local SQL Server.

    --> Maybe the fiber channel connectivity to the SAN is worth looking into?

    If you have SQL 2008 (Enterprise Edition only) or SQL 2008 R2+ (Standard or higher), if you're not already using backup compression, I find it can massively reduce backup time (obviously at the expense of some CPU)

    --> Compression is set default on the server and has not changed.

  • San health check sounds sensible.

    Mind posting the results of the below query? (run against the SAP database)

    SELECT

    s.database_name,

    m.physical_device_name,

    CAST(CAST(s.backup_size / 1024.0/1024.0/1024.0 AS INT) AS VARCHAR(14)) + ' ' + 'GB' AS Backup_Size,

    CAST(CAST(s.compressed_backup_size / 1024.0/1024.0/1024.0 AS INT) AS VARCHAR(14)) + ' ' + 'GB' AS Compressed_Backup_Size,

    CAST(s.backup_size/ 1024.0/1024.0/DATEDIFF(SECOND,s.backup_start_date,s.backup_finish_date) AS INT) AS [Uncompressed_Throughput_MB/s],

    CAST(s.compressed_backup_size/ 1024.0/1024.0/DATEDIFF(SECOND,s.backup_start_date,s.backup_finish_date) AS INT) AS [Compressed_Throughput_MB/s],

    DATEDIFF(minute, s.backup_start_date,s.backup_finish_date) Elapsed_Backup_Time_Minutes,

    s.backup_start_date,

    s.recovery_model

    FROM msdb.dbo.backupset s

    INNER JOIN msdb.dbo.backupmediafamily m ON s.media_set_id = m.media_set_id

    WHERE s.database_name = DB_NAME()

    AND s.type='D'

    ORDER BY backup_start_date DESC, backup_finish_date

  • Results:

    database_namephysical_device_nameBackup_SizeCompressed_Backup_SizeUncompressed_Throughput_MB/sCompressed_Throughput_MB/sElapsed_Backup_Time_Minutesbackup_start_daterecovery_model

    PRDU:\PRD_Backup\PRD1.bak4421 GB781 GB187334022012-09-10 18:20:13.000FULL

    PRDU:\PRD_Backup\PRD2.bak4421 GB781 GB187334022012-09-10 18:20:13.000FULL

    PRDU:\PRD_Backup\PRD3.bak4421 GB781 GB187334022012-09-10 18:20:13.000FULL

    PRDU:\PRD_Backup\PRD4.bak4421 GB781 GB187334022012-09-10 18:20:13.000FULL

    PRDU:\PRD_Backup\PRD5.bak4421 GB781 GB187334022012-09-10 18:20:13.000FULL

    PRDU:\PRD_Backup\PRD6.bak4421 GB781 GB187334022012-09-10 18:20:13.000FULL

    PRDU:\PRD_Backup\PRD1.bak4411 GB777 GB189333972012-09-09 18:20:10.000FULL

    PRDU:\PRD_Backup\PRD2.bak4411 GB777 GB189333972012-09-09 18:20:10.000FULL

    PRDU:\PRD_Backup\PRD3.bak4411 GB777 GB189333972012-09-09 18:20:10.000FULL

    PRDU:\PRD_Backup\PRD4.bak4411 GB777 GB189333972012-09-09 18:20:10.000FULL

    PRDU:\PRD_Backup\PRD5.bak4411 GB777 GB189333972012-09-09 18:20:10.000FULL

    PRDU:\PRD_Backup\PRD6.bak4411 GB777 GB189333972012-09-09 18:20:10.000FULL

    PRDU:\PRD_Backup\PRD1.bak4411 GB777 GB484851562012-09-08 23:21:38.000FULL

    PRDU:\PRD_Backup\PRD2.bak4411 GB777 GB484851562012-09-08 23:21:38.000FULL

    PRDU:\PRD_Backup\PRD3.bak4411 GB777 GB484851562012-09-08 23:21:38.000FULL

    PRDU:\PRD_Backup\PRD4.bak4411 GB777 GB484851562012-09-08 23:21:38.000FULL

    PRDU:\PRD_Backup\PRD5.bak4411 GB777 GB484851562012-09-08 23:21:38.000FULL

    PRDU:\PRD_Backup\PRD6.bak4411 GB777 GB484851562012-09-08 23:21:38.000FULL

    PRDU:\PRD_Backup\PRD1.bak4406 GB777 GB370652032012-09-07 18:20:15.000FULL

    PRDU:\PRD_Backup\PRD2.bak4406 GB777 GB370652032012-09-07 18:20:15.000FULL

    PRDU:\PRD_Backup\PRD3.bak4406 GB777 GB370652032012-09-07 18:20:15.000FULL

    PRDU:\PRD_Backup\PRD4.bak4406 GB777 GB370652032012-09-07 18:20:15.000FULL

    PRDU:\PRD_Backup\PRD5.bak4406 GB777 GB370652032012-09-07 18:20:15.000FULL

    PRDU:\PRD_Backup\PRD6.bak4406 GB777 GB370652032012-09-07 18:20:15.000FULL

    PRDU:\PRD_Backup\PRD1.bak4402 GB777 GB442781702012-09-06 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD2.bak4402 GB777 GB442781702012-09-06 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD3.bak4402 GB777 GB442781702012-09-06 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD4.bak4402 GB777 GB442781702012-09-06 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD5.bak4402 GB777 GB442781702012-09-06 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD6.bak4402 GB777 GB442781702012-09-06 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD1.bak4396 GB776 GB366642052012-09-05 18:20:27.000FULL

    PRDU:\PRD_Backup\PRD2.bak4396 GB776 GB366642052012-09-05 18:20:27.000FULL

    PRDU:\PRD_Backup\PRD3.bak4396 GB776 GB366642052012-09-05 18:20:27.000FULL

    PRDU:\PRD_Backup\PRD4.bak4396 GB776 GB366642052012-09-05 18:20:27.000FULL

    PRDU:\PRD_Backup\PRD5.bak4396 GB776 GB366642052012-09-05 18:20:27.000FULL

    PRDU:\PRD_Backup\PRD6.bak4396 GB776 GB366642052012-09-05 18:20:27.000FULL

    PRDU:\PRD_Backup\PRD1.bak4386 GB774 GB386681942012-09-04 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD2.bak4386 GB774 GB386681942012-09-04 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD3.bak4386 GB774 GB386681942012-09-04 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD4.bak4386 GB774 GB386681942012-09-04 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD5.bak4386 GB774 GB386681942012-09-04 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD6.bak4386 GB774 GB386681942012-09-04 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD1.bak4378 GB772 GB383671952012-09-03 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD2.bak4378 GB772 GB383671952012-09-03 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD3.bak4378 GB772 GB383671952012-09-03 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD4.bak4378 GB772 GB383671952012-09-03 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD5.bak4378 GB772 GB383671952012-09-03 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD6.bak4378 GB772 GB383671952012-09-03 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD1.bak4376 GB771 GB395691892012-09-02 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD2.bak4376 GB771 GB395691892012-09-02 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD3.bak4376 GB771 GB395691892012-09-02 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD4.bak4376 GB771 GB395691892012-09-02 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD5.bak4376 GB771 GB395691892012-09-02 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD6.bak4376 GB771 GB395691892012-09-02 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD1.bak4374 GB771 GB435761712012-09-01 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD2.bak4374 GB771 GB435761712012-09-01 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD3.bak4374 GB771 GB435761712012-09-01 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD4.bak4374 GB771 GB435761712012-09-01 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD5.bak4374 GB771 GB435761712012-09-01 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD6.bak4374 GB771 GB435761712012-09-01 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD1.bak4374 GB772 GB347612142012-08-31 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD2.bak4374 GB772 GB347612142012-08-31 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD3.bak4374 GB772 GB347612142012-08-31 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD4.bak4374 GB772 GB347612142012-08-31 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD5.bak4374 GB772 GB347612142012-08-31 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD6.bak4374 GB772 GB347612142012-08-31 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD1.bak4367 GB771 GB389681912012-08-30 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD2.bak4367 GB771 GB389681912012-08-30 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD3.bak4367 GB771 GB389681912012-08-30 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD4.bak4367 GB771 GB389681912012-08-30 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD5.bak4367 GB771 GB389681912012-08-30 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD6.bak4367 GB771 GB389681912012-08-30 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD1.bak4358 GB769 GB391691902012-08-29 18:20:20.000FULL

    PRDU:\PRD_Backup\PRD2.bak4358 GB769 GB391691902012-08-29 18:20:20.000FULL

    PRDU:\PRD_Backup\PRD3.bak4358 GB769 GB391691902012-08-29 18:20:20.000FULL

    PRDU:\PRD_Backup\PRD4.bak4358 GB769 GB391691902012-08-29 18:20:20.000FULL

    PRDU:\PRD_Backup\PRD5.bak4358 GB769 GB391691902012-08-29 18:20:20.000FULL

    PRDU:\PRD_Backup\PRD6.bak4358 GB769 GB391691902012-08-29 18:20:20.000FULL

    PRDU:\PRD_Backup\PRD1.bak4351 GB768 GB369652012012-08-28 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD2.bak4351 GB768 GB369652012012-08-28 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD3.bak4351 GB768 GB369652012012-08-28 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD4.bak4351 GB768 GB369652012012-08-28 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD5.bak4351 GB768 GB369652012012-08-28 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD6.bak4351 GB768 GB369652012012-08-28 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD1.bak4341 GB766 GB387681912012-08-27 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD2.bak4341 GB766 GB387681912012-08-27 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD3.bak4341 GB766 GB387681912012-08-27 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD4.bak4341 GB766 GB387681912012-08-27 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD5.bak4341 GB766 GB387681912012-08-27 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD6.bak4341 GB766 GB387681912012-08-27 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD1.bak4335 GB764 GB393691882012-08-26 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD2.bak4335 GB764 GB393691882012-08-26 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD3.bak4335 GB764 GB393691882012-08-26 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD4.bak4335 GB764 GB393691882012-08-26 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD5.bak4335 GB764 GB393691882012-08-26 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD6.bak4335 GB764 GB393691882012-08-26 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD1.bak4336 GB765 GB370652002012-08-25 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD2.bak4336 GB765 GB370652002012-08-25 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD3.bak4336 GB765 GB370652002012-08-25 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD4.bak4336 GB765 GB370652002012-08-25 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD5.bak4336 GB765 GB370652002012-08-25 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD6.bak4336 GB765 GB370652002012-08-25 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD1.bak4336 GB765 GB357632072012-08-24 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD2.bak4336 GB765 GB357632072012-08-24 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD3.bak4336 GB765 GB357632072012-08-24 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD4.bak4336 GB765 GB357632072012-08-24 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD5.bak4336 GB765 GB357632072012-08-24 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD6.bak4336 GB765 GB357632072012-08-24 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD1.bak4335 GB765 GB434761702012-08-23 21:03:15.000FULL

    PRDU:\PRD_Backup\PRD2.bak4335 GB765 GB434761702012-08-23 21:03:15.000FULL

    PRDU:\PRD_Backup\PRD3.bak4335 GB765 GB434761702012-08-23 21:03:15.000FULL

    PRDU:\PRD_Backup\PRD4.bak4335 GB765 GB434761702012-08-23 21:03:15.000FULL

    PRDU:\PRD_Backup\PRD5.bak4335 GB765 GB434761702012-08-23 21:03:15.000FULL

    PRDU:\PRD_Backup\PRD6.bak4335 GB765 GB434761702012-08-23 21:03:15.000FULL

    PRDU:\PRD_Backup\PRD1.bak4329 GB765 GB379671952012-08-22 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD2.bak4329 GB765 GB379671952012-08-22 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD3.bak4329 GB765 GB379671952012-08-22 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD4.bak4329 GB765 GB379671952012-08-22 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD5.bak4329 GB765 GB379671952012-08-22 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD6.bak4329 GB765 GB379671952012-08-22 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD1.bak4321 GB763 GB391691882012-08-21 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD2.bak4321 GB763 GB391691882012-08-21 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD3.bak4321 GB763 GB391691882012-08-21 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD4.bak4321 GB763 GB391691882012-08-21 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD5.bak4321 GB763 GB391691882012-08-21 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD6.bak4321 GB763 GB391691882012-08-21 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD1.bak4314 GB762 GB378661942012-08-20 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD2.bak4314 GB762 GB378661942012-08-20 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD3.bak4314 GB762 GB378661942012-08-20 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD4.bak4314 GB762 GB378661942012-08-20 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD5.bak4314 GB762 GB378661942012-08-20 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD6.bak4314 GB762 GB378661942012-08-20 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD1.bak4308 GB760 GB401701832012-08-19 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD2.bak4308 GB760 GB401701832012-08-19 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD3.bak4308 GB760 GB401701832012-08-19 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD4.bak4308 GB760 GB401701832012-08-19 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD5.bak4308 GB760 GB401701832012-08-19 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD6.bak4308 GB760 GB401701832012-08-19 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD1.bak4309 GB760 GB365642012012-08-18 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD2.bak4309 GB760 GB365642012012-08-18 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD3.bak4309 GB760 GB365642012012-08-18 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD4.bak4309 GB760 GB365642012012-08-18 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD5.bak4309 GB760 GB365642012012-08-18 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD6.bak4309 GB760 GB365642012012-08-18 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD1.bak4309 GB760 GB357632052012-08-17 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD2.bak4309 GB760 GB357632052012-08-17 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD3.bak4309 GB760 GB357632052012-08-17 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD4.bak4309 GB760 GB357632052012-08-17 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD5.bak4309 GB760 GB357632052012-08-17 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD6.bak4309 GB760 GB357632052012-08-17 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD1.bak4310 GB761 GB428751712012-08-16 20:54:25.000FULL

    PRDU:\PRD_Backup\PRD2.bak4310 GB761 GB428751712012-08-16 20:54:25.000FULL

    PRDU:\PRD_Backup\PRD3.bak4310 GB761 GB428751712012-08-16 20:54:25.000FULL

    PRDU:\PRD_Backup\PRD4.bak4310 GB761 GB428751712012-08-16 20:54:25.000FULL

    PRDU:\PRD_Backup\PRD5.bak4310 GB761 GB428751712012-08-16 20:54:25.000FULL

    PRDU:\PRD_Backup\PRD6.bak4310 GB761 GB428751712012-08-16 20:54:25.000FULL

    PRDU:\PRD_Backup\PRD1.bak4302 GB760 GB382671922012-08-15 18:20:20.000FULL

    PRDU:\PRD_Backup\PRD2.bak4302 GB760 GB382671922012-08-15 18:20:20.000FULL

    PRDU:\PRD_Backup\PRD3.bak4302 GB760 GB382671922012-08-15 18:20:20.000FULL

    PRDU:\PRD_Backup\PRD4.bak4302 GB760 GB382671922012-08-15 18:20:20.000FULL

    PRDU:\PRD_Backup\PRD5.bak4302 GB760 GB382671922012-08-15 18:20:20.000FULL

    PRDU:\PRD_Backup\PRD6.bak4302 GB760 GB382671922012-08-15 18:20:20.000FULL

    PRDU:\PRD_Backup\PRD1.bak4295 GB758 GB427751712012-08-14 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD2.bak4295 GB758 GB427751712012-08-14 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD3.bak4295 GB758 GB427751712012-08-14 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD4.bak4295 GB758 GB427751712012-08-14 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD5.bak4295 GB758 GB427751712012-08-14 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD6.bak4295 GB758 GB427751712012-08-14 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD1.bak4288 GB757 GB468821562012-08-13 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD2.bak4288 GB757 GB468821562012-08-13 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD3.bak4288 GB757 GB468821562012-08-13 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD4.bak4288 GB757 GB468821562012-08-13 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD5.bak4288 GB757 GB468821562012-08-13 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD6.bak4288 GB757 GB468821562012-08-13 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD1.bak4283 GB755 GB393691862012-08-12 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD2.bak4283 GB755 GB393691862012-08-12 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD3.bak4283 GB755 GB393691862012-08-12 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD4.bak4283 GB755 GB393691862012-08-12 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD5.bak4283 GB755 GB393691862012-08-12 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD6.bak4283 GB755 GB393691862012-08-12 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD1.bak4284 GB756 GB397701842012-08-11 18:20:26.000FULL

    PRDU:\PRD_Backup\PRD2.bak4284 GB756 GB397701842012-08-11 18:20:26.000FULL

    PRDU:\PRD_Backup\PRD3.bak4284 GB756 GB397701842012-08-11 18:20:26.000FULL

    PRDU:\PRD_Backup\PRD4.bak4284 GB756 GB397701842012-08-11 18:20:26.000FULL

    PRDU:\PRD_Backup\PRD5.bak4284 GB756 GB397701842012-08-11 18:20:26.000FULL

    PRDU:\PRD_Backup\PRD6.bak4284 GB756 GB397701842012-08-11 18:20:26.000FULL

    PRDU:\PRD_Backup\PRD1.bak4284 GB756 GB334592182012-08-10 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD2.bak4284 GB756 GB334592182012-08-10 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD3.bak4284 GB756 GB334592182012-08-10 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD4.bak4284 GB756 GB334592182012-08-10 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD5.bak4284 GB756 GB334592182012-08-10 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD6.bak4284 GB756 GB334592182012-08-10 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD1.bak4279 GB756 GB383671902012-08-09 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD2.bak4279 GB756 GB383671902012-08-09 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD3.bak4279 GB756 GB383671902012-08-09 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD4.bak4279 GB756 GB383671902012-08-09 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD5.bak4279 GB756 GB383671902012-08-09 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD6.bak4279 GB756 GB383671902012-08-09 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD1.bak4274 GB755 GB332582192012-08-08 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD2.bak4274 GB755 GB332582192012-08-08 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD3.bak4274 GB755 GB332582192012-08-08 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD4.bak4274 GB755 GB332582192012-08-08 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD5.bak4274 GB755 GB332582192012-08-08 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD6.bak4274 GB755 GB332582192012-08-08 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD1.bak4267 GB754 GB330582202012-08-07 18:20:16.000FULL

    PRDU:\PRD_Backup\PRD2.bak4267 GB754 GB330582202012-08-07 18:20:16.000FULL

    PRDU:\PRD_Backup\PRD3.bak4267 GB754 GB330582202012-08-07 18:20:16.000FULL

    PRDU:\PRD_Backup\PRD4.bak4267 GB754 GB330582202012-08-07 18:20:16.000FULL

    PRDU:\PRD_Backup\PRD5.bak4267 GB754 GB330582202012-08-07 18:20:16.000FULL

    PRDU:\PRD_Backup\PRD6.bak4267 GB754 GB330582202012-08-07 18:20:16.000FULL

    PRDU:\PRD_Backup\PRD1.bak4269 GB755 GB372651962012-08-06 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD2.bak4269 GB755 GB372651962012-08-06 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD3.bak4269 GB755 GB372651962012-08-06 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD4.bak4269 GB755 GB372651962012-08-06 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD5.bak4269 GB755 GB372651962012-08-06 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD6.bak4269 GB755 GB372651962012-08-06 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD1.bak4255 GB750 GB441771642012-08-05 18:20:00.000FULL

    PRDU:\PRD_Backup\PRD2.bak4255 GB750 GB441771642012-08-05 18:20:00.000FULL

    PRDU:\PRD_Backup\PRD3.bak4255 GB750 GB441771642012-08-05 18:20:00.000FULL

    PRDU:\PRD_Backup\PRD4.bak4255 GB750 GB441771642012-08-05 18:20:00.000FULL

    PRDU:\PRD_Backup\PRD5.bak4255 GB750 GB441771642012-08-05 18:20:00.000FULL

    PRDU:\PRD_Backup\PRD6.bak4255 GB750 GB441771642012-08-05 18:20:00.000FULL

    PRDU:\PRD_Backup\PRD1.bak4260 GB753 GB208363492012-08-03 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD2.bak4260 GB753 GB208363492012-08-03 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD3.bak4260 GB753 GB208363492012-08-03 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD4.bak4260 GB753 GB208363492012-08-03 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD5.bak4260 GB753 GB208363492012-08-03 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD6.bak4260 GB753 GB208363492012-08-03 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD1.bak4249 GB751 GB228403182012-08-02 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD2.bak4249 GB751 GB228403182012-08-02 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD3.bak4249 GB751 GB228403182012-08-02 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD4.bak4249 GB751 GB228403182012-08-02 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD5.bak4249 GB751 GB228403182012-08-02 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD6.bak4249 GB751 GB228403182012-08-02 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD1.bak4247 GB753 GB207363492012-08-01 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD2.bak4247 GB753 GB207363492012-08-01 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD3.bak4247 GB753 GB207363492012-08-01 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD4.bak4247 GB753 GB207363492012-08-01 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD5.bak4247 GB753 GB207363492012-08-01 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD6.bak4247 GB753 GB207363492012-08-01 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD1.bak4227 GB748 GB207363482012-07-31 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD2.bak4227 GB748 GB207363482012-07-31 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD3.bak4227 GB748 GB207363482012-07-31 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD4.bak4227 GB748 GB207363482012-07-31 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD5.bak4227 GB748 GB207363482012-07-31 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD6.bak4227 GB748 GB207363482012-07-31 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD1.bak4217 GB746 GB200353592012-07-30 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD2.bak4217 GB746 GB200353592012-07-30 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD3.bak4217 GB746 GB200353592012-07-30 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD4.bak4217 GB746 GB200353592012-07-30 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD5.bak4217 GB746 GB200353592012-07-30 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD6.bak4217 GB746 GB200353592012-07-30 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD1.bak4208 GB743 GB204363512012-07-29 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD2.bak4208 GB743 GB204363512012-07-29 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD3.bak4208 GB743 GB204363512012-07-29 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD4.bak4208 GB743 GB204363512012-07-29 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD5.bak4208 GB743 GB204363512012-07-29 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD6.bak4208 GB743 GB204363512012-07-29 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD1.bak4210 GB744 GB200353592012-07-28 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD2.bak4210 GB744 GB200353592012-07-28 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD3.bak4210 GB744 GB200353592012-07-28 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD4.bak4210 GB744 GB200353592012-07-28 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD5.bak4210 GB744 GB200353592012-07-28 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD6.bak4210 GB744 GB200353592012-07-28 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD1.bak4210 GB745 GB192343732012-07-27 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD2.bak4210 GB745 GB192343732012-07-27 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD3.bak4210 GB745 GB192343732012-07-27 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD4.bak4210 GB745 GB192343732012-07-27 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD5.bak4210 GB745 GB192343732012-07-27 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD6.bak4210 GB745 GB192343732012-07-27 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD1.bak4196 GB742 GB398701792012-07-26 18:20:00.000FULL

    PRDU:\PRD_Backup\PRD2.bak4196 GB742 GB398701792012-07-26 18:20:00.000FULL

    PRDU:\PRD_Backup\PRD3.bak4196 GB742 GB398701792012-07-26 18:20:00.000FULL

    PRDU:\PRD_Backup\PRD4.bak4196 GB742 GB398701792012-07-26 18:20:00.000FULL

    PRDU:\PRD_Backup\PRD5.bak4196 GB742 GB398701792012-07-26 18:20:00.000FULL

    PRDU:\PRD_Backup\PRD6.bak4196 GB742 GB398701792012-07-26 18:20:00.000FULL

    PRDU:\PRD_Backup\PRD1.bak4183 GB740 GB344602072012-07-24 18:20:02.000FULL

    PRDU:\PRD_Backup\PRD2.bak4183 GB740 GB344602072012-07-24 18:20:02.000FULL

    PRDU:\PRD_Backup\PRD3.bak4183 GB740 GB344602072012-07-24 18:20:02.000FULL

    PRDU:\PRD_Backup\PRD4.bak4183 GB740 GB344602072012-07-24 18:20:02.000FULL

    PRDU:\PRD_Backup\PRD5.bak4183 GB740 GB344602072012-07-24 18:20:02.000FULL

    PRDU:\PRD_Backup\PRD6.bak4183 GB740 GB344602072012-07-24 18:20:02.000FULL

    PRDU:\PRD_Backup\PRD1.bak4174 GB739 GB354622012012-07-23 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD2.bak4174 GB739 GB354622012012-07-23 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD3.bak4174 GB739 GB354622012012-07-23 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD4.bak4174 GB739 GB354622012012-07-23 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD5.bak4174 GB739 GB354622012012-07-23 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD6.bak4174 GB739 GB354622012012-07-23 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD1.bak4169 GB736 GB341602082012-07-22 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD2.bak4169 GB736 GB341602082012-07-22 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD3.bak4169 GB736 GB341602082012-07-22 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD4.bak4169 GB736 GB341602082012-07-22 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD5.bak4169 GB736 GB341602082012-07-22 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD6.bak4169 GB736 GB341602082012-07-22 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD1.bak4169 GB736 GB235413022012-07-21 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD2.bak4169 GB736 GB235413022012-07-21 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD3.bak4169 GB736 GB235413022012-07-21 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD4.bak4169 GB736 GB235413022012-07-21 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD5.bak4169 GB736 GB235413022012-07-21 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD6.bak4169 GB736 GB235413022012-07-21 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD1.bak4169 GB737 GB302532352012-07-20 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD2.bak4169 GB737 GB302532352012-07-20 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD3.bak4169 GB737 GB302532352012-07-20 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD4.bak4169 GB737 GB302532352012-07-20 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD5.bak4169 GB737 GB302532352012-07-20 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD6.bak4169 GB737 GB302532352012-07-20 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD1.bak4169 GB737 GB354622012012-07-19 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD2.bak4169 GB737 GB354622012012-07-19 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD3.bak4169 GB737 GB354622012012-07-19 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD4.bak4169 GB737 GB354622012012-07-19 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD5.bak4169 GB737 GB354622012012-07-19 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD6.bak4169 GB737 GB354622012012-07-19 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD1.bak4161 GB736 GB369651922012-07-18 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD2.bak4161 GB736 GB369651922012-07-18 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD3.bak4161 GB736 GB369651922012-07-18 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD4.bak4161 GB736 GB369651922012-07-18 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD5.bak4161 GB736 GB369651922012-07-18 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD6.bak4161 GB736 GB369651922012-07-18 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD1.bak4157 GB735 GB360631972012-07-17 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD2.bak4157 GB735 GB360631972012-07-17 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD3.bak4157 GB735 GB360631972012-07-17 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD4.bak4157 GB735 GB360631972012-07-17 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD5.bak4157 GB735 GB360631972012-07-17 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD6.bak4157 GB735 GB360631972012-07-17 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD1.bak4153 GB735 GB350622022012-07-16 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD2.bak4153 GB735 GB350622022012-07-16 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD3.bak4153 GB735 GB350622022012-07-16 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD4.bak4153 GB735 GB350622022012-07-16 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD5.bak4153 GB735 GB350622022012-07-16 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD6.bak4153 GB735 GB350622022012-07-16 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD1.bak4150 GB734 GB337592102012-07-15 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD2.bak4150 GB734 GB337592102012-07-15 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD3.bak4150 GB734 GB337592102012-07-15 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD4.bak4150 GB734 GB337592102012-07-15 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD5.bak4150 GB734 GB337592102012-07-15 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD6.bak4150 GB734 GB337592102012-07-15 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD1.bak4147 GB733 GB350612022012-07-14 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD2.bak4147 GB733 GB350612022012-07-14 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD3.bak4147 GB733 GB350612022012-07-14 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD4.bak4147 GB733 GB350612022012-07-14 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD5.bak4147 GB733 GB350612022012-07-14 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD6.bak4147 GB733 GB350612022012-07-14 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD1.bak4148 GB734 GB323572192012-07-13 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD2.bak4148 GB734 GB323572192012-07-13 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD3.bak4148 GB734 GB323572192012-07-13 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD4.bak4148 GB734 GB323572192012-07-13 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD5.bak4148 GB734 GB323572192012-07-13 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD6.bak4148 GB734 GB323572192012-07-13 18:20:23.000FULL

    PRDU:\PRD_Backup\PRD1.bak4146 GB734 GB364641942012-07-12 18:20:26.000FULL

    PRDU:\PRD_Backup\PRD2.bak4146 GB734 GB364641942012-07-12 18:20:26.000FULL

    PRDU:\PRD_Backup\PRD3.bak4146 GB734 GB364641942012-07-12 18:20:26.000FULL

    PRDU:\PRD_Backup\PRD4.bak4146 GB734 GB364641942012-07-12 18:20:26.000FULL

    PRDU:\PRD_Backup\PRD5.bak4146 GB734 GB364641942012-07-12 18:20:26.000FULL

    PRDU:\PRD_Backup\PRD6.bak4146 GB734 GB364641942012-07-12 18:20:26.000FULL

    PRDU:\PRD_Backup\PRD1.bak4140 GB733 GB367651922012-07-11 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD2.bak4140 GB733 GB367651922012-07-11 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD3.bak4140 GB733 GB367651922012-07-11 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD4.bak4140 GB733 GB367651922012-07-11 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD5.bak4140 GB733 GB367651922012-07-11 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD6.bak4140 GB733 GB367651922012-07-11 18:20:22.000FULL

    PRDU:\PRD_Backup\PRD1.bak4133 GB731 GB346612042012-07-10 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD2.bak4133 GB731 GB346612042012-07-10 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD3.bak4133 GB731 GB346612042012-07-10 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD4.bak4133 GB731 GB346612042012-07-10 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD5.bak4133 GB731 GB346612042012-07-10 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD6.bak4133 GB731 GB346612042012-07-10 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD1.bak4128 GB730 GB373661882012-07-09 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD2.bak4128 GB730 GB373661882012-07-09 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD3.bak4128 GB730 GB373661882012-07-09 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD4.bak4128 GB730 GB373661882012-07-09 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD5.bak4128 GB730 GB373661882012-07-09 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD6.bak4128 GB730 GB373661882012-07-09 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD1.bak4122 GB729 GB373661882012-07-08 18:20:01.000FULL

    PRDU:\PRD_Backup\PRD2.bak4122 GB729 GB373661882012-07-08 18:20:01.000FULL

    PRDU:\PRD_Backup\PRD3.bak4122 GB729 GB373661882012-07-08 18:20:01.000FULL

    PRDU:\PRD_Backup\PRD4.bak4122 GB729 GB373661882012-07-08 18:20:01.000FULL

    PRDU:\PRD_Backup\PRD5.bak4122 GB729 GB373661882012-07-08 18:20:01.000FULL

    PRDU:\PRD_Backup\PRD6.bak4122 GB729 GB373661882012-07-08 18:20:01.000FULL

    PRDU:\PRD_Backup\PRD1.bak4117 GB727 GB328582142012-07-07 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD2.bak4117 GB727 GB328582142012-07-07 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD3.bak4117 GB727 GB328582142012-07-07 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD4.bak4117 GB727 GB328582142012-07-07 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD5.bak4117 GB727 GB328582142012-07-07 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD6.bak4117 GB727 GB328582142012-07-07 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD1.bak4115 GB727 GB352621992012-07-06 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD2.bak4115 GB727 GB352621992012-07-06 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD3.bak4115 GB727 GB352621992012-07-06 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD4.bak4115 GB727 GB352621992012-07-06 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD5.bak4115 GB727 GB352621992012-07-06 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD6.bak4115 GB727 GB352621992012-07-06 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD1.bak4111 GB727 GB380671842012-07-05 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD2.bak4111 GB727 GB380671842012-07-05 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD3.bak4111 GB727 GB380671842012-07-05 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD4.bak4111 GB727 GB380671842012-07-05 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD5.bak4111 GB727 GB380671842012-07-05 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD6.bak4111 GB727 GB380671842012-07-05 18:20:21.000FULL

    PRDU:\PRD_Backup\PRD1.bak4104 GB725 GB388681802012-07-04 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD2.bak4104 GB725 GB388681802012-07-04 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD3.bak4104 GB725 GB388681802012-07-04 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD4.bak4104 GB725 GB388681802012-07-04 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD5.bak4104 GB725 GB388681802012-07-04 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD6.bak4104 GB725 GB388681802012-07-04 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD1.bak4101 GB725 GB385681822012-07-03 18:20:26.000FULL

    PRDU:\PRD_Backup\PRD2.bak4101 GB725 GB385681822012-07-03 18:20:26.000FULL

    PRDU:\PRD_Backup\PRD3.bak4101 GB725 GB385681822012-07-03 18:20:26.000FULL

    PRDU:\PRD_Backup\PRD4.bak4101 GB725 GB385681822012-07-03 18:20:26.000FULL

    PRDU:\PRD_Backup\PRD5.bak4101 GB725 GB385681822012-07-03 18:20:26.000FULL

    PRDU:\PRD_Backup\PRD6.bak4101 GB725 GB385681822012-07-03 18:20:26.000FULL

    PRDU:\PRD_Backup\PRD1.bak4093 GB724 GB397701762012-07-02 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD2.bak4093 GB724 GB397701762012-07-02 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD3.bak4093 GB724 GB397701762012-07-02 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD4.bak4093 GB724 GB397701762012-07-02 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD5.bak4093 GB724 GB397701762012-07-02 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD6.bak4093 GB724 GB397701762012-07-02 18:20:24.000FULL

    PRDU:\PRD_Backup\PRD1.bak4088 GB723 GB399701752012-07-01 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD2.bak4088 GB723 GB399701752012-07-01 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD3.bak4088 GB723 GB399701752012-07-01 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD4.bak4088 GB723 GB399701752012-07-01 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD5.bak4088 GB723 GB399701752012-07-01 18:20:25.000FULL

    PRDU:\PRD_Backup\PRD6.bak4088 GB723 GB399701752012-07-01 18:20:25.000FULL

  • Yikes, lots of data there - could you edit that and remove all but the top couple of hundred rows or so as it's going to be very slow to load the thread? It's duplicating data as you've got multiple files per set, but your average throughput has gone down from 65-85MB/s to 33MB/s when you look at the last few backups, but actually, if you look back further, you had similar slow timings for your backups between 27th July and 3rd August, which makes me think this is likely to be I/O contention at the time the backup job runs rather than a hardware issue. This would also make sense as to why it was much faster when it was run outside of its normal schedule on the 8th (presumably there's less activity on the system at this time).

    Any other jobs running at the time? Could you move the backup window to a quieter time on the sytem?

  • HowardW (9/11/2012)


    Yikes, lots of data there - could you edit that and remove all but the top couple of hundred rows or so as it's going to be very slow to load the thread? It's duplicating data as you've got multiple files per set, but your average throughput has gone down from 65-85MB/s to 33MB/s when you look at the last few backups, but actually, if you look back further, you had similar slow timings for your backups between 27th July and 3rd August, which makes me think this is likely to be I/O contention at the time the backup job runs rather than a hardware issue. This would also make sense as to why it was much faster when it was run outside of its normal schedule on the 8th (presumably there's less activity on the system at this time).

    Any other jobs running at the time? Could you move the backup window to a quieter time on the sytem?

    Only other (SQL Agent) jobs running is the tlog backup job that runs every 6 minutes. Never caused an issue before.

Viewing 7 posts - 1 through 6 (of 6 total)

You must be logged in to reply to this topic. Login to reply