Transfer data from azure vm to blob storage

  • Hi Experts

    I want to move data/ some million rows from a Azure vm table to Azure blob storage.

    What all are the best ways to complete this task?

     

    Thanks

    Manoj Bhadiyadra

  • Thanks for posting your issue and hopefully someone will answer soon.

    This is an automated bump to increase visibility of your question.

  • If you create a container inside your storage account, you can then use the mount command to mount it as NFS storage inside the VM.

    Something like this (example code from online):

    $fileShareName = "<your_file_share_name>"
    $driveLetter = "Z:"
    New-PSDrive -Name $driveLetter -PSProvider FileSystem -Root "\\$storageAccountName.file.core.windows.net\$fileShareName" -Persist -Credential $ctx.StorageAccount.Credentials

    After that, however you want to export the data.

    "The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood"
    - Theodore Roosevelt

    Author of:
    SQL Server Execution Plans
    SQL Server Query Performance Tuning

  • Thanks for your prompt response Grant.

    Does it mean that I can transfer structure data to & from Azure Blob Storage post creating NFS storage

  • Export, backup, whatever. It's going to look & act like a drive inside the VM.

    "The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood"
    - Theodore Roosevelt

    Author of:
    SQL Server Execution Plans
    SQL Server Query Performance Tuning

  • Thanks for your quick response. Thing is it will be in file format. I mean converted table data in to file and then moved data...but i f there is need to see the data immediately which are shifted / stored in file? is it possible?

  • It's a VM and operates like a VM. Attached storage will act like attached storage. I'm not sure where you're going with this. As I said before. It's going to look and act like a drive. Whatever you can write & read from on a drive, will be the same here.

    "The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood"
    - Theodore Roosevelt

    Author of:
    SQL Server Execution Plans
    SQL Server Query Performance Tuning

  • manoj2001 wrote:

    Thing is it will be in file format. I mean converted table data in to file and then moved data...but i f there is need to see the data immediately which are shifted / stored in file? is it possible?

    Mybe you could use ADF to export the data to something like parquet format. The parquet could then be viewed within SQL as an External Table.

Viewing 8 posts - 1 through 7 (of 7 total)

You must be logged in to reply to this topic. Login to reply