January 14, 2025 at 6:55 am
Hi Experts
I want to move data/ some million rows from a Azure vm table to Azure blob storage.
What all are the best ways to complete this task?
Thanks
Manoj Bhadiyadra
January 15, 2025 at 7:06 am
Thanks for posting your issue and hopefully someone will answer soon.
This is an automated bump to increase visibility of your question.
January 15, 2025 at 1:19 pm
If you create a container inside your storage account, you can then use the mount command to mount it as NFS storage inside the VM.
Something like this (example code from online):
$fileShareName = "<your_file_share_name>"
$driveLetter = "Z:"
New-PSDrive -Name $driveLetter -PSProvider FileSystem -Root "\\$storageAccountName.file.core.windows.net\$fileShareName" -Persist -Credential $ctx.StorageAccount.Credentials
After that, however you want to export the data.
"The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood"
- Theodore Roosevelt
Author of:
SQL Server Execution Plans
SQL Server Query Performance Tuning
January 24, 2025 at 10:36 am
Thanks for your prompt response Grant.
Does it mean that I can transfer structure data to & from Azure Blob Storage post creating NFS storage
January 27, 2025 at 12:36 pm
Export, backup, whatever. It's going to look & act like a drive inside the VM.
"The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood"
- Theodore Roosevelt
Author of:
SQL Server Execution Plans
SQL Server Query Performance Tuning
February 17, 2025 at 5:22 am
Thanks for your quick response. Thing is it will be in file format. I mean converted table data in to file and then moved data...but i f there is need to see the data immediately which are shifted / stored in file? is it possible?
February 17, 2025 at 7:05 pm
It's a VM and operates like a VM. Attached storage will act like attached storage. I'm not sure where you're going with this. As I said before. It's going to look and act like a drive. Whatever you can write & read from on a drive, will be the same here.
"The credit belongs to the man who is actually in the arena, whose face is marred by dust and sweat and blood"
- Theodore Roosevelt
Author of:
SQL Server Execution Plans
SQL Server Query Performance Tuning
February 18, 2025 at 10:49 am
Thing is it will be in file format. I mean converted table data in to file and then moved data...but i f there is need to see the data immediately which are shifted / stored in file? is it possible?
Mybe you could use ADF to export the data to something like parquet format. The parquet could then be viewed within SQL as an External Table.
Viewing 8 posts - 1 through 7 (of 7 total)
You must be logged in to reply to this topic. Login to reply
This website stores cookies on your computer.
These cookies are used to improve your website experience and provide more personalized services to you, both on this website and through other media.
To find out more about the cookies we use, see our Privacy Policy