Sorry I didn't reply sooner.  You're in a great position to build up your SCD2 dims.

SCD2 is designed to detect and capture change over time.  On Monday you get a...

Do you have actual historical data?  I.e. you know what the value was on Jan1, and you also know what the value was on Jan2.  Do you have each change...

Since there's no ODBC driver support available in Azure (to my knowledge), you cannot directly import from the Intersystems database.

This is best solved from the source side.   Write an app...

MEDIAN is notoriously slow.  Here's an article that suggests a workaround:

Median calculation routine

Help me to better understand your question.  What is the external database?  That will dictate what driver you may use.

Try this.  Please mark as answered if this does the trick.

ls "c:\temp\bigfile*chunk*.zip" | Expand-Archive -force -destinationpath c:\temp
cmd /c copy /b "c:\temp\bigfile*chunk" "c:\temp\bigfile.exe"

Looks like an SQL question.  Suggest you post in the appropriate forum, trim down your request, provide some sample input and output data that someone can just run to see...

Try this.  Splits files, then zips each one.

$from = "C:\temp\bigfile.exe"
$rootName = "C:\temp\bigfile"
$ext = "chunk"
$upperBound = 500KB


$fromFile = [io.file]::OpenRead($from)
$buff = new-object byte[] $upperBound
$count = $idx = 0
try {
...