Azure Data Factory

  • Comments posted to this topic are about the item Azure Data Factory

  • This was removed by the editor as SPAM

  • Nice one, thank you.

  • Azure data factory is rather cool. We use this a great deal in our shop.

  • Nice question, thanks.

    Need an answer? No, you need a question
    My blog at https://sqlkover.com.
    MCSE Business Intelligence - Microsoft Data Platform MVP

  • Thanks for the question. Had to do a little research. Ended up reading a lot. These question do serve a good purpose.

  • Hello,

    As there is no Data Factory specific forum option (could we have one, please?), then I'll post a question here. I have been calling an JSON API and storing the output in Blob to be used as a dataset for the next activity. What I am wondering is, could I use the output of the JSON API for the next activity without having to store it in blob? FYI, the next activity will be extracting the information using OPENJSON and storing it into a SQL 2016 landing table.

    Thank you for any suggestions or ideas. If I work it out in the meantime, I'll post back.

    Regards,
    D.

  • Duran - Tuesday, December 4, 2018 3:33 PM

    Hello,

    As there is no Data Factory specific forum option (could we have one, please?), then I'll post a question here. I have been calling an JSON API and storing the output in Blob to be used as a dataset for the next activity. What I am wondering is, could I use the output of the JSON API for the next activity without having to store it in blob? FYI, the next activity will be extracting the information using OPENJSON and storing it into a SQL 2016 landing table.

    Thank you for any suggestions or ideas. If I work it out in the meantime, I'll post back.

    Regards,
    D.

    Can you not just make the copy activity convert the JSON input to Text output as it copies the entire JSON dataset into SQL Server directly? Last I check, you can convert the input of a data stream to something entirely separate with the output. For example, you can read in a TSV file and have data factory output the data as a CSV with a custom delimiter.

    Also, what's stopping you from just saving this as something else than JSON? I work with a lot of API's myself and I always convert the data to CSV or similar as it writes the file. Therefore, what would be in BLOB would be the actual CSV file.

  • Please don't post a question here. If there isn't a forum, pick a forum that's close and start a new thread. Don't hijack others.

    I've added an ADF forum here: https://www.sqlservercentral.com/Forums/Cloud-Computing/Azure-Data-Factory

Viewing 10 posts - 1 through 9 (of 9 total)

You must be logged in to reply to this topic. Login to reply