December 18, 2020 at 11:23 am
I am currently trying to backfill data from an S3 bucket, to SQL server using Alteryx. Unfortunately, there is a lot of data and running a month at a time crashes our server.
I'm trying to find a way to build a SQL statement, that will look for a MAX() date that is currently in the dataset, and then subsequently add/append the next 3+ days of data to my table. Is this functionality possible, and if so, any suggestions on the query?
I would like to then schedule this query to run overnight so we can start populating this table.
December 18, 2020 at 2:40 pm
I am currently trying to backfill data from an S3 bucket, to SQL server using Alteryx. Unfortunately, there is a lot of data and running a month at a time crashes our server.
I'm trying to find a way to build a SQL statement, that will look for a MAX() date that is currently in the dataset, and then subsequently add/append the next 3+ days of data to my table. Is this functionality possible, and if so, any suggestions on the query?
It's not fully explained imo. What format is the data in S3? It's a text file or ??? Please post the query you're currently running.
Aus dem Paradies, das Cantor uns geschaffen, soll uns niemand vertreiben können
Viewing 2 posts - 1 through 1 (of 1 total)
You must be logged in to reply to this topic. Login to reply