September 16, 2022 at 6:25 am
Hi,
I am trying to fetch 2200 records from a website list to my sql server db using REST Source component in SSIS.
The import is working fine but only the top 1000 records get inserted in the table (db) as the REST Source has 1000 batch size limit. Tried to increase the limit ( thru advanced editor), but getting Error:- Batch size out of range, allowed range 1-1000.
If I again import it, those same 1000 will again be populated.
For getting next 1000 (1000-2000) records i used limit and offset too.....In the Advanced Editor, I put Endpoint as :-GET https://website?limit=1000&offset=1000
Not able to get required results ( same first 1000 records getting populated)
Does anyone have an idea about this ?
Regards
skybvi
Regards
Sushant Kumar
MCTS,MCP
September 16, 2022 at 6:32 am
I believe that this limit will have been imposed at source and therefore I suggest you get hold of whatever documentation or support is available for the particular REST API you are dealing with
The absence of evidence is not evidence of absence
- Martin Rees
The absence of consumable DDL, sample data and desired results is, however, evidence of the absence of my response
- Phil Parkin
Viewing 2 posts - 1 through 1 (of 1 total)
You must be logged in to reply to this topic. Login to reply