Dataset extracting issue in ADF - status code 400 Bad Request
Vikki.C.486
Posts: 2 🔍
Hi everyone,
I built a pipeline in Azure data factory to download bright space datasets in batches.
Some of the datasets extracting gave me HTTP 400 Bad request error.
What confused me is some of the datasets extracts worked, some didn't.
The download link URL is like this:
https://XXX.brightspace.com/d2l/api/lp/1.45/datasets/bds/SchemaId/plugins/PluginId/extracts/extractID
I have noticed that when the extract ID are numbers, the pipeline works fine. I am able to download these datasets. Example:
https://XXX.brightspace.com/d2l/api/lp/1.45/datasets/bds/dcef8789-1e6b-4d98-ac76-588583b3ba30/plugins/6d6cd2d8-c714-41fd-9465-f797dfd69c76/extracts/1699858856
When the extract ID contains letters, the process always fails. Example:
https://XXX.brightspace.com/d2l/api/lp/1.45/datasets/bds/435ee960-871f-484f-8e66-44886dea08f8/plugins/d18ed567-e0a3-4fb7-912f-84d294620830/extracts/MTY5OTg1OTEwMA
The error message is:
"Http request failed with client error, status code 400 BadRequest, please check your activity settings."
I couldn't figure out how to solve this. It makes no sense because if the url is problematic, the whole pipeline should fail. But it wasn't the case.
Did anyone experience the same?
Any help is appreciated.
BTW, what is the meaning/difference between extract IDs that consist numbers or letters? (Just try to understand the logic )
Thanks,
Vikki
I built a pipeline in Azure data factory to download bright space datasets in batches.
Some of the datasets extracting gave me HTTP 400 Bad request error.
What confused me is some of the datasets extracts worked, some didn't.
The download link URL is like this:
https://XXX.brightspace.com/d2l/api/lp/1.45/datasets/bds/SchemaId/plugins/PluginId/extracts/extractID
I have noticed that when the extract ID are numbers, the pipeline works fine. I am able to download these datasets. Example:
https://XXX.brightspace.com/d2l/api/lp/1.45/datasets/bds/dcef8789-1e6b-4d98-ac76-588583b3ba30/plugins/6d6cd2d8-c714-41fd-9465-f797dfd69c76/extracts/1699858856
When the extract ID contains letters, the process always fails. Example:
https://XXX.brightspace.com/d2l/api/lp/1.45/datasets/bds/435ee960-871f-484f-8e66-44886dea08f8/plugins/d18ed567-e0a3-4fb7-912f-84d294620830/extracts/MTY5OTg1OTEwMA
The error message is:
"Http request failed with client error, status code 400 BadRequest, please check your activity settings."
I couldn't figure out how to solve this. It makes no sense because if the url is problematic, the whole pipeline should fail. But it wasn't the case.
Did anyone experience the same?
Any help is appreciated.
BTW, what is the meaning/difference between extract IDs that consist numbers or letters? (Just try to understand the logic )
Thanks,
Vikki
Answers
-
I'm having the exact same problem - was a fix found for this?
