extracting data from a IP restricted api using synapse analytics

58 Views Asked by At

I'm trying to use the copy tool in azure synapse analytics to access data from the Clash Royale API at https://developer.clashroyale.com/#/ and store into the data lake. While creating the authorization token, you are only allowed to give specific IP addresses and not a range. While using synapse copy tool, synapse uses different IP address each time to extract the data and the authorization fails. What can I do to make this work.

Thanks in advance.

I thought I would create a Vnet and a public IP and route the traffic through it but couldn't figure out how to do it.

(update) I was able to do it using a self hosted integration runtime running on a windows vm in azure. Is there a better way to do this?

1

There are 1 best solutions below

2
Bhavani On

If you want to extract data from a IP restricted Api using synapse analytics create https linked service with URL with "Anonymous" authentication as shown below:

enter image description here

You can use above linked service for copy the data to ADLS account. For more information you can refer this document.