How to extract data from MS Planner to Snowflake using Azure Data Factory

141 Views Asked by At

I would like to extract data from Ms Planner and load it into snowflake. I am using ADF as integration tool. How to achieve this?

1

There are 1 best solutions below

1
Trent Tamura On

I would personally use a REST API call (Web Activity in ADF) to MS Planner. Here is a link to a GET command for Plans, and there are many other commands you can navigate to from this link:

MS Planner API

Once you do an API call, you will get a JSON Output. You should be able to load this JSON to Snowflake and then shred it using various methods detailed in this link:

JSON Handling in Snowflake

The way I picture it in my head in ADF is:

  1. Web call to MS Planner
  2. Write the Output to a variable (optional, but could be good for organization purposes)
  3. Write the JSON variable to Snowflake (single column)
  4. Parse JSON (aka Shredding) from Single Column to Individual Columns depending on the JSON structure (arrays, objects, etc)

Cheers!