Abstract: Most of us know ETL jobs and Datawarehouse designs. When working within the Microsoft Data Plattform on premises, using SSIS is a no-brainer. But what if you build your DWH in the cloud? What if dependencies rapidly change? For example if your sources are no longer Databases and Flat Files but REST APIs? How can you incorporate all this into a cloud-borne DWH project? You will need to rethink the patterns you used to work with on premises to adapt for the cloud. Also, with the multitude of available cloud services, sometimes it is hard to decide on the right tool for your task.
I will develop a modern ETL architecture and talk about the different services, you can apply in order to get your data into your analytical system. You will learn, what tools you an use for which task, how to utilize Azure Functions, Data Factory, Logic Apps and Web Activities and where to make your tasks asynchronous and how to decouple your processes in order to have a stable environment for your cloud-borne DWH.
1. Using ADF, ADF Basics
2. Azure Functions
4. Connectiong with APIs
5. Resiliency, hardening your solution
Note: This recorded class is available in the format of a video course. Content is presented in modular videos. Learn more.