Azure Data Factory


Data Engineering Best Practices Using Azure Data Factory

Trainer(s): Abhishek Narain, Sunil Sabat & Linda Wang
Provider: DPS 2021 (Data Platform Summit)
Duration: 7 Hours 33 Mins
Subtitles: Yes
Price: USD 149.5

Abstract: In this workshop, we will cover data engineering best practices while using Azure Data Factory – Performance, Security, and Scalability being the key focus areas. We will build ETL pipelines as part of the workshop for hands-on learning.

Modules

    1. Data pipeline overview

    • What is data factory?
    • Data engineering common scenario
    • Getting started and environment setup

    2. Data Integration: Connectivity and code-free transformation

    • Bringing data to data lake on Azure: On-premises and SaaS/PaaS datastore connectivity with a Copy activity
    • Transforming data using data flows

    3. Best practices for operationalizing data pipelines

    • Govern data using Azure Purview Integration
    • Scalability and Performance considerations
    • Security
    • External integrations with compute engines (Databricks, SProc)
    • Continuous Integration and Continuous Deployment (CICD)

Note: This recorded class is available in the format of a video course. Content is presented in modular videos. Learn more.