DP-3011: Implementing a data analytics solution with Azure Databricks

Become an EPIC Affiliate

To view the class schedule you need to become an Affiliate

  • Largest “Guaranteed To Run” public technical training schedules available
  • Easy to become an Affiliate – no charge or fee
Become an EPIC Affiliate

already an Affiliate?  Login

About this Course

This course is designed to be delivered in one full day.

Learn how to harness the power of Apache Spark and powerful clusters running on the Azure Databricks platform to run large data engineering workloads in the cloud.

Audience Profile

You should be an Azure data engineer with subject matter expertise in designing, implementing, managing, and maintaining Microsoft Azure Virtual Desktop experiences and remote apps for any device.

At Course Completion

Outline

Module:  Explore Azure Databricks

Azure Databricks is a cloud service that provides a scalable platform for data analytics using Apache Spark..

Lessons

  • Get started with Azure Databricks
  • Identify Azure Databricks workloads
  • Understand key concepts

Exercise

  • Explore Azure Databricks

Module:  Use Apache Spark in Azure Databricks

Azure Databricks is built on Apache Spark and enables data engineers and analysts to run Spark jobs to transform, analyze and visualize data at scale.

Lessons

  • Get to know Spark
  • Create a Spark cluster
  • Use Spark in notebooks
  • Use Spark to work with data files
  • Visualize data

Exercise

  • Use Spark in Azure Databricks

Module:  Use Delta Lake in Azure Databricks

Delta Lake is an open source relational storage area for Spark that you can use to implement a data lakehouse architecture in Azure Databricks.

Lessons

  • Get Started with Delta Lake
  • Create Delta Lake tables
  • Create and query catalog tables
  • Use Delta Lake for streaming data

Exercise

  • Use Delta Lake in Azure Databricks

Module:  Use SQL Warehouses in Azure Databricks

Azure Databricks provides SQL Warehouses that enable data analysts to work with data using familiar relational SQL queries.

Lessons

  • Get started with SQL Warehouses
  • Create databases and tables
  • Create queries and dashboards

Exercise

  • Use a SQL Warehouse in Azure Databricks

Module:  Run Azure Databricks Notebooks with Azure Data Factory

Using pipelines in Azure Data Factory to run notebooks in Azure Databricks enables you to automate data engineering processes at cloud scale.

Lessons

  • Understand Azure Databricks notebooks and pipelines
  • Create a linked service for Azure Databricks
  • Use a Notebook activity in a pipeline
  • Use parameters in a notebook

Exercise

  • Run an Azure Databricks Notebook with Azure Data Factory

Prerequisites

None