Microsoft Azure Databricks for Data Engineering (Coursera)

Offered by Microsoft,
Microsoft Azure Databricks for Data Engineering (Coursera)

In this course, you will learn how to harness the power of Apache Spark and powerful clusters running on the Azure Databricks platform to run large data engineering workloads in the cloud. You will discover the capabilities of Azure Databricks and the Apache Spark notebook for processing huge files. You will come to understand the Azure Databricks platform and identify the types of tasks well-suited for Apache Spark.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

You will also be introduced to the architecture of an Azure Databricks Spark Cluster and Spark Jobs. You will work with large amounts of data from multiple sources in different raw formats. you will learn how Azure Databricks supports day-to-day data-handling functions, such as reads, writes, and queries.
This course is part of a Specialization intended for Data engineers and developers who want to demonstrate their expertise in designing and implementing data solutions that use Microsoft Azure data services for anyone interested in preparing for the Exam DP-203: Data Engineering on Microsoft Azure (beta). You will take a practice exam that covers key skills measured by the certification exam.
This is the eighth course in a program of 10 courses to help prepare you to take the exam so that you can have expertise in designing and implementing data solutions that use Microsoft Azure data services. The Data Engineering on Microsoft Azure exam is an opportunity to prove knowledge expertise in integrating, transforming, and consolidating data from various structured and unstructured data systems into structures that are suitable for building analytics solutions that use Microsoft Azure data services. Each course teaches you the concepts and skills that are measured by the exam.
By the end of this Specialization, you will be ready to take and sign-up for the Exam DP-203: Data Engineering on Microsoft Azure (beta).

Course 8 of 10 in the Microsoft Azure Data Engineering Associate DP-203 Exam Prep Specialization

Syllabus

WEEK 1
Introduction to Azure Databricks
Describe the capabilities of Azure Databricks and the Apache Spark notebook for processing huge files. Describe the Azure Databricks platform and identify the types of tasks well-suited for Apache Spark. Describe the architecture of an Azure Databricks Spark Cluster and Spark Jobs.

WEEK 2
Read and write data in Azure Databricks
Describe how to use Azure Databricks supports day-to-day data-handling functions, such as reads, writes, and queries.

WEEK 3
Data processing in Azure Databricks
Process data in Azure Databricks by defining DataFrames to read and process the Data. Perform data transformations in DataFrames and execute actions to display the transformed data. Explain the difference between a transform and an action, lazy and eager evaluations, Wide and Narrow transformations, and other optimizations in Azure Databricks.

WEEK 4
Work with DataFrames in Azure Databricks
Use the DataFrame Column Class Azure Databricks to apply column-level transformations, such as sorts, filters and aggregations. Use advanced DataFrame functions operations to manipulate data, apply aggregates, and perform date and time operations in Azure Databricks.

WEEK 5
Platform architecture, security, and data protection in Azure Databricks
Describe the Azure Databricks platform architecture and how it is securedUse Azure Key Vault to store secrets used by Azure Databricks and other services. Access Azure Storage with Key Vault-based secrets

WEEK 6
Delta Lake
Describe how to use Delta Lake to create, append, and upsert data to Apache Spark tables, taking advantage of built-in reliability and optimizations. Describe Azure Databricks Delta Lake architecture

WEEK 7
Analyze streaming data and create production workloads
Process streaming data with Azure Databricks structured streaming. Create production workloads on Azure Databricks with Azure Data Factory.

WEEK 8
Create a data architecture
Describe how to put Azure Databricks notebooks under version control in an Azure DevOps repo and build deployment pipelines to manage your release process. Describe how to integrate Azure Databricks with Azure Synapse Analytics as part of your data architecture. Describe best practices for workspace administration, security, tools, integration, databricks runtime, HA/DR, and clusters in Azure Databricks

WEEK 9
Practice Exam on Data engineering with Azure Databricks
Prepare for the Microsoft Certified: Azure Data Engineer Associate exam

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Machine Learning With Big Data (Coursera) Coursera
University of California, San Diego

Machine Learning With Big Data (Coursera)

Want to make sense of the volumes of data you have collected? Need to incorporate data-driven decisions into your process? This course provides an overview of machine learning techniques to explore, analyze, and leverage data. You will be introduced to tools and algorithms you can use to create machine learning models that learn from data, and to scale those models up to big data problems.

Oct 26th 2026
5-12 Weeks
Learn SQL with Databricks (Coursera) Coursera
Edureka

Learn SQL with Databricks (Coursera)

Welcome to the Learn SQL with Databricks course, where you'll embark on a journey to acquire essential skills in database management, data analysis, and advanced data manipulation techniques. This course is meticulously designed to guide you through the intricacies of SQL, leveraging the powerful and versatile Databricks platform.

Oct 26th 2026
5-12 Weeks
Microsoft Azure Management Tools and Security Solutions (Coursera) Coursera
Microsoft

Microsoft Azure Management Tools and Security Solutions (Coursera)

Microsoft Azure offers a wide range of services to deploy your applications. To keep control of your environment and to make deployments easier, it also offers a wide array of management tools and services. In this course, you will be introduced to these tools and services and you will be asked to help choose the best one for a given business scenario.

Oct 26th 2026
4 Weeks
Preparing for the AZ-900 Microsoft Azure Fundamentals Exam (Coursera) Coursera
Microsoft

Preparing for the AZ-900 Microsoft Azure Fundamentals Exam (Coursera)

Microsoft certifications give you a professional advantage by providing globally recognized and industry-endorsed evidence of mastering skills in digital and cloud businesses. In this course, you will prepare for the AZ-900 Microsoft Azure Fundamentals exam. You will refresh your knowledge of cloud concepts, Microsoft Azure services, Microsoft Azure workloads, security and privacy in Microsoft Azure, as well as Microsoft Azure pricing and support. in short, you will recap all the core concepts and skills that are measured by the exam.

Oct 26th 2026
5-12 Weeks
Azure: Security Operations Management (Coursera) Coursera
Whizlabs

Azure: Security Operations Management (Coursera)

Azure: Security Operations Management Course is the fourth course of the Exam Prep AZ-500: Microsoft Azure Security Engineer Associate Specialization. This course is designed to describe the concepts of Managing Security operations related to multiple Azure services. In This course, you will how to Plan, implement, and manage governance for security, how to Manage security posture by using Microsoft Defender for Cloud, Configuration, and management of threat protection by using Microsoft Defender for Cloud, Configuration, and management of security monitoring and automation solutions.

Oct 26th 2026
3 Weeks
Prepare for DP-100: Data Science on Microsoft Azure Exam (Coursera) Coursera
Microsoft

Prepare for DP-100: Data Science on Microsoft Azure Exam (Coursera)

Microsoft certifications give you a professional advantage by providing globally recognized and industry-endorsed evidence of mastering skills in digital and cloud businesses. In this course, you will prepare to take the DP-100 Azure Data Scientist Associate certification exam. You will refresh your knowledge of how to plan and create a suitable working environment for data science workloads on Azure, run data experiments, and train predictive models. In addition, you will recap on how to manage, optimize, and deploy machine learning models into production.

Oct 26th 2026
5-12 Weeks
Preparing for AI-900: Microsoft Azure AI Fundamentals exam (Coursera) Coursera
Microsoft

Preparing for AI-900: Microsoft Azure AI Fundamentals exam (Coursera)

Microsoft certifications give you a professional advantage by providing globally recognized and industry-endorsed evidence of mastering skills in digital and cloud businesses. In this course, you will prepare to take the AI-900 Microsoft Azure AI Fundamentals certification exam. You will refresh your knowledge of fundamental principles of machine learning on Microsoft Azure. You will go back over the main consideration of AI workloads and the features of computer vision, Natural Language Processing (NLP), and conversational AI workloads on Azure. In short, you will recap all the core concepts and skills that are measured by the exam.

Oct 26th 2026
4 Weeks
Artificial Intelligence on Microsoft Azure (Coursera) Coursera
Microsoft

Artificial Intelligence on Microsoft Azure (Coursera)

Whether you're just beginning to work with Artificial Intelligence (AI) or you already have AI experience and are new to Microsoft Azure, this course provides you with everything you need to get started. Artificial Intelligence (AI) empowers amazing new solutions and experiences; and Microsoft Azure provides easy to use services to help you build solutions that seemed like science fiction a short time ago; enabling incredible advances in health care, financial management, environmental protection, and other areas to make a better world for everyone.

Oct 19th 2026
1 Week
Big Data Analysis with Scala and Spark (Scala 2 version) (Coursera) Coursera
École Polytechnique Fédérale de Lausanne

Big Data Analysis with Scala and Spark (Scala 2 version) (Coursera)

Manipulating big data distributed over a cluster using functional concepts is rampant in industry, and is arguably one of the first widespread industrial uses of functional ideas. This is evidenced by the popularity of MapReduce and Hadoop, and most recently Apache Spark, a fast, in-memory distributed collections framework written in Scala. In this course, we'll see how the data parallel paradigm can be extended to the distributed case, using Spark throughout.

Nov 9th 2026
4 Weeks