Operationalizing LLMs on Azure (Coursera)

Offered by Duke University,
Operationalizing LLMs on Azure (Coursera)

This course is designed for individuals at both an intermediate and beginner level, including data scientists, AI enthusiasts, and professionals seeking to harness the power of Azure for Large Language Models (LLMs). Tailored for those with foundational programming experience and familiarity with Azure basics, this comprehensive program takes you through a four-week journey.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

In the first week, you'll delve into Azure's AI services and the Azure portal, gaining insights into large language models, their functionalities, and strategies for risk mitigation. Subsequent weeks cover practical applications, including leveraging Azure Machine Learning, managing GPU quotas, deploying models, and utilizing the Azure OpenAI Service. As you progress, the course explores nuanced query crafting, Semantic Kernel implementation, and advanced strategies for optimizing interactions with LLMs within the Azure environment. The final week focuses on architectural patterns, deployment strategies, and hands-on application building using RAG, Azure services, and GitHub Actions workflows. Whether you're a data professional or AI enthusiast, this course equips you with the skills to deploy, optimize, and build robust large-scale applications leveraging Azure and Large Language Models.
This course is part of the Large Language Model Operations (LLMOps) Specialization.

What you'll learn

  • Gain proficiency in leveraging Azure for deploying and managing Large Language Models (LLMs).
  • Develop advanced query crafting skills using Semantic Kernel to optimize interactions with LLMs within the Azure environment.
  • Acquire hands-on experience in implementing patterns and deploying applications with Retrieval Augmented Generation (RAG)

Syllabus

Introduction to LLMOps with Azure
This week, you will learn how to get started with Azure and its AI services through an introduction to the Azure portal, and key offerings like Azure Machine Learning. You will also gain an understanding of large language models, including how they work, their benefits and risks, and strategies for mitigating those risks. Finally, you will be introduced to options for discovering, evaluating, and deploying pre-trained LLMs in Azure, including leveraging prompt engineering for responsible data grounding.

LLMs with Azure
This week, you will learn to leverage Azure for Large Language Models (LLMs) by using Azure Machine Learning through its compute resources and managing GPU quotas and model deployments as well as Azure OpenAI Service. You will apply this knowledge by deploying a model and using its inference API using the Python programming language.

Extending with Functions and Plugins
This week, you will discover the art of crafting nuanced queries for Large Language Models (LLMs) in Azure through the implementation of Semantic Kernel. You will gain insights into refining prompts, understand the dynamics of using system prompts, and explore advanced strategies to optimize your interaction with LLMs. You will apply these techniques hands-on to enhance your proficiency in leveraging Semantic Kernel within the Azure environment.

Building an End-to-End LLM application in Azure
This week, you will explore architectural patterns and deployment of large language model applications. By studying RAG, Azure services, and GitHub Actions, you will learn how to build robust applications. You will apply your learning by implementing RAG with Azure search, creating GitHub Actions workflows, and deploying an end-to-end application.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

The AI Awakening: Implications for the Economy and Society (Coursera) Coursera
Stanford University

The AI Awakening: Implications for the Economy and Society (Coursera)

This course explores how the advances in artificial intelligence can and will transform our economy and society in the near future. You will hear insights from esteemed AI researchers and industry leaders in technology, economics, and business. The curriculum addresses the technological underpinnings of Generative AI, its profound implications for businesses and the broader economy, and the potential risks associated with AI-driven transformations in the workforce.

Oct 12th 2026
3 Weeks
Deploying Microservices to Kubernetes using Azure DevOps (Coursera) Coursera
Whizlabs

Deploying Microservices to Kubernetes using Azure DevOps (Coursera)

Kubernetes is open-source, and its container orchestration benefits enable automation of various tasks such as deployment, management, and scaling of container-based applications. Presently, you can find various cloud-based applications using Kubernetes workloads. Since the Azure cloud provides ease of running Kubernetes alongside ease of scalability and management of microservices with higher availability, it is one of the foremost choices of all enterprises for DevOps transformation. You can utilize the opportunity to improve your expertise in deploying microservices in Kubernetes and capitalize on many career options.

Oct 12th 2026
3 Weeks
Infrastructure Automation with Terraform (Coursera) Coursera
Whizlabs

Infrastructure Automation with Terraform (Coursera)

Terraform is one of the most recognized infrastructure automation tools that help in addressing various real-life challenges. Infrastructure automation is a reliable instrument for improving productivity, efficiency, and reduction of operational downtime for enterprises. As a result, you can gain better career opportunities with skills in infrastructure automation with Terraform.

Oct 12th 2026
5-12 Weeks
Technologies and platforms for Artificial Intelligence (Coursera) Coursera
Politecnico di Milano

Technologies and platforms for Artificial Intelligence (Coursera)

This course will address the hardware technologies for machine and deep learning (from the units of an Internet-of-Things system to a large-scale data centers) and will explore the families of machine and deep learning platforms (libraries and frameworks) for the design and development of smart applications and systems.

Oct 12th 2026
4 Weeks
Artificial Intelligence: An Overview (Coursera) Coursera
Politecnico di Milano

Artificial Intelligence: An Overview (Coursera)

The course will provide a non-technical overview of the artificial intelligence field. Initially, a discussion on the birth of AI is provided, remarking the seminal ideas and preliminary goals. Furthermore, the crucial weaknesses are presented and how these weaknesses have been circumvented. Then, the current state of AI is presented, in terms of goals, importance at national level, and strategies. Moreover, the taxonomy of the AI topics is presented.

Oct 12th 2026
5-12 Weeks
Quantization Fundamentals (Coursera) Coursera
DeepLearning.AI

Quantization Fundamentals (Coursera)

Generative AI models, like large language models, often exceed the capabilities of consumer-grade hardware and are expensive to run. Compressing models through methods such as quantization makes them more efficient, faster, and accessible. This allows them to run on a wide variety of devices, including smartphones, personal computers, and edge devices, and minimizes performance degradation.

Oct 12th 2026
1 Week
Designing Autonomous AI (Coursera) Coursera
University of Washington,Microsoft

Designing Autonomous AI (Coursera)

When children learn how to hit a baseball, they don’t start with fastballs. Their coaches begin with the basics: how to grip the handle of the bat, where to put their feet and how to keep their eyes on the ball. Similarly, an autonomous AI system needs a subject matter expert (SME) to break a complex process or problem into easier tasks that give the AI important clues about how to find a solution faster.

Oct 12th 2026
4 Weeks
GenAI for Everyone (Coursera) Coursera
Coursera Instructor Network

GenAI for Everyone (Coursera)

This course offers a foundational journey into the world of Generative AI (GenAI), setting the stage for a comprehensive learning path that delves into the nuanced, role-specific applications of AI. Designed to equip learners with essential GenAI knowledge, this primer is the perfect starting point before progressing through a series of courses tailored to various job functions and roles.

Oct 12th 2026
1 Week
Llama for Python Programmers (Coursera) Coursera
University of Michigan

Llama for Python Programmers (Coursera)

Llama for Python Programmers is designed for programmers who want to leverage the Llama 2 large language model (LLM) and take advantage of the generative artificial intelligence (AI) revolution. In this course, you’ll learn how open-source LLMs can run on self-hosted hardware, made possible through techniques such as quantization by using the llama.cpp package.

Oct 12th 2026
3 Weeks