Operationalizing LLMs on Azure (Coursera)

Offered by Duke University,
Operationalizing LLMs on Azure (Coursera)

This course is designed for individuals at both an intermediate and beginner level, including data scientists, AI enthusiasts, and professionals seeking to harness the power of Azure for Large Language Models (LLMs). Tailored for those with foundational programming experience and familiarity with Azure basics, this comprehensive program takes you through a four-week journey.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

In the first week, you'll delve into Azure's AI services and the Azure portal, gaining insights into large language models, their functionalities, and strategies for risk mitigation. Subsequent weeks cover practical applications, including leveraging Azure Machine Learning, managing GPU quotas, deploying models, and utilizing the Azure OpenAI Service. As you progress, the course explores nuanced query crafting, Semantic Kernel implementation, and advanced strategies for optimizing interactions with LLMs within the Azure environment. The final week focuses on architectural patterns, deployment strategies, and hands-on application building using RAG, Azure services, and GitHub Actions workflows. Whether you're a data professional or AI enthusiast, this course equips you with the skills to deploy, optimize, and build robust large-scale applications leveraging Azure and Large Language Models.
This course is part of the Large Language Model Operations (LLMOps) Specialization.

What you'll learn

  • Gain proficiency in leveraging Azure for deploying and managing Large Language Models (LLMs).
  • Develop advanced query crafting skills using Semantic Kernel to optimize interactions with LLMs within the Azure environment.
  • Acquire hands-on experience in implementing patterns and deploying applications with Retrieval Augmented Generation (RAG)

Syllabus

Introduction to LLMOps with Azure
This week, you will learn how to get started with Azure and its AI services through an introduction to the Azure portal, and key offerings like Azure Machine Learning. You will also gain an understanding of large language models, including how they work, their benefits and risks, and strategies for mitigating those risks. Finally, you will be introduced to options for discovering, evaluating, and deploying pre-trained LLMs in Azure, including leveraging prompt engineering for responsible data grounding.

LLMs with Azure
This week, you will learn to leverage Azure for Large Language Models (LLMs) by using Azure Machine Learning through its compute resources and managing GPU quotas and model deployments as well as Azure OpenAI Service. You will apply this knowledge by deploying a model and using its inference API using the Python programming language.

Extending with Functions and Plugins
This week, you will discover the art of crafting nuanced queries for Large Language Models (LLMs) in Azure through the implementation of Semantic Kernel. You will gain insights into refining prompts, understand the dynamics of using system prompts, and explore advanced strategies to optimize your interaction with LLMs. You will apply these techniques hands-on to enhance your proficiency in leveraging Semantic Kernel within the Azure environment.

Building an End-to-End LLM application in Azure
This week, you will explore architectural patterns and deployment of large language model applications. By studying RAG, Azure services, and GitHub Actions, you will learn how to build robust applications. You will apply your learning by implementing RAG with Azure search, creating GitHub Actions workflows, and deploying an end-to-end application.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Data Processing with Azure (Coursera) Coursera
LearnQuest

Data Processing with Azure (Coursera)

This Azure training course is designed to equip students with the knowledge need to process, store and analyze data for making informed business decisions. Through this Azure course, the student will understand what big data is along with the importance of big data analytics, which will improve the students mathematical and programming skills. Students will learn the most effective method of using essential analytical tools such as Python, R, and Apache Spark.

Nov 16th 2026
3 Weeks
General AI Mastery Toolbox: Master AI and Drive Success (Coursera) Coursera
Coursera Instructor Network

General AI Mastery Toolbox: Master AI and Drive Success (Coursera)

General Artificial Intelligence (AI) has proven its value in the business world with its multiple uses. The various applications of AI have proved to be of increasing value to businesses in their ability to meet customer demand with efficiency and creativity. To remain in sync with the direction of business entities, individuals need a tool kit to assist them as they master this technology.

Nov 23rd 2026
1 Week
Frontiers in Dentistry (Coursera) Coursera
University of Pennsylvania

Frontiers in Dentistry (Coursera)

In this course, Frontiers in Dentistry, you will be able to explore some of the latest advances in the field of dental medicine. The innovations in therapeutic techniques as well as our understanding of the biomedical sciences have been made possible by our research enterprise which integrates the latest emerging technology along with interdisciplinary collaborations.

Nov 23rd 2026
5-12 Weeks
Math for AI beginner part 1 Linear Algebra (Coursera) Coursera
Korea Advanced Institute of Science and Technology - KAIST

Math for AI beginner part 1 Linear Algebra (Coursera)

'Learn concept of AI such as machine learning, deep-learning, support vector machine which is related to linear algebra. Learn how to use linear algebra for AI algorithm. After completing this course, you are able to understand AI algorithm and basics of linear algebra for AI applications.

Nov 23rd 2026
5-12 Weeks
Generative AI for the Resilient Pricer (Coursera) Coursera
Dartmouth College

Generative AI for the Resilient Pricer (Coursera)

In this course we’ll address the concept of leveraging Gen-AI in various economic and operational circumstances to rapidly generate pricing insights. Disruption occurs at an ever-increasing pace, driving imperfect information, limited response time, and competing priorities. The commercial excellence discipline is one that requires a holistic approach to delivering results, and those who complete this course will come away with the understanding necessary to determine where to focus for maximum effect.

Nov 23rd 2026
4 Weeks
Google Cloud Product Fundamentals en Español (Coursera) Coursera
Google Cloud

Google Cloud Product Fundamentals en Español (Coursera)

Este curso, que es una continuación de Business Transformation with Google Cloud, le permitirá conocer la perspectiva tecnológica de la transformación de una organización. Para ser más específicos, explicaremos cómo la tecnología de Google Cloud puede transformar digitalmente una organización en los siguientes aspectos: modernizar la infraestructura de TI; mejorar la forma en que los equipos desarrollan las aplicaciones que utiliza la empresa; saber cómo aprovechar el aprendizaje automático y la inteligencia artificial para generar más valor; advertir el rol fundamental de las herramientas de productividad basadas en la nube, como G Suite, para cumplir con el trabajo, y comprender los desafíos y las oportunidades de la administración de costos que trae aparejados una infraestructura de TI cambiante basada en la nube.

Nov 23rd 2026
5-12 Weeks
Ethical Issues in Data Science (Coursera) Coursera
University of Colorado Boulder

Ethical Issues in Data Science (Coursera)

Computing applications involving large amounts of data – the domain of data science – impact the lives of most people in the U.S. and the world. These impacts include recommendations made to us by internet-based systems, information that is available about us online, techniques that are used for security and surveillance, data that is used in health care, and many more. In many cases, they are affected by techniques in artificial intelligence and machine learning.

Nov 23rd 2026
5-12 Weeks
New Technologies for Business Leaders (Coursera) Coursera
Rutgers University

New Technologies for Business Leaders (Coursera)

This introductory course is developed for high-level business people (and those on their way) who want a broad understanding of new Information Technologies and understand their potential for business functions (e.g. marketing, supply change management, finance). This is not a course for people looking for guidance on how to become a deep technical expert or implement these technologies.

Nov 23rd 2026
5-12 Weeks
Machine Learning for All (Coursera) Coursera
University of London

Machine Learning for All (Coursera)

Machine Learning, often called Artificial Intelligence or AI, is one of the most exciting areas of technology at the moment. We see daily news stories that herald new breakthroughs in facial recognition technology, self driving cars or computers that can have a conversation just like a real person. Machine Learning technology is set to revolutionise almost any area of human life and work, and so will affect all our lives, and so you are likely to want to find out more about it.

Nov 16th 2026
4 Weeks
Amazon Bedrock - Getting Started (Coursera) Coursera
AWS

Amazon Bedrock - Getting Started (Coursera)

Amazon Bedrock is a fully managed service that makes foundation models (FMs) from Amazon and leading artificial intelligence (AI) startups available through an API. In this course, you will learn the benefits of Amazon Bedrock. You will learn how to start using the service through a demonstration in the Amazon Bedrock console. You will also learn about the AI concepts of Amazon Bedrock and how you can use the service to accelerate development of generative AI applications.

Nov 23rd 2026
1 Week
Artificial Intelligence: Ethics & Societal Challenges (Coursera) Coursera
Lund University

Artificial Intelligence: Ethics & Societal Challenges (Coursera)

Artificial Intelligence: Ethics & Societal Challenges is a four-week course that explores ethical and societal aspects of the increasing use of artificial intelligent technologies (AI). The aim of the course is to raise awareness of ethical and societal aspects of AI and to stimulate reflection and discussion upon implications of the use of AI in society.

Nov 16th 2026
4 Weeks