Optimize ML Models and Deploy Human-in-the-Loop Pipelines (Coursera)

Offered by DeepLearning.AI, AWS,
Optimize ML Models and Deploy Human-in-the-Loop Pipelines (Coursera)

In the third course of the Practical Data Science Specialization, you will learn a series of performance-improvement and cost-reduction techniques to automatically tune model accuracy, compare prediction performance, and generate new training data with human intelligence. After tuning your text classifier using Amazon SageMaker Hyper-parameter Tuning (HPT), you will deploy two model candidates into an A/B test to compare their real-time prediction performance and automatically scale the winning model using Amazon SageMaker Hosting.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

Lastly, you will set up a human-in-the-loop pipeline to fix misclassified predictions and generate new training data using Amazon Augmented AI and Amazon SageMaker Ground Truth.
Practical data science is geared towards handling massive datasets that do not fit in your local hardware and could originate from multiple sources. One of the biggest benefits of developing and running data science projects in the cloud is the agility and elasticity that the cloud offers to scale up and out at a minimum cost.
The Practical Data Science Specialization helps you develop the practical skills to effectively deploy your data science projects and overcome challenges at each step of the ML workflow using Amazon SageMaker. This Specialization is designed for data-focused developers, scientists, and analysts familiar with the Python and SQL programming languages and want to learn how to build, train, and deploy scalable, end-to-end ML pipelines - both automated and human-in-the-loop - in the AWS cloud.

Course 3 of 3 in the Practical Data Science Specialization

Syllabus

WEEK 1
Advanced model training, tuning and evaluation
Train, tune, and evaluate models using data-parallel and model-parallel strategies and automatic model tuning.

WEEK 2
Advanced model deployment and monitoring
Deploy models with A/B testing, monitor model performance, and detect drift from baseline metrics.

WEEK 3
Data labeling and human-in-the-loop pipelines
Label data at scale using private human workforces and build human-in-the-loop pipelines.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Machine Learning Foundations for Product Managers (Coursera) Coursera
Duke University

Machine Learning Foundations for Product Managers (Coursera)

In this first course of the AI Product Management Specialization offered by Duke University's Pratt School of Engineering, you will build a foundational understanding of what machine learning is, how it works and when and why it is applied. To successfully manage an AI team or product and work collaboratively with data scientists, software engineers, and customers you need to understand the basics of machine learning technology.

Nov 9th 2026
5-12 Weeks
Machine Learning Operations 1 (MLOps1-AML): Deploying AI & ML Models in Production using Microsoft Azure Machine Learning (AML) (edX) EdX
Statistics.comX,Statistics.com

Machine Learning Operations 1 (MLOps1-AML): Deploying AI & ML Models in Production using Microsoft Azure Machine Learning (AML) (edX)

Most data science projects fail. There are various reasons why, but one of the primary reasons is the challenge of deployment. One piece to the deployment puzzle is understanding how data engineers can effectively work with data scientists to monitor and iterate on model performance, which is why we developed this course: Machine Learning Ops (MLOps1) - Deploying AI & ML Models in Production using Microsoft Azure Machine Learning (AML).

Self Paced
Self-Paced
Business Analytics Using Forecasting (FutureLearn) FutureLearn
National Tsing Hua University

Business Analytics Using Forecasting (FutureLearn)

Discover how business can harness the power of big data to make better predictive analysis. Learn how to use data to create powerful business forecasts. Organisations currently collect a vast quantity of data about suppliers, clients, employees, citizens, transactions, and much more. However, many are unaware of the predictive power this ‘big data’ has if anaylsed correctly. On this course, you’ll learn about forecasting using big data, exploring how it’s used by business as an important component of decision making.

Self Paced
5-12 Weeks
Digital Marketing Analytics: Tools and Techniques (edX) EdX
University of Maryland, College Park,University System of Maryland - USM,USMx,UMD

Digital Marketing Analytics: Tools and Techniques (edX)

Learn how to leverage leading tools and approaches to digital marketing data analysis. Dive into SEO and SEM strategies including web analytics, machine learning and AI/Big Data applications to strengthen your digital marketing efforts and leverage your resources most effectively.

Self Paced
Self-Paced
Understanding Data Science (DataCamp) DataCamp
DataCamp

Understanding Data Science (DataCamp)

An introduction to data science with no coding involved. What is data science, why is it so popular, and why did the Harvard Business Review hail it as the “sexiest job of the 21st century”? In this non-technical course, you’ll be introduced to everything you were ever too afraid to ask about this fast-growing and exciting field, without needing to write a single line of code.

Self Paced
Self-Paced
Introduction to Machine Learning in Production (Coursera) Coursera
DeepLearning.AI

Introduction to Machine Learning in Production (Coursera)

In the first course of Machine Learning Engineering for Production Specialization, you will identify the various components and design an ML production system end-to-end: project scoping, data needs, modeling strategies, and deployment constraints and requirements; and learn how to establish a model baseline, address concept drift, and prototype the process for developing, deploying, and continuously improving a productionized ML application.

Jul 6th 2026
3 Weeks
The Business of Social (Coursera) Coursera
Northwestern University

The Business of Social (Coursera)

In a 2014 study of CEOs and CMOs, IBM found 63% wanted social strategies which generate business metrics while only 20% of businesses worldwide actually have them. This means strategies which not only grow your company’s social footprint but link to your sales and marketing systems. With this critical linkage, your social and mobile strategies will provide you with the ability to engage consumers at a 1-to-1 level and measure your social investments in terms of costs, revenues, profits and ROI. In this fifth MOOC of the Social Marketing Specialization - "The Business of Social" - you will learn how to transform your organization's social marketing from an untracked investment to an integral part of your company’s marketing strategy.

Nov 9th 2026
4 Weeks
Optimización de Redes Neuronales Profundas (Coursera) Coursera
Universidad Austral

Optimización de Redes Neuronales Profundas (Coursera)

Este curso se centrará en la optimización de Redes Neuronales Profundas, cambiando la idea de que todo el proceso es una “caja negra”. Comprenderá qué impulsa el rendimiento y podrá obtener mejores resultados de manera más sistemática. Entenderá cómo optimizar los principales Hiperparámetros y su implementación. Además, aprenderá nuevos conceptos útiles para el entrenamiento de las redes como los mini-batch y las regularizaciones. También, aprenderá a implementar una red neuronal utilizando TensorFlow

Nov 23rd 2026
3 Weeks
Data Wrangling, Analysis and AB Testing with SQL (Coursera) Coursera
University of California, Davis

Data Wrangling, Analysis and AB Testing with SQL (Coursera)

This course allows you to apply the SQL skills taught in “SQL for Data Science” to four increasingly complex and authentic data science inquiry case studies. We'll learn how to convert timestamps of all types to common formats and perform date/time calculations. We'll select and perform the optimal JOIN for a data science inquiry and clean data within an analysis dataset by deduping, running quality checks, backfilling, and handling nulls.

Jun 29th 2026
4 Weeks