Optimize ML Models and Deploy Human-in-the-Loop Pipelines (Coursera)

Offered by DeepLearning.AI, AWS,
Optimize ML Models and Deploy Human-in-the-Loop Pipelines (Coursera)

In the third course of the Practical Data Science Specialization, you will learn a series of performance-improvement and cost-reduction techniques to automatically tune model accuracy, compare prediction performance, and generate new training data with human intelligence. After tuning your text classifier using Amazon SageMaker Hyper-parameter Tuning (HPT), you will deploy two model candidates into an A/B test to compare their real-time prediction performance and automatically scale the winning model using Amazon SageMaker Hosting.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

Lastly, you will set up a human-in-the-loop pipeline to fix misclassified predictions and generate new training data using Amazon Augmented AI and Amazon SageMaker Ground Truth.
Practical data science is geared towards handling massive datasets that do not fit in your local hardware and could originate from multiple sources. One of the biggest benefits of developing and running data science projects in the cloud is the agility and elasticity that the cloud offers to scale up and out at a minimum cost.
The Practical Data Science Specialization helps you develop the practical skills to effectively deploy your data science projects and overcome challenges at each step of the ML workflow using Amazon SageMaker. This Specialization is designed for data-focused developers, scientists, and analysts familiar with the Python and SQL programming languages and want to learn how to build, train, and deploy scalable, end-to-end ML pipelines - both automated and human-in-the-loop - in the AWS cloud.

Course 3 of 3 in the Practical Data Science Specialization

Syllabus

WEEK 1
Advanced model training, tuning and evaluation
Train, tune, and evaluate models using data-parallel and model-parallel strategies and automatic model tuning.

WEEK 2
Advanced model deployment and monitoring
Deploy models with A/B testing, monitor model performance, and detect drift from baseline metrics.

WEEK 3
Data labeling and human-in-the-loop pipelines
Label data at scale using private human workforces and build human-in-the-loop pipelines.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Data Wrangling, Analysis and AB Testing with SQL (Coursera) Coursera
University of California, Davis

Data Wrangling, Analysis and AB Testing with SQL (Coursera)

This course allows you to apply the SQL skills taught in “SQL for Data Science” to four increasingly complex and authentic data science inquiry case studies. We'll learn how to convert timestamps of all types to common formats and perform date/time calculations. We'll select and perform the optimal JOIN for a data science inquiry and clean data within an analysis dataset by deduping, running quality checks, backfilling, and handling nulls.

Jun 29th 2026
4 Weeks
Medir y optimizar campañas de marketing en redes sociales (Coursera) Coursera
Facebook

Medir y optimizar campañas de marketing en redes sociales (Coursera)

Este curso te proporcionará las habilidades para optimizar tus acciones de marketing en redes sociales. Aprende a evaluar e interpretar los resultados de tus campañas publicitarias. Aprende a evaluar la efectividad de la publicidad a través de estudios de mejora y optimiza tus campañas con pruebas divididas. Comprende cómo la efectividad de la publicidad se mide en todas las plataformas y dispositivos, aprende a evaluar el ROI de tu actividad de marketing y perfecciona el modo de comunicar tus resultados de marketing en redes sociales a otros en la empresa.

Jan 13th 2025
4 Weeks
Digital Marketing Analytics: Tools and Techniques (edX) EdX
University of Maryland, College Park,University System of Maryland - USM,USMx,UMD

Digital Marketing Analytics: Tools and Techniques (edX)

Learn how to leverage leading tools and approaches to digital marketing data analysis. Dive into SEO and SEM strategies including web analytics, machine learning and AI/Big Data applications to strengthen your digital marketing efforts and leverage your resources most effectively.

Self Paced
Self-Paced
Machine Learning Operations 1 (MLOps1-AWS): Deploying AI & ML Models in Production using Amazon Web Services (AWS) (edX) EdX
Statistics.comX,Statistics.com

Machine Learning Operations 1 (MLOps1-AWS): Deploying AI & ML Models in Production using Amazon Web Services (AWS) (edX)

Most data science projects fail. There are various reasons why, but one of the primary reasons is the challenge of deployment. One piece to the deployment puzzle is understanding how data engineers can effectively work with data scientists to monitor and iterate on model performance, which is why we developed this course: Machine Learning Operations 1 (MLOps1): Deploying AI & ML Models in Production using Amazon Web Services (AWS).

Self Paced
Self-Paced
Business Analytics Using Forecasting (FutureLearn) FutureLearn
National Tsing Hua University

Business Analytics Using Forecasting (FutureLearn)

Discover how business can harness the power of big data to make better predictive analysis. Learn how to use data to create powerful business forecasts. Organisations currently collect a vast quantity of data about suppliers, clients, employees, citizens, transactions, and much more. However, many are unaware of the predictive power this ‘big data’ has if anaylsed correctly. On this course, you’ll learn about forecasting using big data, exploring how it’s used by business as an important component of decision making.

Self Paced
5-12 Weeks
Understanding Data Science (DataCamp) DataCamp
DataCamp

Understanding Data Science (DataCamp)

An introduction to data science with no coding involved. What is data science, why is it so popular, and why did the Harvard Business Review hail it as the “sexiest job of the 21st century”? In this non-technical course, you’ll be introduced to everything you were ever too afraid to ask about this fast-growing and exciting field, without needing to write a single line of code.

Self Paced
Self-Paced
Introduction to Machine Learning in Production (Coursera) Coursera
DeepLearning.AI

Introduction to Machine Learning in Production (Coursera)

In the first course of Machine Learning Engineering for Production Specialization, you will identify the various components and design an ML production system end-to-end: project scoping, data needs, modeling strategies, and deployment constraints and requirements; and learn how to establish a model baseline, address concept drift, and prototype the process for developing, deploying, and continuously improving a productionized ML application.

Jul 6th 2026
3 Weeks
Build, Train, and Deploy ML Pipelines using BERT (Coursera) Coursera
DeepLearning.AI,AWS

Build, Train, and Deploy ML Pipelines using BERT (Coursera)

In the second course of the Practical Data Science Specialization, you will learn to automate a natural language processing task by building an end-to-end machine learning pipeline using Hugging Face’s highly-optimized implementation of the state-of-the-art BERT algorithm with Amazon SageMaker Pipelines. Your pipeline will first transform the dataset into BERT-readable features and store the features in the Amazon SageMaker Feature Store. It will then fine-tune a text classification model to the dataset using a Hugging Face pre-trained model, which has learned to understand the human language from millions of Wikipedia documents.

Mar 25th 2024
3 Weeks
Experimentation for Improvement (Coursera) Coursera
McMaster University

Experimentation for Improvement (Coursera)

We are always using experiments to improve our lives, our community, and our work. Are you doing it efficiently? Or are you (incorrectly) changing one thing at a time and hoping for the best? In this course, you will learn how to plan efficient experiments - testing with many variables. Our goal is to find the best results using only a few experiments. A key part of the course is how to optimize a system.

Oct 12th 2026
5-12 Weeks
The Business of Social (Coursera) Coursera
Northwestern University

The Business of Social (Coursera)

In a 2014 study of CEOs and CMOs, IBM found 63% wanted social strategies which generate business metrics while only 20% of businesses worldwide actually have them. This means strategies which not only grow your company’s social footprint but link to your sales and marketing systems. With this critical linkage, your social and mobile strategies will provide you with the ability to engage consumers at a 1-to-1 level and measure your social investments in terms of costs, revenues, profits and ROI. In this fifth MOOC of the Social Marketing Specialization - "The Business of Social" - you will learn how to transform your organization's social marketing from an untracked investment to an integral part of your company’s marketing strategy.

Sep 28th 2026
4 Weeks