Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization (Coursera)

Offered by DeepLearning.AI,
Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization (Coursera)

This course will teach you the "magic" of getting deep learning to work well. Rather than the deep learning process being a black box, you will understand what drives performance, and be able to more systematically get good results. You will also learn TensorFlow.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

After 3 weeks, you will:

  • Understand industry best-practices for building deep learning applications.
  • Be able to effectively use the common neural network "tricks", including initialization, L2 and dropout regularization, Batch normalization, gradient checking,
  • Be able to implement and apply a variety of optimization algorithms, such as mini-batch gradient descent, Momentum, RMSprop and Adam, and check for their convergence.
  • Understand new best-practices for the deep learning era of how to set up train/dev/test sets and analyze bias/variance
  • Be able to implement a neural network in TensorFlow.

Course 2 of 5 in the Deep Learning Specialization.

Syllabus

WEEK 1: Practical aspects of Deep Learning
WEEK 2: Optimization algorithms
WEEK 3: Hyperparameter tuning, Batch Normalization and Programming Frameworks

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Introduction to Vertex AI (Coursera) Coursera
Fractal Analytics

Introduction to Vertex AI (Coursera)

Welcome to "Introduction to Vertex AI"! In this concise yet impactful microlearning course spanning around 4 hours, we're diving into the world of Vertex AI to equip you with fundamental insights and practical skills. We'll unravel the essentials of Vertex AI, guiding you through the interface to empower you to navigate this powerful platform seamlessly. Get ready to grasp strategic insights that will enable you to effectively harness the capabilities of Vertex AI in your projects.

Sep 28th 2026
2 Weeks
Cloud: Platform as a Service - Master's (Coursera) Coursera
Illinois Tech

Cloud: Platform as a Service - Master's (Coursera)

This course is aimed at preparing individuals to gain knowledge, skills, and abilities to demonstrate the knowledge for managing Platform as a Service (PaaS) in the Cloud. Students will learn to deploy, operate, and maintain cloud platforms for storing, processing, and transferring information with architecture design principles and a structured approach. Students will also learn the shared responsibility model and cloud security best practices to secure PaaS platforms for the application-hosting environments.

Sep 28th 2026
5-12 Weeks
Preparing for the Google Cloud Professional Data Engineer Exam em Português Brasileiro (Coursera) Coursera
Google Cloud

Preparing for the Google Cloud Professional Data Engineer Exam em Português Brasileiro (Coursera)

Por que fazer o curso: "A melhor forma de se preparar para o exame é ser competente nas habilidades necessárias ao trabalho." Este curso usa uma abordagem "top-down". Ele identifica as habilidades que você já tem e apresenta novas informações e áreas para ampliar seus conhecimentos. Use este curso para criar seu plano de preparação personalizado. Ele ajudará você a identificar o que sabe e o que precisa estudar mais, além de desenvolver e praticar as habilidades necessárias às competências do cargo.

Sep 28th 2026
1 Week
Ethical Issues in Data Science (Coursera) Coursera
University of Colorado Boulder

Ethical Issues in Data Science (Coursera)

Computing applications involving large amounts of data – the domain of data science – impact the lives of most people in the U.S. and the world. These impacts include recommendations made to us by internet-based systems, information that is available about us online, techniques that are used for security and surveillance, data that is used in health care, and many more. In many cases, they are affected by techniques in artificial intelligence and machine learning.

Sep 28th 2026
5-12 Weeks
Approximation Algorithms Part II (Coursera) Coursera
École normale supérieure

Approximation Algorithms Part II (Coursera)

This is the continuation of Approximation algorithms, Part 1. Here you will learn linear programming duality applied to the design of some approximation algorithms, and semidefinite programming applied to Maxcut. By taking the two parts of this course, you will be exposed to a range of problems at the foundations of theoretical computer science, and to powerful design and analysis techniques.

Sep 28th 2026
4 Weeks
Approximation Algorithms Part I (Coursera) Coursera
École normale supérieure

Approximation Algorithms Part I (Coursera)

How efficiently can you pack objects into a minimum number of boxes? How well can you cluster nodes so as to cheaply separate a network into components around a few centers? These are examples of NP-hard combinatorial optimization problems. It is most likely impossible to solve such problems efficiently, so our aim is to give an approximate solution that can be computed in polynomial time and that at the same time has provable guarantees on its cost relative to the optimum.

Sep 28th 2026
5-12 Weeks
Google Cloud Product Fundamentals en Español (Coursera) Coursera
Google Cloud

Google Cloud Product Fundamentals en Español (Coursera)

Este curso, que es una continuación de Business Transformation with Google Cloud, le permitirá conocer la perspectiva tecnológica de la transformación de una organización. Para ser más específicos, explicaremos cómo la tecnología de Google Cloud puede transformar digitalmente una organización en los siguientes aspectos: modernizar la infraestructura de TI; mejorar la forma en que los equipos desarrollan las aplicaciones que utiliza la empresa; saber cómo aprovechar el aprendizaje automático y la inteligencia artificial para generar más valor; advertir el rol fundamental de las herramientas de productividad basadas en la nube, como G Suite, para cumplir con el trabajo, y comprender los desafíos y las oportunidades de la administración de costos que trae aparejados una infraestructura de TI cambiante basada en la nube.

Sep 28th 2026
5-12 Weeks
Algorithms, Part I (Coursera) Coursera
Princeton University

Algorithms, Part I (Coursera)

This course covers the essential information that every serious programmer needs to know about algorithms and data structures, with emphasis on applications and scientific performance analysis of Java implementations. Part I covers elementary data structures, sorting, and searching algorithms. Part II focuses on graph- and string-processing algorithms.

Sep 21st 2026
5-12 Weeks
Operations Research (2): Optimization Algorithms (Coursera) Coursera
National Taiwan University

Operations Research (2): Optimization Algorithms (Coursera)

Operations Research (OR) is a field in which people use mathematical and engineering methods to study optimization problems in Business and Management, Economics, Computer Science, Civil Engineering, Electrical Engineering, etc. The series of courses consists of three parts, we focus on deterministic optimization techniques, which is a major part of the field of OR. As the second part of the series, we study some efficient algorithms for solving linear programs, integer programs, and nonlinear programs.

Sep 28th 2026
5-12 Weeks
Statistical Mechanics: Algorithms and Computations (Coursera) Coursera
École normale supérieure

Statistical Mechanics: Algorithms and Computations (Coursera)

In this course you will learn a whole lot of modern physics (classical and quantum) from basic computer programs that you will download, generalize, or write from scratch, discuss, and then hand in. Join in if you are curious (but not necessarily knowledgeable) about algorithms, and about the deep insights into science that you can obtain by the algorithmic approach.

Sep 28th 2026
5-12 Weeks
Machine Learning Algorithms (Coursera) Coursera
Sungkyunkwan University - SKKU

Machine Learning Algorithms (Coursera)

In this course you will: understand the naïve Bayesian algorithm; understand the Support Vector Machine algorithm; understand the Decision Tree algorithm; understand the Clustering. Please make sure that you’re comfortable programming in Python and have a basic knowledge of mathematics including matrix multiplications, and conditional probability.

Sep 28th 2026
4 Weeks