Linear Algebra: Orthogonality and Diagonalization (Coursera)

Linear Algebra: Orthogonality and Diagonalization (Coursera)

This is the third and final course in the Linear Algebra Specialization that focuses on the theory and computations that arise from working with orthogonal vectors. This includes the study of orthogonal transformation, orthogonal bases, and orthogonal transformations. The course culminates in the theory of symmetric matrices, linking the algebraic properties with their corresponding geometric equivalences. These matrices arise more often in applications than any other class of matrices.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

The theory, skills and techniques learned in this course have applications to AI and machine learning. In these popular fields, often the driving engine behind the systems that are interpreting, training, and using external data is exactly the matrix analysis arising from the content in this course.
Successful completion of this specialization will prepare students to take advanced courses in data science, AI, and mathematics.
This course is part of the Linear Algebra from Elementary to Advanced Specialization.

Syllabus

Orthogonality
In this module, we define a new operation on vectors called the dot product. This operation is a function that returns a scalar related to the angle between the vectors, distance between vectors, and length of vectors. After working through the theory and examples, we hone in on both unit (length one) and orthogonal (perpendicular) vectors. These special vectors will be pivotal in our course as we start to define linear transformations and special matrices that use only these vectors.

Orthogonal Projections and Least Squares Problems
In this module we will study the special type of transformation called the orthogonal projection. We have already seen the formula for the orthogonal projection onto a line so now we generalize the formula to the case of projection onto any subspace W. The formula will require basis vectors that are both orthogonal and normalize and we show, using the Gram-Schmidt Process, how to meet these requirements given any non-empty basis.

Symmetric Matrices and Quadratic Forms
In this module we look to diagonalize symmetric matrices. The symmetry displayed in the matrix A turns out to force a beautiful relationship between the eigenspaces. The corresponding eigenspaces turn out to be mutually orthogonal. After normalizing, these orthogonal eigenvectors give a very special basis of R^n with extremely useful applications to data science, machine learning, and image processing. We introduce the notion of quadratic forms, special functions of degree two on vectors , which use symmetric matrices in their definition. Quadratic forms are then completely classified based on the properties of their eigenvalues.

Final Assessment

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Machine Learning (Coursera) Coursera
Stanford University

Machine Learning (Coursera)

Machine learning is the science of getting computers to act without being explicitly programmed. In the past decade, machine learning has given us self-driving cars, practical speech recognition, effective web search, and a vastly improved understanding of the human genome. Machine learning is so pervasive today that you probably use it dozens of times a day without knowing it. Many researchers also think it is the best way to make progress towards human-level AI. In this class, you will learn about the most effective machine learning techniques, and gain practice implementing them and getting them to work for yourself. More importantly, you'll learn about not only the theoretical underpinnings of learning, but also gain the practical know-how needed to quickly and powerfully apply these techniques to new problems.

Jul 27th 2026
5-12 Weeks
Introduction to Linear Algebra and Python (Coursera) Coursera
Howard University

Introduction to Linear Algebra and Python (Coursera)

This course is the first of a series that is designed for beginners who want to learn how to apply basic data science concepts to real-world problems. You might be a student who is considering pursuing a career in data science and wanting to learn more, or you might be a business professional who wants to apply some data science principles to your work. Or, you might simply be a curious, lifelong learner intrigued by the powerful tools that data science and math provides. Regardless of your motivation, we’ll provide you with the support and information you need to get started.

Jul 20th 2026
4 Weeks
Linear Algebra IV: Orthogonality & Symmetric Matrices and the SVD (edX) EdX
Georgia Institute of Technology,GTx

Linear Algebra IV: Orthogonality & Symmetric Matrices and the SVD (edX)

This course takes you through roughly five weeks of MATH 1554, Linear Algebra, as taught in the School of Mathematics at The Georgia Institute of Technology. In the first part of this course you will explore methods to compute an approximate solution to an inconsistent system of equations that have no solutions. Our overall approach is to center our algorithms on the concept of distance.

Self Paced
Self-Paced
Build Regression, Classification, and Clustering Models (Coursera) Coursera
CertNexus

Build Regression, Classification, and Clustering Models (Coursera)

In most cases, the ultimate goal of a machine learning project is to produce a model. Models make decisions, predictions—anything that can help the business understand itself, its customers, and its environment better than a human could. Models are constructed using algorithms, and in the world of machine learning, there are many different algorithms to choose from. You need to know how to select the best algorithm for a given job, and how to use that algorithm to produce a working model that provides value to the business. This third course within the Certified Artificial Intelligence Practitioner (CAIP) professional certificate introduces you to some of the major machine learning algorithms that are used to solve the two most common supervised problems: regression and classification, and one of the most common unsupervised problems: clustering.

Jul 27th 2026
5-12 Weeks
Advanced Machine Learning and Signal Processing (Coursera) Coursera
IBM

Advanced Machine Learning and Signal Processing (Coursera)

This course, Advanced Machine Learning and Signal Processing, is part of the IBM Advanced Data Science Specialization which IBM is currently creating and gives you easy access to the invaluable insights into Supervised and Unsupervised Machine Learning Models used by experts in many field relevant disciplines. We’ll learn about the fundamentals of Linear Algebra to understand how machine learning modes work.

Aug 12th 2024
4 Weeks
Deep Learning and Reinforcement Learning (Coursera) Coursera
IBM

Deep Learning and Reinforcement Learning (Coursera)

This course introduces you to two of the most sought-after disciplines in Machine Learning: Deep Learning and Reinforcement Learning. Deep Learning is a subset of Machine Learning that has applications in both Supervised and Unsupervised Learning, and is frequently used to power most of the AI applications that we use on a daily basis. First you will learn about the theory behind Neural Networks, which are the basis of Deep Learning, as well as several modern architectures of Deep Learning.

Jul 20th 2026
5-12 Weeks
Linear Algebra I: Linear Equations (edX) EdX
Georgia Institute of Technology,GTx

Linear Algebra I: Linear Equations (edX)

This course takes you through the first three weeks of MATH 1554, Linear Algebra, as taught in the School of Mathematics at The Georgia Institute of Technology. Systems of equations live at the heart of linear algebra. In this course you will explore fundamental concepts by exploring definitions and theorems that give a basis for this subject.

Self Paced
Self-Paced
Math for AI beginner part 1 Linear Algebra (Coursera) Coursera
Korea Advanced Institute of Science and Technology - KAIST

Math for AI beginner part 1 Linear Algebra (Coursera)

'Learn concept of AI such as machine learning, deep-learning, support vector machine which is related to linear algebra. Learn how to use linear algebra for AI algorithm. After completing this course, you are able to understand AI algorithm and basics of linear algebra for AI applications.

Aug 3rd 2026
5-12 Weeks
Mathematics for Machine Learning: Linear Algebra (Coursera) Coursera
Imperial College London

Mathematics for Machine Learning: Linear Algebra (Coursera)

In this course on Linear Algebra we look at what linear algebra is and how it relates to vectors and matrices. Then we look through what vectors and matrices are and how to work with them, including the knotty problem of eigenvalues and eigenvectors, and how to use these to solve problems. Finally we look at how to use these to do fun things with datasets - like how to rotate images of faces and how to extract eigenvectors to look at how the Pagerank algorithm works.

Jul 27th 2026
5-12 Weeks