Introduction to AI in the Data Center (Coursera)

Offered by NVIDIA,
Introduction to AI in the Data Center (Coursera)

Welcome to the Introduction to AI in the Data Center Course! As you know, Artificial Intelligence, or AI, is transforming society in many ways. From speech recognition to improved supply chain management, AI technology provides enterprises with the compute power, tools, and algorithms their teams need to do their life’s work.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

But how does AI work in a Data Center? What hardware and software infrastructure are needed?
These are some of the questions that this course will help you address.
This course will cover an introduction to concepts and terminology that will help you start the journey to AI and GPU computing in the data center.
You will learn about:

  • AI and AI use cases, Machine Learning, Deep Learning, and how training and inference happen in a Deep Learning Workflow.
  • The history and architecture of GPUs, how they differ from CPUs, and how they are revolutionizing AI.
  • Deep learning frameworks, AI software stack, and considerations when deploying AI workloads on a data center on prem, in the cloud, on a hybrid model, or on a multi-cloud environment. 
  • Requirements for multi-system AI clusters, considerations for infrastructure planning, including servers, networking, and storage and tools for cluster management, monitoring and orchestration.

This course is part of the preparation material for the NVIDIA Certified Associate - ”AI in the Data Center” certification.
This certification will take your expertise to the next level and support your professional development.
Who should take this course?

  • IT Professionals
  • System and Network Administrators
  • DevOps
  • Data Center Professionals

No prior experience required.
This is an introduction course to AI and GPU computing in the data center.
So let's get started!

What You Will Learn

  • What is AI and AI use cases, Machine Learning, Deep Leaning, and how training and inference happen in a Deep Learning Workflow.
  • The history and architecture of GPUs, how they differ from CPUs, and how they are revolutionizing AI.
  • Become familiar with deep learning frameworks, AI software stack, and considerations when deploying AI workloads on a data center on prem or cloud.
  • Requirements for multi-system AI clusters and considerations for infrustructure planning, including servers, networking, storage and tools.

Syllabus

WEEK 1
Introduction to GPU Computing | NVIDIA Training
In this module you will see AI use cases in different industries, the concepts of AI, Machine Learning (ML) and Deep Learning (DL), understand what a GPU is, the differences between a GPU and a CPU.
You will learn about the software ecosystem that has allowed developers to make use of GPU computing for data science and considerations when deploying AI workloads on a data center on prem, in the cloud, on a hybrid model, or on a multi-cloud environment.

WEEK 2
Rack Level Considerations | NVIDIA Training
In this module we will cover rack level considerations when deploying AI clusters.
You will learn about requirements for multi-system AI clusters, storage and networking considerations for such deployments, and an overview of NVIDIA reference architectures, which provide best practices to design systems for AI workloads.

WEEK 3
Data Center Level Considerations | NVIDIA Training
This unit covers  data center level considerations  when deploying AI clusters, such as infrastructure provisioning and workload management, orchestration and job scheduling, tools for cluster management and monitoring, and power and cooling considerations for data center deployments. 
Lastly, you will learn about AI infrastructure offered by NVIDIA partners through the DGX-ready data center colocation program.

WEEK 4
Course Completion Quiz - Introduction to AI in the Data Center
It is highly recommended that you complete all the course activities before you begin the quiz.
Good luck!

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Developing AI Applications on Azure (Coursera) Coursera
LearnQuest

Developing AI Applications on Azure (Coursera)

This course introduces the concepts of Artificial Intelligence and Machine learning. We'll discuss machine learning types and tasks, and machine learning algorithms. You'll explore Python as a popular programming language for machine learning solutions, including using some scientific ecosystem packages which will help you implement machine learning.

Sep 21st 2026
5-12 Weeks
Sistemas difusos (Coursera) Coursera
Universidad Nacional de Colombia

Sistemas difusos (Coursera)

Los sistemas difusos permiten efectuar cálculos cuando hay información con incertidumbre, o cuando se debe combinar información tanto cuantitativa como cualitativa. Se trata de una aproximación matemática para modelar esas situaciones. Este curso está diseñado para ayudar a entender y explicar cómo funcionan dichos sistemas. El curso tiene una aproximación teórica y práctica. Los principios matemáticos son de un nivel bajo y están al alcance de un público muy amplio. El curso cuenta con varios laboratorios para aprender a utilizar las herramientas de software que usan esos principios. Este componente práctico requiere una comprensión mínima de programación.

Sep 21st 2026
4 Weeks
Generative AI for Leaders (Coursera) Coursera
Vanderbilt University

Generative AI for Leaders (Coursera)

Leaders are constantly seeking innovative tools to amplify their impact. Dive into the realm of Generative AI, a groundbreaking technology poised to redefine the leadership landscape more profoundly than the Internet itself. This course offers a comprehensive journey into understanding, applying, and mastering Generative AI as a robust tool to amplify leadership capabilities.

Sep 21st 2026
3 Weeks
AI Concepts and Strategy (Coursera) Coursera
Rutgers University

AI Concepts and Strategy (Coursera)

Artificial intelligence (AI) is rapidly evolving as a multidimensional paradigm, with critical implications for individuals, communities, organizations, businesses, national and regional economies and human society at large. This unique course will help you understand AI on three dimensions: Practice, Principles & Strategy. The course is introductory in nature but will provide a reasonably rigorous learning experience towards gaining a state of the art applied and philosophical overview of AI.

Sep 21st 2026
4 Weeks
Introduction to Machine Learning (Coursera) Coursera
Duke University

Introduction to Machine Learning (Coursera)

This course will provide you a foundational understanding of machine learning models (logistic regression, multilayer perceptrons, convolutional neural networks, natural language processing, etc.) as well as demonstrate how these models can solve complex problems in a variety of industries, from medical diagnostics to image recognition to text prediction.

Sep 21st 2026
5-12 Weeks
Exam Prep AI-102: Microsoft Azure AI Engineer Associate (Coursera) Coursera
Whizlabs

Exam Prep AI-102: Microsoft Azure AI Engineer Associate (Coursera)

The AI-102: Designing and Implementing a Microsoft Azure AI Solution certification exam tests the candidate’s experience and knowledge of the AI solutions that make the most of Azure Cognitive Services and Azure services. In addition, the exam also tests the candidate's ability to implement this knowledge by participating in all phases of AI solutions development—from defining requirements, and design to development, deployment, integration, maintenance, performance tuning, and monitoring.

Sep 21st 2026
5-12 Weeks
Artificial Intelligence: Ethics & Societal Challenges (Coursera) Coursera
Lund University

Artificial Intelligence: Ethics & Societal Challenges (Coursera)

Artificial Intelligence: Ethics & Societal Challenges is a four-week course that explores ethical and societal aspects of the increasing use of artificial intelligent technologies (AI). The aim of the course is to raise awareness of ethical and societal aspects of AI and to stimulate reflection and discussion upon implications of the use of AI in society.

Sep 21st 2026
4 Weeks
Artificial Intelligence (AI) Education for Teachers (Coursera) Coursera
Macquarie University

Artificial Intelligence (AI) Education for Teachers (Coursera)

Today’s learners need to know what artificial intelligence (AI) is, how it works, how to use it in their everyday lives, and how it could potentially be used in their future. Using AI requires skills and values which extend far beyond simply having knowledge about coding and technology. This course is designed by teachers, for teachers, and will bridge the gap between commonly held beliefs about AI, and what it really is. AI can be embedded into all areas of the school curriculum and this course will show you how. This course will appeal to teachers who want to increase their general understanding of AI, including why it is important for learners; and/or to those who want to embed AI into their teaching practice and their students’ learning.

Sep 21st 2026
5-12 Weeks
Preparing for the Google Cloud Professional Data Engineer Exam (Coursera) Coursera
Google Cloud

Preparing for the Google Cloud Professional Data Engineer Exam (Coursera)

From the course: "The best way to prepare for the exam is to be competent in the skills required of the job." This course uses a top-down approach to recognize knowledge and skills already known, and to surface information and skill areas for additional preparation. You can use this course to help create your own custom preparation plan. It helps you distinguish what you know from what you don't know. And it helps you develop and practice skills required of practitioners who perform this job.

Sep 21st 2026
5-12 Weeks
Create Image Captioning Models (Coursera) Coursera
Google Cloud

Create Image Captioning Models (Coursera)

This course teaches you how to create an image captioning model by using deep learning. You learn about the different components of an image captioning model, such as the encoder and decoder, and how to train and evaluate your model. By the end of this course, you will be able to create your own image captioning models and use them to generate captions for images.

Sep 21st 2026
1 Week