Transformer Models and BERT Model (Coursera)

Offered by Google Cloud,
Transformer Models and BERT Model (Coursera)

This course introduces you to the Transformer architecture and the Bidirectional Encoder Representations from Transformers (BERT) model. You learn about the main components of the Transformer architecture, such as the self-attention mechanism, and how it is used to build the BERT model. You also learn about the different tasks that BERT can be used for, such as text classification, question answering, and natural language inference.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

This course is estimated to take approximately 45 minutes to complete.

What you'll learn

  • Understand the main components of the Transformer architecture.
  • Learn how a BERT model is built using Transformers.
  • Use BERT to solve different natural language processing (NLP) tasks.

Syllabus

Transformer Models and BERT Model: Overview
Module 1
In this module you will learn about the main components of the Transformer architecture, such as the self-attention mechanism, and how it is used to build the BERT model. You also learn about the different tasks that BERT can be used for, such as text classification, question answering, and natural language inference.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Natural Language Processing and Capstone Assignment (Coursera) Coursera
University of California, Irvine

Natural Language Processing and Capstone Assignment (Coursera)

Welcome to Natural Language Processing and Capstone Assignment. In this course we will begin with an Recognize how technical and business techniques can be used to deliver business insight, competitive intelligence, and consumer sentiment. The course concludes with a capstone assignment in which you will apply a wide range of what has been covered in this specialization.

Sep 21st 2026
4 Weeks
Understanding and Applying Text Embeddings (Coursera) Coursera
DeepLearning.AI

Understanding and Applying Text Embeddings (Coursera)

The Vertex AI Text-Embeddings API enhances the process of generating text embeddings. These text embeddings, which are numerical representations of text, play a pivotal role in many tasks involving the identification of similar items, like Google searches, online shopping recommendations, and personalized music suggestions.

Oct 12th 2026
1 Week
Artificial Intelligence in Bioinformatics (FutureLearn) FutureLearn
Taipei Medical University

Artificial Intelligence in Bioinformatics (FutureLearn)

Discover the future of bioinformatics and learn how AI models of bioinformatics data help us to understand biological processes. Study the use of AI, machine learning, and deep learning in bioinformatics. This course will teach you the fundamentals of how AI is applied in the field of bioinformatics.

Self Paced
3 Weeks
Getting Started with AWS Machine Learning (Coursera) Coursera
AWS

Getting Started with AWS Machine Learning (Coursera)

Machine learning (ML) is one of the fastest growing areas in technology and a highly sought after skillset in today’s job market. The World Economic Forum states the growth of artificial intelligence (AI) could create 58 million net new jobs in the next few years, yet it’s estimated that currently there are 300,000 AI engineers worldwide, but millions are needed.

Aug 21st 2023
5-12 Weeks
Preparing for AI-900: Microsoft Azure AI Fundamentals exam (Coursera) Coursera
Microsoft

Preparing for AI-900: Microsoft Azure AI Fundamentals exam (Coursera)

Microsoft certifications give you a professional advantage by providing globally recognized and industry-endorsed evidence of mastering skills in digital and cloud businesses. In this course, you will prepare to take the AI-900 Microsoft Azure AI Fundamentals certification exam. You will refresh your knowledge of fundamental principles of machine learning on Microsoft Azure. You will go back over the main consideration of AI workloads and the features of computer vision, Natural Language Processing (NLP), and conversational AI workloads on Azure. In short, you will recap all the core concepts and skills that are measured by the exam.

Sep 28th 2026
4 Weeks
Introduction to Machine Learning (Coursera) Coursera
Duke University

Introduction to Machine Learning (Coursera)

This course will provide you a foundational understanding of machine learning models (logistic regression, multilayer perceptrons, convolutional neural networks, natural language processing, etc.) as well as demonstrate how these models can solve complex problems in a variety of industries, from medical diagnostics to image recognition to text prediction.

Sep 21st 2026
5-12 Weeks
Machine Learning and NLP Basics (Coursera) Coursera
Edureka

Machine Learning and NLP Basics (Coursera)

Welcome to the "Machine Learning and NLP Basics" course, a comprehensive learning resource designed for enthusiasts keen on mastering the foundational aspects of machine learning (ML) and natural language processing (NLP). This course is structured to provide a deep dive into the core concepts, algorithms, and applications of ML and NLP, preparing you for advanced exploration and application in these fields.

Sep 28th 2026
4 Weeks
Clinical Natural Language Processing (Coursera) Coursera
University of Colorado System

Clinical Natural Language Processing (Coursera)

This course teaches you the fundamentals of clinical natural language processing (NLP). In this course you will learn the basic linguistic principals underlying NLP, as well as how to write regular expressions and handle text data in R. You will also learn practical techniques for text processing to be able to extract information from clinical notes.

Sep 21st 2026
5-12 Weeks
Natural Language Processing in Microsoft Azure (Coursera) Coursera
Microsoft

Natural Language Processing in Microsoft Azure (Coursera)

Natural language processing supports applications that can see, hear, speak with, and understand users. Using text analytics, translation, and language understanding services, Microsoft Azure makes it easy to build applications that support natural language. In this course, you will learn how to use the Text Analytics service for advanced natural language processing of raw text for sentiment analysis, key phrase extraction, named entity recognition, and language detection.

Sep 28th 2026
3 Weeks
Exam Prep AI-102: Microsoft Azure AI Engineer Associate (Coursera) Coursera
Whizlabs

Exam Prep AI-102: Microsoft Azure AI Engineer Associate (Coursera)

The AI-102: Designing and Implementing a Microsoft Azure AI Solution certification exam tests the candidate’s experience and knowledge of the AI solutions that make the most of Azure Cognitive Services and Azure services. In addition, the exam also tests the candidate's ability to implement this knowledge by participating in all phases of AI solutions development—from defining requirements, and design to development, deployment, integration, maintenance, performance tuning, and monitoring.

Sep 21st 2026
5-12 Weeks
Sequence Models (Coursera) Coursera
DeepLearning.AI

Sequence Models (Coursera)

This course will teach you how to build models for natural language, audio, and other sequence data. Thanks to deep learning, sequence algorithms are working far better than just two years ago, and this is enabling numerous exciting applications in speech recognition, music synthesis, chatbots, machine translation, natural language understanding, and many others.

Sep 28th 2026
3 Weeks