Transformer Models and BERT Model (Coursera)

Offered by Google Cloud,
Transformer Models and BERT Model (Coursera)

This course introduces you to the Transformer architecture and the Bidirectional Encoder Representations from Transformers (BERT) model. You learn about the main components of the Transformer architecture, such as the self-attention mechanism, and how it is used to build the BERT model. You also learn about the different tasks that BERT can be used for, such as text classification, question answering, and natural language inference.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

This course is estimated to take approximately 45 minutes to complete.

What you'll learn

  • Understand the main components of the Transformer architecture.
  • Learn how a BERT model is built using Transformers.
  • Use BERT to solve different natural language processing (NLP) tasks.

Syllabus

Transformer Models and BERT Model: Overview
Module 1
In this module you will learn about the main components of the Transformer architecture, such as the self-attention mechanism, and how it is used to build the BERT model. You also learn about the different tasks that BERT can be used for, such as text classification, question answering, and natural language inference.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Select Topics in Python: Natural Language Processing (Coursera) Coursera
Codio

Select Topics in Python: Natural Language Processing (Coursera)

Code and run your first NLP program in minutes without installing anything! This course is designed for learners who have some experience with Python but are a novice to NLP. The modules in this course cover processing and analyzing text; analyzing speech, syntax, and semantics; and building a chatbot.

Nov 16th 2026
3 Weeks
Artificial Intelligence in Bioinformatics (FutureLearn) FutureLearn
Taipei Medical University

Artificial Intelligence in Bioinformatics (FutureLearn)

Discover the future of bioinformatics and learn how AI models of bioinformatics data help us to understand biological processes. Study the use of AI, machine learning, and deep learning in bioinformatics. This course will teach you the fundamentals of how AI is applied in the field of bioinformatics.

Self Paced
3 Weeks
Advanced Tools for Digital Marketing Analytics (Coursera) Coursera
Unilever

Advanced Tools for Digital Marketing Analytics (Coursera)

The Advanced Tools for Digital Marketing Analytics course explores cutting-edge tools and technologies that are transforming the landscape of digital marketing analytics such as marketing automation and scaling strategies, predictive analytics and algorithms, video and mobile marketing trends, as well as artificial intelligence (AI), natural language processing (NLP), and ethics. You’ll also walk through preparing a portfolio and supporting a career change to digital marketing analyst.

Nov 9th 2026
4 Weeks
Understanding and Applying Text Embeddings (Coursera) Coursera
DeepLearning.AI

Understanding and Applying Text Embeddings (Coursera)

The Vertex AI Text-Embeddings API enhances the process of generating text embeddings. These text embeddings, which are numerical representations of text, play a pivotal role in many tasks involving the identification of similar items, like Google searches, online shopping recommendations, and personalized music suggestions.

Nov 9th 2026
1 Week
Applying Data Analytics in Accounting (Coursera) Coursera
University of Illinois at Urbana-Champaign

Applying Data Analytics in Accounting (Coursera)

This course explores business analytic applications in accounting. First, it presents a survey of technology topics in accounting, including process mining, blockchain and applications in audit, tax, and assurance. Next, the course explores visualization and basic analytics in audit and control testing using R and Alteryx. Next, the course examines the uses of text analysis in accounting and conducts text analysis using R and RStudio. Finally, the course examines robot process automation in general using UiPath and its applications in accounting.

Nov 9th 2026
4 Weeks
AI and Disaster Management (Coursera) Coursera
DeepLearning.AI

AI and Disaster Management (Coursera)

In Course 3, AI and Disaster Management, you will begin by learning how natural disasters create both short and long-term impacts on the economy, environment, and community. You will learn how the disaster management cycle can be used to reduce the impacts of a disaster and guidelines for how you can engage in disaster-related projects.

Nov 16th 2026
3 Weeks
Generative AI Language Modeling with Transformers (Coursera) Coursera
IBM

Generative AI Language Modeling with Transformers (Coursera)

This course provides you with an overview of how to use transformer-based models for natural language processing (NLP). In this course, you will learn to apply transformer-based models for text classification, focusing on the encoder component. You’ll learn about positional encoding, word embedding, and attention mechanisms in language transformers and their role in capturing contextual information and dependencies.

Nov 23rd 2026
2 Weeks
Artificial Intelligence on Microsoft Azure (Coursera) Coursera
Microsoft

Artificial Intelligence on Microsoft Azure (Coursera)

Whether you're just beginning to work with Artificial Intelligence (AI) or you already have AI experience and are new to Microsoft Azure, this course provides you with everything you need to get started. Artificial Intelligence (AI) empowers amazing new solutions and experiences; and Microsoft Azure provides easy to use services to help you build solutions that seemed like science fiction a short time ago; enabling incredible advances in health care, financial management, environmental protection, and other areas to make a better world for everyone.

Nov 16th 2026
1 Week
Preparing for AI-900: Microsoft Azure AI Fundamentals exam (Coursera) Coursera
Microsoft

Preparing for AI-900: Microsoft Azure AI Fundamentals exam (Coursera)

Microsoft certifications give you a professional advantage by providing globally recognized and industry-endorsed evidence of mastering skills in digital and cloud businesses. In this course, you will prepare to take the AI-900 Microsoft Azure AI Fundamentals certification exam. You will refresh your knowledge of fundamental principles of machine learning on Microsoft Azure. You will go back over the main consideration of AI workloads and the features of computer vision, Natural Language Processing (NLP), and conversational AI workloads on Azure. In short, you will recap all the core concepts and skills that are measured by the exam.

Nov 9th 2026
4 Weeks