Transformer Models and BERT Model (Coursera)

Offered by Google Cloud,
Transformer Models and BERT Model (Coursera)

This course introduces you to the Transformer architecture and the Bidirectional Encoder Representations from Transformers (BERT) model. You learn about the main components of the Transformer architecture, such as the self-attention mechanism, and how it is used to build the BERT model. You also learn about the different tasks that BERT can be used for, such as text classification, question answering, and natural language inference.

Class Deals by MOOC List - Click here and see Coursera's Active Discounts, Deals, and Promo Codes.

This course is estimated to take approximately 45 minutes to complete.

What you'll learn

  • Understand the main components of the Transformer architecture.
  • Learn how a BERT model is built using Transformers.
  • Use BERT to solve different natural language processing (NLP) tasks.

Syllabus

Transformer Models and BERT Model: Overview
Module 1
In this module you will learn about the main components of the Transformer architecture, such as the self-attention mechanism, and how it is used to build the BERT model. You also learn about the different tasks that BERT can be used for, such as text classification, question answering, and natural language inference.

Go to Class
MOOC List is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

Related Courses

Preparing for AI-900: Microsoft Azure AI Fundamentals exam (Coursera) Coursera
Microsoft

Preparing for AI-900: Microsoft Azure AI Fundamentals exam (Coursera)

Microsoft certifications give you a professional advantage by providing globally recognized and industry-endorsed evidence of mastering skills in digital and cloud businesses. In this course, you will prepare to take the AI-900 Microsoft Azure AI Fundamentals certification exam. You will refresh your knowledge of fundamental principles of machine learning on Microsoft Azure. You will go back over the main consideration of AI workloads and the features of computer vision, Natural Language Processing (NLP), and conversational AI workloads on Azure. In short, you will recap all the core concepts and skills that are measured by the exam.

Aug 3rd 2026
4 Weeks
Artificial Intelligence in Bioinformatics (FutureLearn) FutureLearn
Taipei Medical University

Artificial Intelligence in Bioinformatics (FutureLearn)

Discover the future of bioinformatics and learn how AI models of bioinformatics data help us to understand biological processes. Study the use of AI, machine learning, and deep learning in bioinformatics. This course will teach you the fundamentals of how AI is applied in the field of bioinformatics.

Self Paced
3 Weeks
Exam Prep AI-102: Microsoft Azure AI Engineer Associate (Coursera) Coursera
Whizlabs

Exam Prep AI-102: Microsoft Azure AI Engineer Associate (Coursera)

The AI-102: Designing and Implementing a Microsoft Azure AI Solution certification exam tests the candidate’s experience and knowledge of the AI solutions that make the most of Azure Cognitive Services and Azure services. In addition, the exam also tests the candidate's ability to implement this knowledge by participating in all phases of AI solutions development—from defining requirements, and design to development, deployment, integration, maintenance, performance tuning, and monitoring.

Jul 27th 2026
5-12 Weeks
Generative AI: Elevate your Software Development Career (Coursera) Coursera
IBM

Generative AI: Elevate your Software Development Career (Coursera)

Generative AI is transforming the field of Software Engineering, making it a crucial skills for Developers to have in their toolkit. This IBM course "Generative AI for Software Developers" is designed to provide you with a comprehensive understanding of how generative AI techniques can be applied to enhance software development processes.

Aug 3rd 2026
3 Weeks
Cohere - An Introduction (Coursera) Coursera
Board Infinity

Cohere - An Introduction (Coursera)

"Cohere - An Introduction" is a comprehensive course designed to provide a deep dive into the world of Cohere, a leading platform in natural language processing (NLP). Spanning three modules, the course begins with the fundamentals of Cohere, exploring its NLP capabilities, basic operations, and setup. The second module advances into developing with Cohere, covering advanced text generation, text analysis, and practical application development. The final module focuses on integrating Cohere with other technologies, optimizing performance, and exploring future possibilities in NLP and AI.

Jul 6th 2026
3 Weeks
NLP Modelos y Algoritmos (Coursera) Coursera
Universidad Austral

NLP Modelos y Algoritmos (Coursera)

Este curso te brindará los conocimientos necesarios para la implementación de algoritmos de NLP. Mediante el uso de los últimos algoritmos más populares en NLP se procederá a dar solución a un conjunto de problemas propios del área. Para realizar este curso es necesario contar con conocimientos de programación de nivel básico a medio, deseablemente conocimiento básico del lenguaje Python y es recomendable conocer los Jupyter Notebooks en el entorno Anaconda.

Aug 3rd 2026
4 Weeks
AI and Disaster Management (Coursera) Coursera
DeepLearning.AI

AI and Disaster Management (Coursera)

In Course 3, AI and Disaster Management, you will begin by learning how natural disasters create both short and long-term impacts on the economy, environment, and community. You will learn how the disaster management cycle can be used to reduce the impacts of a disaster and guidelines for how you can engage in disaster-related projects.

Jul 27th 2026
3 Weeks
Advanced Tools for Digital Marketing Analytics (Coursera) Coursera
Unilever

Advanced Tools for Digital Marketing Analytics (Coursera)

The Advanced Tools for Digital Marketing Analytics course explores cutting-edge tools and technologies that are transforming the landscape of digital marketing analytics such as marketing automation and scaling strategies, predictive analytics and algorithms, video and mobile marketing trends, as well as artificial intelligence (AI), natural language processing (NLP), and ethics. You’ll also walk through preparing a portfolio and supporting a career change to digital marketing analyst.

Aug 3rd 2026
4 Weeks
Introduction to Generative AI (Coursera) Coursera
University of Colorado Boulder

Introduction to Generative AI (Coursera)

This introductory course offers a comprehensive exploration of Generative AI, including Transformers, ChatGPT for generating text, and Generative Adversarial Networks (GANs), the Diffusion Model for generating images. By the end of this course, you will gain a basic understanding of these Generative AI models, their underlying theories, and practical considerations. You will build a solid foundation and become ready to dive deeper into more advanced topics in the next course.

Jun 29th 2026
4 Weeks