Natural Language Processing with Sequence Models (Coursera)

Please make sure that you’ve completed Course 2 and are familiar with the basics of TensorFlow. If you’d like to prepare additionally, you can take Course 1: Neural Networks and Deep Learning of the Deep Learning Specialization.

By the end of this Specialization, you will have designed NLP applications that perform question-answering and sentiment analysis, created tools to translate languages and summarize text, and even built a chatbot!

This Specialization is designed and taught by two experts in NLP, machine learning, and deep learning. Younes Bensouda Mourri is an Instructor of AI at Stanford University who also helped build the Deep Learning Specialization. Łukasz Kaiser is a Staff Research Scientist at Google Brain and the co-author of Tensorflow, the Tensor2Tensor and Trax libraries, and the Transformer paper.
What You Will Learn

- Create word embeddings, then train a neural network on them to perform sentiment analysis of tweets

- Generate synthetic Shakespeare text using a Gated Recurrent Unit (GRU) language model

- Train a recurrent neural network to extract important information from text, using named entity recognition (NER) and LSTMs with linear layers

- Use a Siamese network to compare questions in a text and identify duplicates: questions that are worded differently but have the same meaning

Course 3 of 4 in the Natural Language Processing Specialization.

Syllabus

WEEK 1

Neural Networks for Sentiment Analysis

Learn about neural networks for deep learning, then build a sophisticated tweet classifier that places tweets into positive or negative sentiment categories, using a deep neural network.

WEEK 2

Recurrent Neural Networks for Language Modeling

Learn about the limitations of traditional language models and see how RNNs and GRUs use sequential data for text prediction. Then build your own next-word generator using a simple RNN on Shakespeare text data!

WEEK 3

LSTMs and Named Entity Recognition

Learn about how long short-term memory units (LSTMs) solve the vanishing gradient problem, and how Named Entity Recognition systems quickly extract important information from text. Then build your own Named Entity Recognition system using an LSTM and data from Kaggle!

WEEK 4

Siamese Networks

Learn about Siamese networks, a special type of neural network made of two identical networks that are eventually merged together, then build your own Siamese network that identifies question duplicates in a dataset from Quora.