Tutorials

Interested in getting started in a new NLP area? Here are some tutorials to help get started.

Word Embedding

Pre-trained Word Embeddingsword_embedding/word_embedding.html

Basics on how to use word embedding with vocab in GluonNLP and apply it on word similarity and analogy problems.

Word Embeddings Training and Evaluationword_embedding/word_embedding_training.html

Learn how to train fastText and word2vec embeddings on your own dataset, and determine embedding quality through intrinsic evaluation.

Language Model

LSTM-based Language Modelslanguage_model/language_model.html

Learn what a language model is, what it can do, and how to train a word-level language model with truncated back-propagation-through-time (BPTT).

Machine Translation

Google Neural Machine Translationmachine_translation/gnmt.html

Learn how to train Google Neural Machine Translation, a seq2seq with attention model.

Machine Translation with Transformermachine_translation/transformer.html

Learn how to use a pre-trained transformer translation model for English-German translation.

Sentence Embedding

ELMo: Deep Contextualized Word Representationssentence_embedding/elmo_sentence_representation.html

See how to use GluonNLP’s model API to automatically download the pre-trained ELMo model from NAACL2018 best paper, and extract features with it.

A Structured Self-attentive Sentence Embeddingsentence_embedding/self_attentive_sentence_embedding.html

See how to use GluonNLP to build more advanced model structure for extracting sentence embeddings to predict Yelp review rating.

BERT: Bidirectional Encoder Representations from Transformerssentence_embedding/bert.html

See how to use GluonNLP to fine-tune a sentence pair classification model with pre-trained BERT parameters.

Sentiment Analysis

Sentiment Analysis by Fine-tuning Word Language Modelsentiment_analysis/sentiment_analysis.html

See how to fine-tune a pre-trained language model to perform sentiment analysis on movie reviews.

Sequence Sampling