BERT & NLP Explained

Speaker: Mitchell Wong, Data Scientist at Microsoft Host: Abir Mokbel, Stream Owner at Aggregate Intellect Motivation: This video walks us through BERT, an open source machine learning framework for natural language processing (NLP). BERT is designed to help computers understand the meaning of ambiguous language in text by using surrounding text to establish context. This video discusses NLP, language models, how BERT works, MLM and NSP, real life applications, and limitations and future enhancements. Concepts & Graphic credits: Next word: Holtzman et al 2019 Markov: #:~:text=Markov model of natural language. a simple mathematical,of occurrences of each letter in that text, Pre-training and fine-tuning: Self-attention: Disclaimer from Host: “All opinions expressed in this vid