BERT

Heard in 3 episodes across 2 shows since Aug 2026

BERT is an encoder-only Transformer language model introduced by Google researchers in 2018. It uses self-supervised pretraining to learn bidirectional representations of text, and can be fine-tuned for natural-language-processing tasks such as text classification, question answering, and named-entity recognition.