CS · Level 4

4.1 How LLMs Work

Take a peek under the hood of large language models (LLMs) to understand how they work.

Intro to Language Models

Predicting the Next Word

Calculating Word Probabilities

Creativity and Coherence

Improving Models

Preprocessing

Tokenization

Turning Text into Data

Using Dictionaries

Counting Unique Words

Bigrams and Mutability

Bigram Frequency and Tuples

Bigram Analysis

Building a Language Model


Course description

Take a peek under the hood of large language models (LLMs) to understand how they work.


Prerequisites and next steps

Using a live chat interface, this course explores large language models, including how corpora are built, ngram models, tokenization, and temperature.

Up next

CS · Level 5

5.1 Introduction to Neural Networks

Delve into the inner machinery of neural networks to discover how these flexible learning tools actually work.

Jump ahead