Turning words and categories into vectors

How text becomes numbers — from characters to subword tokens via byte-pair encoding

Score how important a word is to a document in a collection — the backbone of search engines and text retrieval

Turn text into numbers — count word occurrences to create the simplest document representation in NLP

Learn dense vector representations where similar words live near each other in space

Predict the center word from its context — the averaging architecture behind Word2Vec

Predict context words from a center word — the architecture that powers Word2Vec with negative sampling