Compression

Can gzip be a language model?

Nathan explores whether compression alone can act like a language model—training gzip-style predictors, measuring next-byte perplexity, and what that says about prediction vs understanding.

Essay · Machine Learning · Compression · AI