It’s not an n-gram, go learn about transformers | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

throwthrowuknow on Aug 19, 2024 | parent | context | favorite | on: Markov chains are funnier than LLMs

It’s not an n-gram, go learn about transformers

Jensson on Aug 19, 2024 [–]

A context window is an n-gram.

throwthrowuknow on Aug 19, 2024 | [–]

It’s not used as an n-gram

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact