dictionary · English Wiktionary
byte pair encoding
2 definition(s) across 1 part(s) of speech · fetched 2026-10-26
Noun2 senses
A lossless data compression algorithm that iteratively replaces the most frequent pair of adjacent bytes in a sequence with a new byte not already present in the data.
A subword tokenization method that iteratively merges the most frequent pairs of adjacent characters in a corpus to form longer and more meaningful tokens, typically until a predefined vocabulary size is reached.