dictionary· e01.org

dictionary · English Wiktionary

byte pair encoding

2 definition(s) across 1 part(s) of speech · fetched 2026-10-26

  • Source Wiktionary
  • Retrieved 2026-10-26
  • Licence CC BY-SA 4.0 (Wiktionary dump)
  • Cache cache
  • Language English
Noun2 senses
  1. A lossless data compression algorithm that iteratively replaces the most frequent pair of adjacent bytes in a sequence with a new byte not already present in the data.

  2. A subword tokenization method that iteratively merges the most frequent pairs of adjacent characters in a corpus to form longer and more meaningful tokens, typically until a predefined vocabulary size is reached.

Source
English Wiktionary
Record
byte pair encoding
Retrieved
2026-10-26
Licence
CC BY-SA 4.0 (Wiktionary dump)
Completeness
Cached copy of the source entry; not a rewrite or a generated definition.