dictionary · English Wiktionary
tokenize
Pronunciation T OW1 K AH0 N AY0 Z3 definition(s) across 1 part(s) of speech · fetched 2026-11-19
Verb3 senses
To reduce to a token or set of tokens by lexical analysis.
To substitute sensitive data with meaningless placeholders.
To treat as a token minority.