en
tokenization
An
English
term in
ConceptNet 5.8
Sources:
English Wiktionary
and
French Wiktionary
View this term in the API
Documentation
FAQ
Chat
Blog
Documentation
FAQ
Chat
Blog
Related terms
en
tokenize
➜
en
tokenize
(
v
)
➜
en
tokenisation
(
n
)
➜
en
tokenizer
➜
fr
parsage
➜
fr
token
➜
fr
tokenisation
➜
en
tokenizer
(
n
)
➜
Word forms
en
tokenisation
(
n
)
➜
en
tokenizations
(
n
)
➜
fr
tokenisation
➜
Derived terms
en
detokenization
➜
en
retokenization
➜
Derived from
en
token
➜
en
token
(
n
)
➜
Synonyms
fr
tokenisation
(
n
)
➜
Links to other resources
en.wiktionary.org
tokenization
fr.wiktionary.org
tokenization