Searched defs:eos_token (Results 1 – 3 of 3) sorted by relevance
/dports/misc/py-gluonnlp/gluon-nlp-0.10.0/src/gluonnlp/vocab/ |
H A D | bert.py | 120 padding_token=PADDING_TOKEN, bos_token=None, eos_token=None, mask_token=MASK_TOKEN, argument 187 eos_token=None, argument
|
H A D | elmo.py | 63 def __init__(self, bos_token='<bos>', eos_token='<eos>'): argument
|
/dports/misc/py-gluonnlp/gluon-nlp-0.10.0/tests/unittest/ |
H A D | test_vocab_embed.py | 1216 eos_token, reserved_tokens): argument 1401 eos_token, reserved_tokens, counter): argument 1449 def test_vocab_remapped_unknown_token_idx(unknown_token, padding_token, eos_token, reserved_tokens, argument
|