Searched refs:tokenize_japanese_word (Results 1 – 2 of 2) sorted by relevance
145 void tokenize_japanese_word(char* chunk);
637 void Tokenizer::tokenize_japanese_word(char* chunk) { in tokenize_japanese_word() function in Tokenizer771 tokenize_japanese_word(word); in tokenize()