update tokenizer.h

雾聪

2023-11-09 b0c108279275a5c0011dfcf76b3e725b3263209b

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
boy
boy
boy
boy
boy
boy
boy
girl
girl
pretty girl
cat
dog
dog
dog
rat
red faced clown
green caterpillar