bug fix for numpy input

shixian.shi

2024-02-06 410a85402db06bf36a9d7acec5dc922012951242

1
{"bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "unk_token": "<|endoftext|>"}