streaming bugfix (#1271)

zhifu gao

2024-01-18 12496e559feea69af2e77eac6f22b32df3bf6762

1
{"bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "unk_token": "<|endoftext|>"}