support transducer model inference

shixian.shi

2024-02-20 151c339ffeced822917e85255431fcfb74f24db9

1
{"bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "unk_token": "<|endoftext|>"}