add func CutSplit

雾聪

2024-01-23 f23b6c98381dd91661fc1df753d84a58c725d71a

1
{"bos_token": "<|endoftext|>", "eos_token": "<|endoftext|>", "unk_token": "<|endoftext|>"}