| | |
|---|
| | | |
|---|
| | | | Model Name | Task Details | Training Data | Parameters | |
|---|
| | | |:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------:|:--------------------------------:|:----------:| |
|---|
| | | | SenseVoiceSmall <br> ([⭐](https://www.modelscope.cn/models/iic/SenseVoiceSmall) [🤗](https://huggingface.co/FunAudioLLM/SenseVoiceSmall) ) | multiple speech understanding capabilities, including ASR, LID, SER, and AED. | 400000 hours | 330M | |
|---|
| | | | SenseVoiceSmall <br> ([⭐](https://www.modelscope.cn/models/iic/SenseVoiceSmall) [🤗](https://huggingface.co/FunAudioLLM/SenseVoiceSmall) ) | multiple speech understanding capabilities, including ASR, ITN, LID, SER, and AED, support languages such as zh, yue, en, ja, ko | 300000 hours | 234M | |
|---|
| | | | paraformer-zh <br> ([⭐](https://www.modelscope.cn/models/damo/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch/summary) [🤗](https://huggingface.co/funasr/paraformer-zh) ) | speech recognition, with timestamps, non-streaming | 60000 hours, Mandarin | 220M | |
|---|
| | | | <nobr>paraformer-zh-streaming <br> ( [⭐](https://modelscope.cn/models/damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-online/summary) [🤗](https://huggingface.co/funasr/paraformer-zh-streaming) )</nobr> | speech recognition, streaming | 60000 hours, Mandarin | 220M | |
|---|
| | | | paraformer-en <br> ( [⭐](https://www.modelscope.cn/models/damo/speech_paraformer-large-vad-punc_asr_nat-en-16k-common-vocab10020/summary) [🤗](https://huggingface.co/funasr/paraformer-en) ) | speech recognition, without timestamps, non-streaming | 50000 hours, English | 220M | |
|---|
| | |
|---|
| | | Notes: Support recognition of single audio file, as well as file list in Kaldi-style wav.scp format: `wav_id wav_pat` |
|---|
| | | |
|---|
| | | ### Speech Recognition (Non-streaming) |
|---|
| | | #### SenseVoice |
|---|
| | | ```python |
|---|
| | | from funasr import AutoModel |
|---|
| | | from funasr.utils.postprocess_utils import rich_transcription_postprocess |
|---|
| | | |
|---|
| | | model_dir = "iic/SenseVoiceSmall" |
|---|
| | | |
|---|
| | | model = AutoModel( |
|---|
| | | model=model_dir, |
|---|
| | | vad_model="fsmn-vad", |
|---|
| | | vad_kwargs={"max_single_segment_time": 30000}, |
|---|
| | | device="cuda:0", |
|---|
| | | ) |
|---|
| | | |
|---|
| | | # en |
|---|
| | | res = model.generate( |
|---|
| | | input=f"{model.model_path}/example/en.mp3", |
|---|
| | | cache={}, |
|---|
| | | language="auto", # "zn", "en", "yue", "ja", "ko", "nospeech" |
|---|
| | | use_itn=True, |
|---|
| | | batch_size_s=60, |
|---|
| | | merge_vad=True, # |
|---|
| | | merge_length_s=15, |
|---|
| | | ) |
|---|
| | | text = rich_transcription_postprocess(res[0]["text"]) |
|---|
| | | print(text) |
|---|
| | | ``` |
|---|
| | | #### Paraformer |
|---|
| | | ```python |
|---|
| | | from funasr import AutoModel |
|---|
| | | # paraformer-zh is a multi-functional asr model |
|---|
