From c542eacb0aadcbc49c63db40429fca4e08f807a4 Mon Sep 17 00:00:00 2001 From: 游雁 <zhifu.gzf@alibaba-inc.com> Date: 星期五, 21 七月 2023 10:27:35 +0800 Subject: [PATCH] Merge branch 'main' of github.com:alibaba-damo-academy/FunASR add --- README_zh.md | 65 ++++++++++++++++++++++++-------- 1 files changed, 48 insertions(+), 17 deletions(-) diff --git a/README_zh.md b/README_zh.md index 3a84040..ee9342d 100644 --- a/README_zh.md +++ b/README_zh.md @@ -11,15 +11,20 @@ FunASR甯屾湜鍦ㄨ闊宠瘑鍒殑瀛︽湳鐮旂┒鍜屽伐涓氬簲鐢ㄤ箣闂存灦璧蜂竴搴фˉ姊併�傞�氳繃鏀寔鍦╗ModelScope](https://www.modelscope.cn/models?page=1&tasks=auto-speech-recognition)涓婂彂甯冪殑宸ヤ笟绾ц闊宠瘑鍒ā鍨嬬殑璁粌鍜屽井璋冿紝鐮旂┒浜哄憳鍜屽紑鍙戜汉鍛樺彲浠ユ洿鏂逛究鍦拌繘琛岃闊宠瘑鍒ā鍨嬬殑鐮旂┒鍜岀敓浜э紝骞舵帹鍔ㄨ闊宠瘑鍒敓鎬佺殑鍙戝睍銆傝璇煶璇嗗埆鏇存湁瓒ｏ紒 -[**鏈�鏂板姩鎬�**](#鏈�鏂板姩鎬�) -| [**鏍稿績鍔熻兘**](#鏍稿績鍔熻兘) -| [**瀹夎鏁欑▼**](#瀹夎鏁欑▼) -| [**濡備綍浣跨敤**](#濡備綍浣跨敤) -| [**鏈嶅姟閮ㄧ讲**](./funasr/runtime/readme_cn.md) -| [**妯″瀷浠撳簱**](./docs/model_zoo/modelscope_models.md) -| [**鑱旂郴鎴戜滑**](#contact) -| [**M2MET2.0姣旇禌**](https://github.com/alibaba-damo-academy/FunASR#multi-channel-multi-party-meeting-transcription-20-m2met20-challenge) +<div align="center"> +<h4> +<a href="#鏈�鏂板姩鎬�"> 鏈�鏂板姩鎬� </a> +锝�<a href="#瀹夎鏁欑▼"> 瀹夎 </a> +锝�<a href="#蹇�熷紑濮�"> 蹇�熷紑濮� </a> +锝�<a href="https://alibaba-damo-academy.github.io/FunASR/en/index.html"> 鏁欑▼鏂囨。 </a> +锝�<a href="#鏍稿績鍔熻兘"> 鏍稿績鍔熻兘 </a> +锝�<a href="./docs/model_zoo/modelscope_models.md"> 妯″瀷浠撳簱 </a> +锝�<a href="./funasr/runtime/readme_cn.md"> 鏈嶅姟閮ㄧ讲 </a> +锝�<a href="#鑱旂郴鎴戜滑"> 鑱旂郴鎴戜滑 </a> +</h4> +</div> +<a name="鏈�鏂板姩鎬�"></a> ## 鏈�鏂板姩鎬� ### 鏈嶅姟閮ㄧ讲SDK @@ -32,17 +37,41 @@ 璇︽儏璇峰弬鑰冩枃妗ｏ紙[鐐瑰嚮姝ゅ](https://alibaba-damo-academy.github.io/FunASR/m2met2_cn/index.html)锛� -### 瀛︽湳妯″瀷鏇存柊 +### 璇煶璇嗗埆 -### 宸ヤ笟妯″瀷鏇存柊 +- 瀛︽湳妯″瀷锛� + - Encoder-Decoder妯″瀷锛歔Transformer](egs/aishell/transformer)锛孾Conformer](egs/aishell/conformer)锛孾Branchformer](egs/aishell/branchformer) + - Transducer妯″瀷锛歔RNNT锛堟祦寮忥級](egs/aishell/rnnt)锛孾BAT](egs/aishell/bat) + - 闈炶嚜鍥炲綊妯″瀷锛歔Paraformer](egs/aishell/paraformer) + - 澶氳璇濅汉璇嗗埆妯″瀷锛歔MFCCA](egs_modelscope/asr/mfcca) + +- 宸ヤ笟妯″瀷锛� + - 涓枃閫氱敤妯″瀷锛歔Paraformer-large](egs_modelscope/asr/paraformer/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch)锛孾Paraformer-large闀块煶棰戠増鏈琞(egs_modelscope/asr_vad_punc/speech_paraformer-large-vad-punc_asr_nat-zh-cn-16k-common-vocab8404-pytorch)锛孾Paraformer-large娴佸紡鐗堟湰](egs_modelscope/asr/paraformer/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-online) + - 涓枃閫氱敤鐑瘝妯″瀷锛歔Paraformer-large-contextual](egs_modelscope/asr/paraformer/speech_paraformer-large-contextual_asr_nat-zh-cn-16k-common-vocab8404)锛� + - 鑻辨枃閫氱敤妯″瀷锛歔Conformer]() + - 娴佸紡绂荤嚎涓�浣撳寲妯″瀷锛� [16k UniASR闂藉崡璇璢(https://modelscope.cn/models/damo/speech_UniASR_asr_2pass-minnan-16k-common-vocab3825/summary)銆� [16k UniASR娉曡](https://modelscope.cn/models/damo/speech_UniASR_asr_2pass-fr-16k-common-vocab3472-tensorflow1-online/summary)銆� [16k UniASR寰疯](https://modelscope.cn/models/damo/speech_UniASR_asr_2pass-de-16k-common-vocab3690-tensorflow1-online/summary)銆� [16k UniASR瓒婂崡璇璢(https://modelscope.cn/models/damo/speech_UniASR_asr_2pass-vi-16k-common-vocab1001-pytorch-online/summary)銆� [16k UniASR娉㈡柉璇璢(https://modelscope.cn/models/damo/speech_UniASR_asr_2pass-fa-16k-common-vocab1257-pytorch-online/summary), + [16k UniASR缂呯敻璇璢(https://modelscope.cn/models/damo/speech_UniASR_asr_2pass-my-16k-common-vocab696-pytorch/summary)銆� [16k UniASR甯屼集鏉ヨ](https://modelscope.cn/models/damo/speech_UniASR_asr_2pass-he-16k-common-vocab1085-pytorch/summary)銆� [16k UniASR涔屽皵閮借](https://modelscope.cn/models/damo/speech_UniASR_asr_2pass-ur-16k-common-vocab877-pytorch/summary)銆� [8k UniASR涓枃閲戣瀺棰嗗煙](https://www.modelscope.cn/models/damo/speech_UniASR_asr_2pass-zh-cn-8k-finance-vocab3445-online/summary)銆乕16k UniASR涓枃闊宠棰戦鍩焆(https://www.modelscope.cn/models/damo/speech_UniASR_asr_2pass-zh-cn-16k-audio_and_video-vocab3445-online/summary) + +### 璇磋瘽浜鸿瘑鍒� + - 璇磋瘽浜虹‘璁ゆā鍨嬶細[xvector](egs_modelscope/speaker_verification) + - 璇磋瘽浜烘棩蹇楁ā鍨嬶細[SOND](egs/callhome/diarization/sond) -- 2023/07/06 +### 鏍囩偣鎭㈠ + - 涓枃鏍囩偣妯″瀷锛歔CT-Transformer](egs_modelscope/punctuation/punc_ct-transformer_zh-cn-common-vocab272727-pytorch)锛孾CT-Transformer娴佸紡](egs_modelscope/punctuation/punc_ct-transformer_zh-cn-common-vadrealtime-vocab272727) +### 绔偣妫�娴� + - [FSMN-VAD](egs_modelscope/vad/speech_fsmn_vad_zh-cn-16k-common) + +### 鏃堕棿鎴抽娴� + - 瀛楃骇鍒ā鍨嬶細[TP-Aligner](egs_modelscope/tp/speech_timestamp_prediction-v1-16k-offline) + +<a name="鏍稿績鍔熻兘"></a> ## 鏍稿績鍔熻兘 - FunASR鏄竴涓熀纭�璇煶璇嗗埆宸ュ叿鍖咃紝鎻愪緵澶氱鍔熻兘锛屽寘鎷闊宠瘑鍒紙ASR锛夈�佽闊虫椿鍔ㄦ娴嬶紙VAD锛夈�佹爣鐐规仮澶嶃�佽瑷�妯″瀷銆佽璇濅汉楠岃瘉銆佽璇濅汉鍒嗙鍜屽浜哄璇濊闊宠瘑鍒�� - 鎴戜滑鍦╗ModelScope](https://www.modelscope.cn/models?page=1&tasks=auto-speech-recognition)涓婂彂甯冧簡澶ч噺鐨勫鏈拰宸ヤ笟棰勮缁冩ā鍨嬶紝鍙互閫氳繃鎴戜滑鐨刐妯″瀷浠撳簱](https://github.com/alibaba-damo-academy/FunASR/blob/main/docs/model_zoo/modelscope_models.md)璁块棶銆備唬琛ㄦ�х殑[Paraformer-large](https://www.modelscope.cn/models/damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch/summary)妯″瀷鍦ㄨ澶氳闊宠瘑鍒换鍔′腑瀹炵幇浜哠OTA鎬ц兘銆� - FunASR鎻愪緵浜嗕竴涓槗浜庝娇鐢ㄧ殑鎺ュ彛锛屽彲浠ョ洿鎺ュ熀浜嶮odelScope涓墭绠℃ā鍨嬭繘琛屾帹鐞嗕笌寰皟銆傛澶栵紝FunASR涓殑浼樺寲鏁版嵁鍔犺浇鍣ㄥ彲浠ュ姞閫熷ぇ瑙勬ā鏁版嵁闆嗙殑璁粌閫熷害銆� +<a name="瀹夎鏁欑▼"></a> ## 瀹夎鏁欑▼ 鐩存帴瀹夎鍙戝竷杞欢鍖� @@ -72,7 +101,8 @@ 鏇磋缁嗗畨瑁呰繃绋嬩粙缁嶏紙[鐐瑰嚮姝ゅ](https://alibaba-damo-academy.github.io/FunASR/en/installation/installation.html)锛� -## 濡備綍浣跨敤 +<a name="蹇�熷紑濮�"></a> +## 蹇�熷紑濮� 鎮ㄥ彲浠ラ�氳繃濡備笅鍑犵鏂瑰紡浣跨敤FunASR鍔熻兘: @@ -84,7 +114,7 @@ #### python鐗堟湰绀轰緥 -鏀寔瀹炴椂娴佸紡璇煶璇嗗埆锛屽苟涓斾細鐢ㄩ潪娴佸紡妯″瀷杩涜绾犻敊锛岃緭鍑烘枃鏈甫鏈夋爣鐐广�傜洰鍓嶅彧鏀寔鍗曚釜client锛屽闇�澶氬苟鍙戣鍙傝�僣++鐗堟湰鏈嶅姟閮ㄧ讲SDK锛圼鐐瑰嚮姝ゅ]()锛� +鏀寔瀹炴椂娴佸紡璇煶璇嗗埆锛屽苟涓斾細鐢ㄩ潪娴佸紡妯″瀷杩涜绾犻敊锛岃緭鍑烘枃鏈甫鏈夋爣鐐广�傜洰鍓嶅彧鏀寔鍗曚釜client锛屽闇�澶氬苟鍙戣鍙傝�冧笅鏂筩++鐗堟湰鏈嶅姟閮ㄧ讲SDK ##### 鏈嶅姟绔儴缃� ```shell @@ -99,6 +129,7 @@ ``` 鏇村渚嬪瓙鍙互鍙傝�冿紙[鐐瑰嚮姝ゅ](https://alibaba-damo-academy.github.io/FunASR/en/runtime/websocket_python.html#id2)锛� +<a name="cpp鐗堟湰绀轰緥"></a> #### c++鐗堟湰绀轰緥 鐩墠宸叉敮鎸佺绾挎枃浠惰浆鍐欐湇鍔★紙CPU锛夛紝鏀寔涓婄櫨璺苟鍙戣姹� @@ -151,12 +182,12 @@ 鏇村渚嬪瓙鍙互鍙傝�冿紙[鐐瑰嚮姝ゅ](https://alibaba-damo-academy.github.io/FunASR/en/academic_recipe/asr_recipe.html)锛� - +<a name="鑱旂郴鎴戜滑"></a> ## 鑱旂郴鎴戜滑 -濡傛灉鎮ㄥ湪浣跨敤涓亣鍒板洶闅撅紝鍙互閫氳繃涓�涓嬫柟寮忚仈绯绘垜浠� +濡傛灉鎮ㄥ湪浣跨敤涓亣鍒板洶闅撅紝鍙互閫氳繃浠ヤ笅鏂瑰紡鑱旂郴鎴戜滑 -- email: [funasr@list.alibaba-inc.com](funasr@list.alibaba-inc.com) +- 閭欢: [funasr@list.alibaba-inc.com](funasr@list.alibaba-inc.com) | 閽夐拤缇� | 寰俊 | |:---------------------------------------------------------------------:|:-----------------------------------------------------:| @@ -171,7 +202,7 @@ ## 璁稿彲鍗忚 -椤圭洰閬靛惊[The MIT License](https://opensource.org/licenses/MIT)寮�婧愬崗璁�. 宸ヤ笟妯″瀷璁稿彲鍗忚璇峰弬鑰冿紙[鐐瑰嚮姝ゅ](./MODEL_LICENSE)锛� +椤圭洰閬靛惊[The MIT License](https://opensource.org/licenses/MIT)寮�婧愬崗璁�� 宸ヤ笟妯″瀷璁稿彲鍗忚璇峰弬鑰冿紙[鐐瑰嚮姝ゅ](./MODEL_LICENSE)锛� ## Stargazers over time -- Gitblit v1.9.1