From 4dc5bd63a2aa4a93beadacaf88768dc78cf4c0eb Mon Sep 17 00:00:00 2001
From: 游雁 <zhifu.gzf@alibaba-inc.com>
Date: 星期五, 24 三月 2023 11:39:15 +0800
Subject: [PATCH] v0.3.1
---
funasr/runtime/python/libtorch/README.md | 36 +++++++++++++++++-------------------
1 files changed, 17 insertions(+), 19 deletions(-)
diff --git a/funasr/runtime/python/libtorch/README.md b/funasr/runtime/python/libtorch/README.md
index 33a56af..b14268f 100644
--- a/funasr/runtime/python/libtorch/README.md
+++ b/funasr/runtime/python/libtorch/README.md
@@ -9,7 +9,7 @@
- Command: (`Tips`: torch >= 1.11.0 is required.)
```shell
- python -m funasr.export.export_model [model_name] [export_dir] [true]
+ python -m funasr.export.export_model [model_name] [export_dir] false
```
`model_name`: the model is to export.
@@ -19,25 +19,22 @@
- `e.g.`, Export model from modelscope
```shell
- python -m funasr.export.export_model 'damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch' "./export" true
+ python -m funasr.export.export_model --model-name damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch --export-dir ./export --type torch --quantize False
```
- `e.g.`, Export model from local path, the model'name must be `model.pb`.
```shell
- python -m funasr.export.export_model '/mnt/workspace/damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch' "./export" true
+ python -m funasr.export.export_model --model-name ./damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch --export-dir ./export --type torch --quantize False
```
-2. Install the `torch_paraformer`.
- - Build the torch_paraformer `whl`
- ```shell
- git clone https://github.com/alibaba/FunASR.git && cd FunASR
- cd funasr/runtime/python/libtorch
- python setup.py bdist_wheel
- ```
- - Install the build `whl`
- ```bash
- pip install dist/torch_paraformer-0.0.1-py3-none-any.whl
- ```
+2. Install the `funasr_torch`.
+ ```shell
+ git clone https://github.com/alibaba/FunASR.git && cd FunASR
+ cd funasr/runtime/python/libtorch
+ python setup.py build
+ python setup.py install
+ ```
+
3. Run the demo.
- Model_dir: the model path, which contains `model.torchscripts`, `config.yaml`, `am.mvn`.
@@ -45,7 +42,7 @@
- Output: `List[str]`: recognition result.
- Example:
```python
- from torch_paraformer import Paraformer
+ from funasr_torch import Paraformer
model_dir = "/nfs/zhifu.gzf/export/damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch"
model = Paraformer(model_dir, batch_size=1)
@@ -62,9 +59,10 @@
Test [wav, 5.53s, 100 times avg.](https://isv-data.oss-cn-hangzhou.aliyuncs.com/ics/MaaS/ASR/test_audio/asr_example_zh.wav)
-| Backend | RTF |
-|:-------:|:-----------------:|
-| Pytorch | 0.110 |
-| Onnx | 0.038 |
+| Backend | RTF (FP32) |
+|:--------:|:----------:|
+| Pytorch | 0.110 |
+| Libtorch | 0.048 |
+| Onnx | 0.038 |
## Acknowledge
--
Gitblit v1.9.1