| | |
| | | ## Using paraformer with ONNXRuntime |
| | | ## Using funasr with ONNXRuntime |
| | | |
| | | <p align="left"> |
| | | <a href=""><img src="https://img.shields.io/badge/Python->=3.7,<=3.10-aff.svg"></a> |
| | | <a href=""><img src="https://img.shields.io/badge/OS-Linux%2C%20Win%2C%20Mac-pink.svg"></a> |
| | | </p> |
| | | |
| | | ### Introduction |
| | | - Model comes from [speech_paraformer](https://www.modelscope.cn/models/damo/speech_paraformer-large_asr_nat-zh-cn-16k-common-vocab8404-pytorch/summary). |
| | |
| | | ### Steps: |
| | | 1. Export the model. |
| | | - Command: (`Tips`: torch >= 1.11.0 is required.) |
| | | |
| | | ```shell |
| | | python -m funasr.export.export_model [model_name] [export_dir] [true] |
| | | ``` |
| | | `model_name`: the model is to export. |
| | | |
| | | `export_dir`: the dir where the onnx is export. |
| | | |
| | | More details ref to ([export docs](https://github.com/alibaba-damo-academy/FunASR/tree/main/funasr/export)) |
| | | |
| | |
| | | |
| | | |
| | | 2. Install the `funasr_onnx`. |
| | | - Build the funasr_onnx `whl` |
| | | ```shell |
| | | git clone https://github.com/alibaba/FunASR.git && cd FunASR |
| | | cd funasr/runtime/python/onnxruntime |
| | | python setup.py bdist_wheel |
| | | ``` |
| | | - Install the build `whl` |
| | | ```bash |
| | | pip install dist/funasr_onnx-0.0.2-py3-none-any.whl |
| | | ``` |
| | | ```shell |
| | | pip install funasr_onnx -i https://pypi.Python.org/simple |
| | | ``` |
| | | |
| | | |
| | | 3. Run the demo. |
| | | - Model_dir: the model path, which contains `model.onnx`, `config.yaml`, `am.mvn`. |