From 4f8bce944e273e317cb84c7046ea514b9d958b4b Mon Sep 17 00:00:00 2001
From: zhuzizyf <42790740+zhuzizyf@users.noreply.github.com>
Date: 星期六, 22 四月 2023 14:54:49 +0800
Subject: [PATCH] Update FsmnVad.cc
---
funasr/export/README.md | 15 +++++++++++++--
1 files changed, 13 insertions(+), 2 deletions(-)
diff --git a/funasr/export/README.md b/funasr/export/README.md
index b3068d0..8f57673 100644
--- a/funasr/export/README.md
+++ b/funasr/export/README.md
@@ -1,3 +1,4 @@
+# Export models
## Environments
torch >= 1.11.0
@@ -7,7 +8,7 @@
## Install modelscope and funasr
-The installation is the same as [funasr](../../README.md)
+The installation is the same as [funasr](https://github.com/alibaba-damo-academy/FunASR/blob/main/README.md#installation)
## Export model
`Tips`: torch>=1.11.0
@@ -17,7 +18,7 @@
--model-name [model_name] \
--export-dir [export_dir] \
--type [onnx, torch] \
- --quantize \
+ --quantize [true, false] \
--fallback-num [fallback_num]
```
`model-name`: the model is to export. It could be the models from modelscope, or local finetuned model(named: model.pb).
@@ -30,6 +31,16 @@
`fallback-num`: specify the number of fallback layers to perform automatic mixed precision quantization.
+## Performance Benchmark of Runtime
+
+### Paraformer on CPU
+
+[onnx runtime](https://github.com/alibaba-damo-academy/FunASR/blob/main/funasr/runtime/python/benchmark_onnx.md)
+
+[libtorch runtime](https://github.com/alibaba-damo-academy/FunASR/blob/main/funasr/runtime/python/benchmark_libtorch.md)
+
+### Paraformer on GPU
+[nv-triton](https://github.com/alibaba-damo-academy/FunASR/tree/main/funasr/runtime/triton_gpu)
## For example
### Export onnx format model
--
Gitblit v1.9.1