Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add C++ API for streaming zipformer ASR on RK NPU #1908

Merged
merged 10 commits into from
Feb 24, 2025
Merged

Add C++ API for streaming zipformer ASR on RK NPU #1908

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
eba102d
WIP: Begin to add C++ API for streaming zipformer ASR on RK NPU
csukuangfj Feb 21, 2025
114f379
Read input and output attrs
csukuangfj Feb 22, 2025
3171b94
read custom string
csukuangfj Feb 22, 2025
c96b54a
parse custom string
csukuangfj Feb 23, 2025
bea1181
First working version
csukuangfj Feb 24, 2025
2d1a1cb
add some notes about transpose
csukuangfj Feb 24, 2025
66c1fa2
Cache decoder out
csukuangfj Feb 24, 2025
e7e9fa8
Add Reset and IsEndpoint
csukuangfj Feb 24, 2025
ec777fe
Add CI
csukuangfj Feb 24, 2025
bed0b6c
Small fixes
csukuangfj Feb 24, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 4 additions & 2 deletions .github/workflows/aarch64-linux-gnu-shared.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -196,6 +196,7 @@ jobs:
timeout_seconds: 200
shell: bash
command: |
SHERPA_ONNX_VERSION=$(grep "SHERPA_ONNX_VERSION" ./CMakeLists.txt | cut -d " " -f 2 | cut -d '"' -f 2)
git config --global user.email "[email protected]"
git config --global user.name "Fangjun Kuang"

Expand All @@ -204,9 +205,10 @@ jobs:
GIT_LFS_SKIP_SMUDGE=1 git clone https://csukuangfj:[email protected]/csukuangfj/sherpa-onnx-libs huggingface

cd huggingface
mkdir -p aarch64
dst=aarch64/$SHERPA_ONNX_VERSION
mkdir -p $dst

cp -v ../sherpa-onnx-*-shared*.tar.bz2 ./aarch64
cp -v ../sherpa-onnx-*-shared*.tar.bz2 $dst/

git status
git lfs track "*.bz2"
Expand Down
6 changes: 4 additions & 2 deletions .github/workflows/aarch64-linux-gnu-static.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -124,6 +124,7 @@ jobs:
timeout_seconds: 200
shell: bash
command: |
SHERPA_ONNX_VERSION=$(grep "SHERPA_ONNX_VERSION" ./CMakeLists.txt | cut -d " " -f 2 | cut -d '"' -f 2)
git config --global user.email "[email protected]"
git config --global user.name "Fangjun Kuang"

Expand All @@ -132,9 +133,10 @@ jobs:
GIT_LFS_SKIP_SMUDGE=1 git clone https://csukuangfj:[email protected]/csukuangfj/sherpa-onnx-libs huggingface

cd huggingface
mkdir -p aarch64
dst=aarch64/$SHERPA_ONNX_VERSION
mkdir -p $dst

cp -v ../sherpa-onnx-*-static.tar.bz2 ./aarch64
cp -v ../sherpa-onnx-*-static.tar.bz2 $dst/

git status
git lfs track "*.bz2"
Expand Down
8 changes: 6 additions & 2 deletions .github/workflows/android-static.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -140,6 +140,7 @@ jobs:
timeout_seconds: 200
shell: bash
command: |
SHERPA_ONNX_VERSION=$(grep "SHERPA_ONNX_VERSION" ./CMakeLists.txt | cut -d " " -f 2 | cut -d '"' -f 2)
git config --global user.email "[email protected]"
git config --global user.name "Fangjun Kuang"
du -h -d1 .
Expand All @@ -150,8 +151,10 @@ jobs:
GIT_LFS_SKIP_SMUDGE=1 git clone https://csukuangfj:[email protected]/csukuangfj/sherpa-onnx-libs huggingface

cd huggingface
dst=$SHERPA_ONNX_VERSION
mkdir -p $dst

cp -v ../sherpa-onnx-*-android*.tar.bz2 ./
cp -v ../sherpa-onnx-*-android*.tar.bz2 $dst/

git status
git lfs track "*.bz2"
Expand Down Expand Up @@ -263,6 +266,7 @@ jobs:
timeout_seconds: 200
shell: bash
command: |
SHERPA_ONNX_VERSION=$(grep "SHERPA_ONNX_VERSION" ./CMakeLists.txt | cut -d " " -f 2 | cut -d '"' -f 2)
git config --global user.email "[email protected]"
git config --global user.name "Fangjun Kuang"
du -h -d1 .
Expand All @@ -273,7 +277,7 @@ jobs:
GIT_LFS_SKIP_SMUDGE=1 git clone https://csukuangfj:[email protected]/csukuangfj/sherpa-onnx-libs huggingface

cd huggingface
dst=android/aar
dst=android/aar/$SHERPA_ONNX_VERSION
mkdir -p $dst

cp -v ../*.aar $dst
Expand Down
6 changes: 4 additions & 2 deletions .github/workflows/arm-linux-gnueabihf.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -199,16 +199,18 @@ jobs:
timeout_seconds: 200
shell: bash
command: |
SHERPA_ONNX_VERSION=$(grep "SHERPA_ONNX_VERSION" ./CMakeLists.txt | cut -d " " -f 2 | cut -d '"' -f 2)
git config --global user.email "[email protected]"
git config --global user.name "Fangjun Kuang"

rm -rf huggingface
GIT_LFS_SKIP_SMUDGE=1 git clone https://csukuangfj:[email protected]/csukuangfj/sherpa-onnx-libs huggingface

cd huggingface
mkdir -p arm32
dst=arm32/$SHERPA_ONNX_VERSION
mkdir -p $dst

cp -v ../sherpa-onnx-*.tar.bz2 ./arm32
cp -v ../sherpa-onnx-*.tar.bz2 $dst/

git status
git lfs track "*.bz2"
Expand Down
6 changes: 4 additions & 2 deletions .github/workflows/dot-net.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -83,6 +83,7 @@ jobs:
timeout_seconds: 200
shell: bash
command: |
SHERPA_ONNX_VERSION=$(grep "SHERPA_ONNX_VERSION" ./CMakeLists.txt | cut -d " " -f 2 | cut -d '"' -f 2)
git config --global user.email "[email protected]"
git config --global user.name "Fangjun Kuang"

Expand All @@ -95,9 +96,10 @@ jobs:
cd huggingface
git fetch
git pull
mkdir -p windows-for-dotnet
dst=windows-for-dotnet/$SHERPA_ONNX_VERSION
mkdir -p $dst

cp -v ../sherpa-onnx-*.tar.bz2 ./windows-for-dotnet
cp -v ../sherpa-onnx-*.tar.bz2 $dst/

git status
git lfs track "*.bz2"
Expand Down
8 changes: 5 additions & 3 deletions .github/workflows/linux-jni-aarch64.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -138,6 +138,7 @@ jobs:
timeout_seconds: 200
shell: bash
command: |
SHERPA_ONNX_VERSION=$(grep "SHERPA_ONNX_VERSION" ./CMakeLists.txt | cut -d " " -f 2 | cut -d '"' -f 2)
git config --global user.email "[email protected]"
git config --global user.name "Fangjun Kuang"

Expand All @@ -146,10 +147,11 @@ jobs:
GIT_LFS_SKIP_SMUDGE=1 git clone https://huggingface.co/csukuangfj/sherpa-onnx-libs huggingface

cd huggingface
mkdir -p jni
dst=jni/$SHERPA_ONNX_VERSION
mkdir -p $dst

cp -v ../sherpa-onnx-*.tar.bz2 ./jni
cp -v ../*.jar ./jni
cp -v ../sherpa-onnx-*.tar.bz2 $dst/
cp -v ../*.jar $dst/

git status
git lfs track "*.bz2"
Expand Down
8 changes: 5 additions & 3 deletions .github/workflows/linux-jni.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -197,6 +197,7 @@ jobs:
timeout_seconds: 200
shell: bash
command: |
SHERPA_ONNX_VERSION=$(grep "SHERPA_ONNX_VERSION" ./CMakeLists.txt | cut -d " " -f 2 | cut -d '"' -f 2)
git config --global user.email "[email protected]"
git config --global user.name "Fangjun Kuang"

Expand All @@ -205,10 +206,11 @@ jobs:
GIT_LFS_SKIP_SMUDGE=1 git clone https://huggingface.co/csukuangfj/sherpa-onnx-libs huggingface

cd huggingface
mkdir -p jni
dst=jni/$SHERPA_ONNX_VERSION
mkdir -p $dst

cp -v ../sherpa-onnx-*.tar.bz2 ./jni
cp -v ../*.jar ./jni
cp -v ../sherpa-onnx-*.tar.bz2 $dst/
cp -v ../*.jar $dst/

git status
git lfs track "*.bz2"
Expand Down
6 changes: 4 additions & 2 deletions .github/workflows/macos-jni.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -113,6 +113,7 @@ jobs:
timeout_seconds: 200
shell: bash
command: |
SHERPA_ONNX_VERSION=$(grep "SHERPA_ONNX_VERSION" ./CMakeLists.txt | cut -d " " -f 2 | cut -d '"' -f 2)
git config --global user.email "[email protected]"
git config --global user.name "Fangjun Kuang"

Expand All @@ -121,9 +122,10 @@ jobs:
GIT_LFS_SKIP_SMUDGE=1 git clone https://huggingface.co/csukuangfj/sherpa-onnx-libs huggingface

cd huggingface
mkdir -p jni
dst=jni/$SHERPA_ONNX_VERSION
mkdir -p $dst

cp -v ../sherpa-onnx-*.tar.bz2 ./jni
cp -v ../sherpa-onnx-*.tar.bz2 $dst

git status
git lfs track "*.bz2"
Expand Down
6 changes: 4 additions & 2 deletions .github/workflows/riscv64-linux.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -239,6 +239,7 @@ jobs:
timeout_seconds: 200
shell: bash
command: |
SHERPA_ONNX_VERSION=$(grep "SHERPA_ONNX_VERSION" ./CMakeLists.txt | cut -d " " -f 2 | cut -d '"' -f 2)
git config --global user.email "[email protected]"
git config --global user.name "Fangjun Kuang"

Expand All @@ -248,9 +249,10 @@ jobs:
GIT_LFS_SKIP_SMUDGE=1 git clone https://huggingface.co/csukuangfj/sherpa-onnx-libs huggingface

cd huggingface
mkdir -p riscv64
dst=riscv64/$SHERPA_ONNX_VERSION
mkdir -p $dst

cp -v ../sherpa-onnx-*-shared.tar.bz2 ./riscv64
cp -v ../sherpa-onnx-*-shared.tar.bz2 $dst/

git status
git lfs track "*.bz2"
Expand Down
Loading
Loading