新的 ort 多态部署库,以支持 CUDA、TensorRT 和 OpenVINO 的 Provider 选择 #96
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Pull Request 合并请求准备清单
详情参见此处
具体内容
rm::OnnxRT
更名为rm::OnnxNet
,并更改为抽象类rm::ClassificationNet
,并作为rm::OnnxNet
的派生实现rm::OnnxRT
的推理接口由于无法做到按返回类型协变,因此使用std::any
作为返回类型,并提供cast
转换函数,以便于转换至正确的类型,例如分类网络在实际推理时,可使用