Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Facing errors when installing onnxruntime backend for triton #247

Open
Aniket-20 opened this issue Mar 15, 2024 · 0 comments
Open

Facing errors when installing onnxruntime backend for triton #247

Aniket-20 opened this issue Mar 15, 2024 · 0 comments

Comments

@Aniket-20
Copy link

/home/aniket/server/src/grpc_server.cc: In lambda function:
/home/aniket/server/src/grpc_server.cc:826:24: error: narrowing conversion of ‘(int)byte_size’ from ‘int’ to ‘google::protobuf::stringpiece_internal::StringPiece::size_type’ {aka ‘long unsigned int’} [-Werror=narrowing]
826 | {buffer, (int)byte_size}, response->mutable_config());
| ^~~~~~~~~~~~~~
/home/aniket/server/src/grpc_server.cc: In instantiation of ‘TRITONSERVER_Error* triton::server::{anonymous}::InferResponseCompleteCommon(TRITONSERVER_Server*, TRITONSERVER_InferenceResponse*, inference::ModelInferResponse&, const triton::server::{anonymous}::AllocPayload&) [with ResponseType = inference::ModelInferResponse]’:
/home/aniket/server/src/grpc_server.cc:3800:69: required from here
/home/aniket/server/src/grpc_server.cc:3353:5: error: enumeration value ‘TRITONSERVER_PARAMETER_DOUBLE’ not handled in switch [-Werror=switch]
3353 | switch (type) {
| ^~~~~~
/home/aniket/server/src/grpc_server.cc: In instantiation of ‘TRITONSERVER_Error* triton::server::{anonymous}::InferResponseCompleteCommon(TRITONSERVER_Server*, TRITONSERVER_InferenceResponse*, inference::ModelInferResponse&, const triton::server::{anonymous}::AllocPayload&) [with ResponseType = inference::ModelStreamInferResponse]’:
/home/aniket/server/src/grpc_server.cc:4400:77: required from here
/home/aniket/server/src/grpc_server.cc:3353:5: error: enumeration value ‘TRITONSERVER_PARAMETER_DOUBLE’ not handled in switch [-Werror=switch]
cc1plus: all warnings being treated as errors
make[5]: *** [CMakeFiles/grpc-endpoint-library.dir/build.make:76: CMakeFiles/grpc-endpoint-library.dir/grpc_server.cc.o] Error 1
make[4]: *** [CMakeFiles/Makefile2:440: CMakeFiles/grpc-endpoint-library.dir/all] Error 2
make[3]: *** [Makefile:136: all] Error 2
make[2]: *** [CMakeFiles/triton-server.dir/build.make:86: triton-server/src/triton-server-stamp/triton-server-build] Error 2
make[1]: *** [CMakeFiles/Makefile2:193: CMakeFiles/triton-server.dir/all] Error 2
make: *** [Makefile:136: all] Error 2

Triton Information
nvcr.io/nvidia/tritonserver:24.02-py3 using docker container
Version:24.02

cmake used for installing backend :
$ mkdir build
$ cd build
$ cmake -DCMAKE_INSTALL_PREFIX:PATH=pwd/install -DTRITON_BUILD_ONNXRUNTIME_VERSION=1.1.1 -DTRITON_BUILD_CONTAINER_VERSION=24.02 ..
$ make install

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant