KeyError: 'vi' ! Can you please support Vietnamese language!

[binhbong9]

Thank you for creating a great application, if possible can you support Vietnamese language? I found there is a Vietnamese model that can run Vietnamese very well https://huggingface.co/capleaf/viXTTS

In addition, I also get the following error when I use this model:

2024-11-06 12:52:16.904 | INFO | main:init:73 - Setting unload timer to 300 seconds
INFO: 172.21.0.1:52558 - "POST /v1/audio/speech HTTP/1.1" 500 Internal Server Error
ERROR: Exception in ASGI application

• Exception Group Traceback (most recent call last):
  | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 83, in collapse_excgroups
  | yield
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 190, in call
  | async with anyio.create_task_group() as task_group:
  | File "/usr/local/lib/python3.11/site-packages/anyio/_backends/_asyncio.py", line 680, in aexit
  | raise BaseExceptionGroup(
  | ExceptionGroup: unhandled errors in a TaskGroup (1 sub-exception)
  +-+---------------- 1 ----------------
  | Traceback (most recent call last):
  | File "/usr/local/lib/python3.11/site-packages/uvicorn/protocols/http/h11_impl.py", line 406, in run_asgi
  | result = await app( # type: ignore[func-returns-value]
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 70, in call
  | return await self.app(scope, receive, send)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
  | await super().call(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in call
  | await self.middleware_stack(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in call
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in call
  | await self.app(scope, receive, _send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
  | with collapse_excgroups():
  | File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
  | self.gen.throw(typ, value, traceback)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 89, in collapse_excgroups
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 191, in call
  | response = await self.dispatch_func(request, call_next)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/app/openedai.py", line 126, in log_requests
  | response = await call_next(request)
  | ^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 165, in call_next
  | raise app_exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
  | await self.app(scope, receive_or_disconnect, send_no_error)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 85, in call
  | await self.app(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 65, in call
  | await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
  | await app(scope, receive, sender)
  | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 754, in call
  | await self.middleware_stack(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 774, in app
  | await route.handle(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 295, in handle
  | await self.app(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 77, in app
  | await wrap_app_handling_exceptions(app, request)(scope, receive, send)
  | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
  | raise exc
  | File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
  | await app(scope, receive, sender)
  | File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 74, in app
  | response = await f(request)
  | ^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 278, in app
  | raw_response = await run_endpoint_function(
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 191, in run_endpoint_function
  | return await dependant.call(**values)
  | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  | File "/app/speech.py", line 313, in generate_speech
  | all_text = split_sentence(input_text, split_lang, xtts.xtts.tokenizer.char_limits[split_lang])
  | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^
  | KeyError: 'vi'
  +------------------------------------

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/local/lib/python3.11/site-packages/uvicorn/protocols/http/h11_impl.py", line 406, in run_asgi
result = await app( # type: ignore[func-returns-value]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/uvicorn/middleware/proxy_headers.py", line 70, in call
return await self.app(scope, receive, send)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
await super().call(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/starlette/applications.py", line 123, in call
await self.middleware_stack(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 186, in call
raise exc
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/errors.py", line 164, in call
await self.app(scope, receive, _send)
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 189, in call
with collapse_excgroups():
File "/usr/local/lib/python3.11/contextlib.py", line 158, in exit
self.gen.throw(typ, value, traceback)
File "/usr/local/lib/python3.11/site-packages/starlette/_utils.py", line 89, in collapse_excgroups
raise exc
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 191, in call
response = await self.dispatch_func(request, call_next)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/openedai.py", line 126, in log_requests
response = await call_next(request)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 165, in call_next
raise app_exc
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/base.py", line 151, in coro
await self.app(scope, receive_or_disconnect, send_no_error)
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/cors.py", line 85, in call
await self.app(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 65, in call
await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
raise exc
File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
await app(scope, receive, sender)
File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 754, in call
await self.middleware_stack(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 774, in app
await route.handle(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 295, in handle
await self.app(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 77, in app
await wrap_app_handling_exceptions(app, request)(scope, receive, send)
File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 64, in wrapped_app
raise exc
File "/usr/local/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
await app(scope, receive, sender)
File "/usr/local/lib/python3.11/site-packages/starlette/routing.py", line 74, in app
response = await f(request)
^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 278, in app
raw_response = await run_endpoint_function(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/fastapi/routing.py", line 191, in run_endpoint_function
return await dependant.call(**values)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/app/speech.py", line 313, in generate_speech
all_text = split_sentence(input_text, split_lang, xtts.xtts.tokenizer.char_limits[split_lang])
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^
KeyError: 'vi'

[matatonic]

I'm a bit busy with other priorities right now, but I'll see what I can do to enable vi in future releases. This error is related to sentence level splitting, which you can disable by setting "enable_text_splitting: False" for the model, see the bottom of the README.md for syntax examples. I don't know if this is all that will be required, and you will need to limit the input to about 250 tokens at a time, but it may get you working until a real fix comes along.