You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I try to upload a 10MB PDF file. The PDF file contains text and images because it's a digital newspaper. I've set Qdrant as my vector store. I got error timed out when I try to upload the file.
This is the log from Kotaemon app:
2024-12-27 13:03:20 use_quick_index_mode False
2024-12-27 13:03:21 reader_mode default
2024-12-27 13:03:21 Using reader <kotaemon.loaders.pdf_loader.PDFThumbnailReader object at 0x7fa79b7c78e0>
2024-12-27 13:04:02 Page numbers: 17
2024-12-27 13:04:09 Got 17 page thumbnails
2024-12-27 13:04:09 Adding documents to doc store
2024-12-27 13:04:10 Getting embeddings for 162 nodes
2024-12-27 13:04:37 INFO:httpx:HTTP Request: POST http://host.docker.internal:11434/v1/embeddings "HTTP/1.1 200 OK"
2024-12-27 13:04:40 Adding embeddings to vector store
2024-12-27 13:04:40 INFO:httpx:HTTP Request: GET http://qdrant:6333/collections/index_1/exists "HTTP/1.1 200 OK"
2024-12-27 13:04:40 INFO:httpx:HTTP Request: GET http://qdrant:6333/collections/index_1 "HTTP/1.1 200 OK"
2024-12-27 13:04:40 INFO:httpx:HTTP Request: PUT http://qdrant:6333/collections/index_1/points?wait=true "HTTP/1.1 200 OK"
2024-12-27 13:04:40 INFO:httpx:HTTP Request: PUT http://qdrant:6333/collections/index_1/points?wait=true "HTTP/1.1 200 OK"
2024-12-27 13:04:45 WARNING:root:Batch upload failed 1 times. Retrying...
2024-12-27 13:04:52 WARNING:root:Batch upload failed 2 times. Retrying...
2024-12-27 13:04:58 WARNING:root:Batch upload failed 3 times. Retrying...
2024-12-27 13:04:58 ERROR:ktem.index.file.pipelines:timed out
2024-12-27 13:04:58 Traceback (most recent call last):
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/httpx/_transports/default.py", line 72, in map_httpcore_exceptions
2024-12-27 13:04:58 yield
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/httpx/_transports/default.py", line 236, in handle_request
2024-12-27 13:04:58 resp = self._pool.handle_request(req)
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/httpcore/_sync/connection_pool.py", line 256, in handle_request
2024-12-27 13:04:58 raise exc from None
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/httpcore/_sync/connection_pool.py", line 236, in handle_request
2024-12-27 13:04:58 response = connection.handle_request(
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/httpcore/_sync/connection.py", line 103, in handle_request
2024-12-27 13:04:58 return self._connection.handle_request(request)
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/httpcore/_sync/http11.py", line 136, in handle_request
2024-12-27 13:04:58 raise exc
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/httpcore/_sync/http11.py", line 88, in handle_request
2024-12-27 13:04:58 self._send_request_body(**kwargs)
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/httpcore/_sync/http11.py", line 159, in _send_request_body
2024-12-27 13:04:58 self._send_event(event, timeout=timeout)
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/httpcore/_sync/http11.py", line 166, in _send_event
2024-12-27 13:04:58 self._network_stream.write(bytes_to_send, timeout=timeout)
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/httpcore/_backends/sync.py", line 135, in write
2024-12-27 13:04:58 with map_exceptions(exc_map):
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/contextlib.py", line 153, in __exit__
2024-12-27 13:04:58 self.gen.throw(typ, value, traceback)
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
2024-12-27 13:04:58 raise to_exc(exc) from exc
2024-12-27 13:04:58 httpcore.WriteTimeout: timed out
2024-12-27 13:04:58
2024-12-27 13:04:58 The above exception was the direct cause of the following exception:
2024-12-27 13:04:58
2024-12-27 13:04:58 Traceback (most recent call last):
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/qdrant_client/http/api_client.py", line 106, in send_inner
2024-12-27 13:04:58 response = self._client.send(request)
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/httpx/_client.py", line 926, in send
2024-12-27 13:04:58 response = self._send_handling_auth(
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/httpx/_client.py", line 954, in _send_handling_auth
2024-12-27 13:04:58 response = self._send_handling_redirects(
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/httpx/_client.py", line 991, in _send_handling_redirects
2024-12-27 13:04:58 response = self._send_single_request(request)
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/httpx/_client.py", line 1027, in _send_single_request
2024-12-27 13:04:58 response = transport.handle_request(request)
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/httpx/_transports/default.py", line 235, in handle_request
2024-12-27 13:04:58 with map_httpcore_exceptions():
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/contextlib.py", line 153, in __exit__
2024-12-27 13:04:58 self.gen.throw(typ, value, traceback)
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/httpx/_transports/default.py", line 89, in map_httpcore_exceptions
2024-12-27 13:04:58 raise mapped_exc(message) from exc
2024-12-27 13:04:58 httpx.WriteTimeout: timed out
2024-12-27 13:04:58
2024-12-27 13:04:58 During handling of the above exception, another exception occurred:
2024-12-27 13:04:58
2024-12-27 13:04:58 Traceback (most recent call last):
2024-12-27 13:04:58 File "/app/libs/ktem/ktem/index/file/pipelines.py", line 799, in stream
2024-12-27 13:04:58 file_id, docs = yield from pipeline.stream(
2024-12-27 13:04:58 File "/app/libs/ktem/ktem/index/file/pipelines.py", line 645, in stream
2024-12-27 13:04:58 yield from self.handle_docs(docs, file_id, file_name)
2024-12-27 13:04:58 File "/app/libs/ktem/ktem/index/file/pipelines.py", line 415, in handle_docs
2024-12-27 13:04:58 yield from insert_chunks_to_vectorstore()
2024-12-27 13:04:58 File "/app/libs/ktem/ktem/index/file/pipelines.py", line 400, in insert_chunks_to_vectorstore
2024-12-27 13:04:58 self.handle_chunks_vectorstore(chunks, file_id)
2024-12-27 13:04:58 File "/app/libs/ktem/ktem/index/file/pipelines.py", line 442, in handle_chunks_vectorstore
2024-12-27 13:04:58 self.vector_indexing.add_to_vectorstore(chunks)
2024-12-27 13:04:58 File "/app/libs/kotaemon/kotaemon/indices/vectorindex.py", line 98, in add_to_vectorstore
2024-12-27 13:04:58 self.vector_store.add(
2024-12-27 13:04:58 File "/app/libs/kotaemon/kotaemon/storages/vectorstores/base.py", line 135, in add
2024-12-27 13:04:58 return self._client.add(nodes=nodes)
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/llama_index/vector_stores/qdrant/base.py", line 416, in add
2024-12-27 13:04:58 self._client.upload_points(
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/qdrant_client/qdrant_client.py", line 2439, in upload_points
2024-12-27 13:04:58 return self._client.upload_points(
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/qdrant_client/qdrant_remote.py", line 2965, in upload_points
2024-12-27 13:04:58 self._upload_collection(
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/qdrant_client/qdrant_remote.py", line 2917, in _upload_collection
2024-12-27 13:04:58 for _ in updater.process(batches_iterator):
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/qdrant_client/uploader/rest_uploader.py", line 81, in process
2024-12-27 13:04:58 yield upload_batch(
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/qdrant_client/uploader/rest_uploader.py", line 47, in upload_batch
2024-12-27 13:04:58 raise e
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/qdrant_client/uploader/rest_uploader.py", line 37, in upload_batch
2024-12-27 13:04:58 openapi_client.points_api.upsert_points(
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/qdrant_client/http/api/points_api.py", line 1871, in upsert_points
2024-12-27 13:04:58 return self._build_for_upsert_points(
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/qdrant_client/http/api/points_api.py", line 954, in _build_for_upsert_points
2024-12-27 13:04:58 return self.api_client.request(
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/qdrant_client/http/api_client.py", line 79, in request
2024-12-27 13:04:58 return self.send(request, type_)
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/qdrant_client/http/api_client.py", line 96, in send
2024-12-27 13:04:58 response = self.middleware(request, self.send_inner)
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/qdrant_client/http/api_client.py", line 205, in __call__
2024-12-27 13:04:58 return call_next(request)
2024-12-27 13:04:58 File "/usr/local/lib/python3.10/site-packages/qdrant_client/http/api_client.py", line 108, in send_inner
2024-12-27 13:04:58 raise ResponseHandlingException(e)
2024-12-27 13:04:58 qdrant_client.http.exceptions.ResponseHandlingException: timed out
Description
I try to upload a 10MB PDF file. The PDF file contains text and images because it's a digital newspaper. I've set Qdrant as my vector store. I got error
timed out
when I try to upload the file.This is the log from Kotaemon app:
This is log from Qdrant:
Reproduction steps
Screenshots
No response
Logs
Browsers
Brave
OS
Windows
Additional information
No response
The text was updated successfully, but these errors were encountered: