Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Server Crash #2970

Open
adamkrellenstein opened this issue Jan 27, 2025 · 1 comment
Open

Server Crash #2970

adamkrellenstein opened this issue Jan 27, 2025 · 1 comment
Labels
bug
Milestone
v10.10.2 (API and...

Comments

@adamkrellenstein
Copy link
Member 

2025-01-10T19:43:27.649-05:00 - [    INFO] - Ledger.Main - Block 693431 - Parsing complete. L: ea7e39a, TX: 6f44116, M: a5938a9 (0.36s)
2025-01-10T19:43:27.852-05:00 - [    INFO] - Ledger.Main - Stopping RSFetcher thread...
2025-01-10T19:43:29.578-05:00 - [    INFO] - Ledger.Main - RSFetcher thread stopped.
2025-01-10T19:43:29.578-05:00 - [   ERROR] - Ledger.Main - Exception caught!
Traceback (most recent call last):
  File "/Users/evan/repos/counterparty-core/venv/lib/python3.11/site-packages/requests/models.py", line 974, in json
    return complexjson.loads(self.text, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/[email protected]/3.11.11/Frameworks/Python.framework/Versions/3.11/lib/python3.11/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/[email protected]/3.11.11/Frameworks/Python.framework/Versions/3.11/lib/python3.11/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/[email protected]/3.11.11/Frameworks/Python.framework/Versions/3.11/lib/python3.11/json/decoder.py", line 353, in raw_decode
    obj, end = self.scan_once(s, idx)
               ^^^^^^^^^^^^^^^^^^^^^^
json.decoder.JSONDecodeError: Expecting ',' delimiter: line 1 column 163730 (char 163729)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/Users/evan/repos/counterparty-core/counterparty-core/counterpartycore/lib/backend/bitcoind.py", line 79, in rpc_call
    response_json = response.json()
                    ^^^^^^^^^^^^^^^
  File "/Users/evan/repos/counterparty-core/venv/lib/python3.11/site-packages/requests/models.py", line 978, in json
    raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: Expecting ',' delimiter: line 1 column 163730 (char 163729)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/Users/evan/repos/counterparty-core/counterparty-core/counterpartycore/server.py", line 725, in start_all
    blocks.catch_up(db)
  File "/Users/evan/repos/counterparty-core/counterparty-core/counterpartycore/lib/blocks.py", line 1492, in catch_up
    mempool.clean_mempool(db)
  File "/Users/evan/repos/counterparty-core/counterparty-core/counterpartycore/lib/mempool.py", line 135, in clean_mempool
    raw_mempool = backend.bitcoind.getrawmempool(verbose=False)
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/evan/repos/counterparty-core/counterparty-core/counterpartycore/lib/backend/bitcoind.py", line 233, in getrawmempool
    return rpc("getrawmempool", [True if verbose else False])
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/evan/repos/counterparty-core/counterparty-core/counterpartycore/lib/backend/bitcoind.py", line 143, in rpc
    return rpc_call(payload)
           ^^^^^^^^^^^^^^^^^
  File "/Users/evan/repos/counterparty-core/counterparty-core/counterpartycore/lib/backend/bitcoind.py", line 81, in rpc_call
    raise exceptions.BitcoindRPCError(  # noqa: B904
counterpartycore.lib.exceptions.BitcoindRPCError: Received invalid JSON from backend with a response of 200 OK
2025-01-10T19:43:29.589-05:00 - [    INFO] - Ledger.Main - Stopping API v1 Status Poller thread...
2025-01-10T19:43:29.589-05:00 - [    INFO] - Ledger.Main - API v1 Status Poller thread stopped.
2025-01-10T19:43:29.589-05:00 - [    INFO] - Ledger.Main - Stopping API Server v1 thread...
2025-01-10T19:43:29.706-05:00 - [    INFO] - API.ParentProcessChecker - Stopping WSGI Server thread...
2025-01-10T19:43:29.707-05:00 - [    INFO] - API.Main - Stopping API Server...
2025-01-10T19:43:29.707-05:00 - [    INFO] - API.Main - Stopping WSGI Server thread...
2025-01-10T19:43:29.708-05:00 - [    INFO] - API.Main - Stopping API Watcher thread...
2025-01-10T19:43:30.080-05:00 - [    INFO] - Ledger.Main - API Server v1 thread stopped.
2025-01-10T19:43:30.084-05:00 - [    INFO] - Ledger.Main - Stopping Asset Conservation Checker thread...
2025-01-10T19:43:30.582-05:00 - [    INFO] - Ledger.AssetConservationChecker - Thread stopped.
2025-01-10T19:43:30.584-05:00 - [    INFO] - Ledger.Main - Closing database connections...
2025-01-10T19:43:30.595-05:00 - [    INFO] - Ledger.Main - Shutting down logging...
2025-01-10T19:43:30.747-05:00 - [ WARNING] - Ledger.Main - Ledger DB is in use by another process and was unable to be closed correctly.
2025-01-10T19:43:30.780-05:00 - [ WARNING] - Ledger.Main - State DB is in use by another process and was unable to be closed correctly.
2025-01-10T19:43:30.780-05:00 - [    INFO] - Ledger.Main - Shutdown complete.
2025-01-10T19:43:32.659-05:00 - [    INFO] - API.Main - API Watcher thread stopped.
2025-01-10T19:43:32.662-05:00 - [    INFO] - API.Main - API Server stopped.
Process API:
Traceback (most recent call last):
  File "/opt/homebrew/Cellar/[email protected]/3.11.11/Frameworks/Python.framework/Versions/3.11/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap
    self.run()
  File "/opt/homebrew/Cellar/[email protected]/3.11.11/Frameworks/Python.framework/Versions/3.11/lib/python3.11/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/Users/evan/repos/counterparty-core/counterparty-core/counterpartycore/lib/api/api_server.py", line 534, in run_api_server
    wsgi_server.run()
  File "/Users/evan/repos/counterparty-core/counterparty-core/counterpartycore/lib/api/wsgi.py", line 236, in run
    self.server.run()
  File "/Users/evan/repos/counterparty-core/counterparty-core/counterpartycore/lib/api/wsgi.py", line 215, in run
    self.server.run()
  File "/Users/evan/repos/counterparty-core/venv/lib/python3.11/site-packages/waitress/server.py", line 325, in run
    self.asyncore.loop(
  File "/Users/evan/repos/counterparty-core/venv/lib/python3.11/site-packages/waitress/wasyncore.py", line 245, in loop
    poll_fun(timeout, map)
  File "/Users/evan/repos/counterparty-core/venv/lib/python3.11/site-packages/waitress/wasyncore.py", line 172, in poll
    r, w, e = select.select(r, w, e, timeout)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
OSError: [Errno 9] Bad file descriptor
@adamkrellenstein
Copy link
Member Author

And again:

2025-01-10T22:18:26.347-05:00 - [    INFO] - Ledger.Main - Block 720741 - Parsing complete. L: fafa2ca, TX: 86f6b51, M: 896cde7 (0.20s)
2025-01-10T22:18:26.518-05:00 - [    INFO] - Ledger.Main - Stopping RSFetcher thread...
2025-01-10T22:18:27.571-05:00 - [    INFO] - Ledger.Main - RSFetcher thread stopped.
2025-01-10T22:18:27.571-05:00 - [   ERROR] - Ledger.Main - Exception caught!
Traceback (most recent call last):
  File "/Users/evan/repos/counterparty-core/venv/lib/python3.11/site-packages/requests/models.py", line 974, in json
    return complexjson.loads(self.text, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/[email protected]/3.11.11/Frameworks/Python.framework/Versions/3.11/lib/python3.11/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/[email protected]/3.11.11/Frameworks/Python.framework/Versions/3.11/lib/python3.11/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/homebrew/Cellar/[email protected]/3.11.11/Frameworks/Python.framework/Versions/3.11/lib/python3.11/json/decoder.py", line 353, in raw_decode
    obj, end = self.scan_once(s, idx)
               ^^^^^^^^^^^^^^^^^^^^^^
json.decoder.JSONDecodeError: Expecting ',' delimiter: line 1 column 163732 (char 163731)
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
  File "/Users/evan/repos/counterparty-core/counterparty-core/counterpartycore/lib/backend/bitcoind.py", line 79, in rpc_call
    response_json = response.json()
                    ^^^^^^^^^^^^^^^
  File "/Users/evan/repos/counterparty-core/venv/lib/python3.11/site-packages/requests/models.py", line 978, in json
    raise RequestsJSONDecodeError(e.msg, e.doc, e.pos)
requests.exceptions.JSONDecodeError: Expecting ',' delimiter: line 1 column 163732 (char 163731)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
  File "/Users/evan/repos/counterparty-core/counterparty-core/counterpartycore/server.py", line 725, in start_all
    blocks.catch_up(db)
  File "/Users/evan/repos/counterparty-core/counterparty-core/counterpartycore/lib/blocks.py", line 1492, in catch_up
    mempool.clean_mempool(db)
  File "/Users/evan/repos/counterparty-core/counterparty-core/counterpartycore/lib/mempool.py", line 135, in clean_mempool
    raw_mempool = backend.bitcoind.getrawmempool(verbose=False)
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/evan/repos/counterparty-core/counterparty-core/counterpartycore/lib/backend/bitcoind.py", line 233, in getrawmempool
    return rpc("getrawmempool", [True if verbose else False])
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/evan/repos/counterparty-core/counterparty-core/counterpartycore/lib/backend/bitcoind.py", line 143, in rpc
    return rpc_call(payload)
           ^^^^^^^^^^^^^^^^^
  File "/Users/evan/repos/counterparty-core/counterparty-core/counterpartycore/lib/backend/bitcoind.py", line 81, in rpc_call
    raise exceptions.BitcoindRPCError(  # noqa: B904
counterpartycore.lib.exceptions.BitcoindRPCError: Received invalid JSON from backend with a response of 200 OK
2025-01-10T22:18:27.582-05:00 - [    INFO] - Ledger.Main - Stopping API v1 Status Poller thread...
2025-01-10T22:18:27.582-05:00 - [    INFO] - Ledger.Main - API v1 Status Poller thread stopped.
2025-01-10T22:18:27.582-05:00 - [    INFO] - Ledger.Main - Stopping API Server v1 thread...
2025-01-10T22:18:27.680-05:00 - [    INFO] - Ledger.Main - API Server v1 thread stopped.
2025-01-10T22:18:27.680-05:00 - [    INFO] - Ledger.Main - Stopping Asset Conservation Checker thread...
2025-01-10T22:18:28.210-05:00 - [    INFO] - Ledger.AssetConservationChecker - Thread stopped.
2025-01-10T22:18:28.211-05:00 - [    INFO] - Ledger.Main - Closing database connections...
2025-01-10T22:18:28.212-05:00 - [    INFO] - Ledger.Main - Shutting down logging...
2025-01-10T22:18:28.283-05:00 - [ WARNING] - Ledger.Main - Ledger DB is in use by another process and was unable to be closed correctly.
2025-01-10T22:18:28.300-05:00 - [ WARNING] - Ledger.Main - State DB is in use by another process and was unable to be closed correctly.
2025-01-10T22:18:28.300-05:00 - [    INFO] - Ledger.Main - Shutdown complete.
2025-01-10T22:18:28.510-05:00 - [    INFO] - API.ParentProcessChecker - Stopping WSGI Server thread...
2025-01-10T22:18:28.511-05:00 - [    INFO] - API.Main - Stopping API Server...
2025-01-10T22:18:28.511-05:00 - [    INFO] - API.Main - Stopping WSGI Server thread...
2025-01-10T22:18:28.511-05:00 - [    INFO] - API.Main - Stopping API Watcher thread...
2025-01-10T22:18:32.416-05:00 - [    INFO] - API.Main - API Watcher thread stopped.
2025-01-10T22:18:32.417-05:00 - [    INFO] - API.Main - API Server stopped.
Process API:
Traceback (most recent call last):
  File "/opt/homebrew/Cellar/[email protected]/3.11.11/Frameworks/Python.framework/Versions/3.11/lib/python3.11/multiprocessing/process.py", line 314, in _bootstrap
    self.run()
  File "/opt/homebrew/Cellar/[email protected]/3.11.11/Frameworks/Python.framework/Versions/3.11/lib/python3.11/multiprocessing/process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "/Users/evan/repos/counterparty-core/counterparty-core/counterpartycore/lib/api/api_server.py", line 534, in run_api_server
    wsgi_server.run()
  File "/Users/evan/repos/counterparty-core/counterparty-core/counterpartycore/lib/api/wsgi.py", line 236, in run
    self.server.run()
  File "/Users/evan/repos/counterparty-core/counterparty-core/counterpartycore/lib/api/wsgi.py", line 215, in run
    self.server.run()
  File "/Users/evan/repos/counterparty-core/venv/lib/python3.11/site-packages/waitress/server.py", line 325, in run
    self.asyncore.loop(
  File "/Users/evan/repos/counterparty-core/venv/lib/python3.11/site-packages/waitress/wasyncore.py", line 245, in loop
    poll_fun(timeout, map)
  File "/Users/evan/repos/counterparty-core/venv/lib/python3.11/site-packages/waitress/wasyncore.py", line 172, in poll
    r, w, e = select.select(r, w, e, timeout)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
OSError: [Errno 9] Bad file descriptor

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug
Projects
None yet
Milestone
v10.10.2 (API and CLI 1)
Development

No branches or pull requests
1 participant
@adamkrellenstein