Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor: CNS-1008 - Optimizer Refactor Part 1: provider optimizer refactor #1784

Open
wants to merge 33 commits into
base: main
Choose a base branch
from
+2,414 −832

Merge branch 'main' into CNS-1008-score-store-refactor

62048d5
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Open

refactor: CNS-1008 - Optimizer Refactor Part 1: provider optimizer refactor #1784

Merge branch 'main' into CNS-1008-score-store-refactor
62048d5
Select commit
Loading
Failed to load commit list.
GitHub Actions / Test Results failed Dec 29, 2024 in 0s

1 errors, 5 fail, 1 037 pass in 11m 17s

1 043 tests   - 1 290   1 037 ✅  - 1 292   11m 17s ⏱️ - 3m 40s
   49 suites  -    71       0 💤 ±    0 
    4 files    -     2       5 ❌ +    2   1 🔥 ±0 

Results for commit 62048d5. ± Comparison against earlier commit 517148d.

Annotations

Check warning on line 0 in github.com/lavanet/lava/v4/utils/score

See this annotation in the file changed.

@github-actions github-actions / Test Results

TestScoreStoreUpdateIdenticalSamplesThenBetter (github.com/lavanet/lava/v4/utils/score) failed 

artifacts/Test Results (Consensus)/utils-report.xml [took 0s]
Raw output 
Failed
    score_store_test.go:291: 
        	Error Trace:	/home/runner/work/lava/lava/utils/score/score_store_test.go:291
        	Error:      	Relative error is too high: 1e-06 (expected)
        	            	        < 1.6781555050767356e-06 (actual)
        	Test:       	TestScoreStoreUpdateIdenticalSamplesThenBetter

Check warning on line 0 in github.com/lavanet/lava/v4/protocol/chaintracker

See this annotation in the file changed.

@github-actions github-actions / Test Results

TestChainTrackerPollingTimeUpdate (github.com/lavanet/lava/v4/protocol/chaintracker) failed 

artifacts/Test Results (Protocol)/protocol-report.xml [took 6s]
Raw output 
Failed

Check warning on line 0 in github.com/lavanet/lava/v4/protocol/chaintracker

See this annotation in the file changed.

@github-actions github-actions / Test Results

TestChainTrackerPollingTimeUpdate/90Percent__delay_polling_time_decrease_big (github.com/lavanet/lava/v4/protocol/chaintracker) failed 

artifacts/Test Results (Protocol)/protocol-report.xml [took 0s]
Raw output 
Failed
Dec 29 17:40:40 DBG Chain Tracker Updated block hashes ApiInterface= ChainID= blocksKept=1 blocksQueried=0 blocksQueueLen=1 latestHash=stubHash-1025 latest_block=1025 nextBlocksUpdate=1125
Dec 29 17:40:40 DBG ChainTracker fetched init data successfully
Dec 29 17:40:40 INF updated chain tracker polling time blocks measured=11 chainID= median new polling time=6.000008ms original polling time=16ms stability=0.11223685035086618
    chain_tracker_test.go:515: 
        	Error Trace:	/home/runner/work/lava/lava/protocol/chaintracker/chain_tracker_test.go:515
        	Error:      	Max difference between 5ms and 6.000008ms allowed is 1e+06, but difference was -1.000008e+06
        	Test:       	TestChainTrackerPollingTimeUpdate/90Percent__delay_polling_time_decrease_big

Check warning on line 0 in github.com/lavanet/lava/v4/protocol/integration

See this annotation in the file changed.

@github-actions github-actions / Test Results

TestConsumerProviderWithProviders (github.com/lavanet/lava/v4/protocol/integration) failed 

artifacts/Test Results (Protocol)/protocol-report.xml [took 9s]
Raw output 
Failed

Check warning on line 0 in github.com/lavanet/lava/v4/protocol/integration

See this annotation in the file changed.

@github-actions github-actions / Test Results

TestConsumerProviderWithProviders/basic-success (github.com/lavanet/lava/v4/protocol/integration) failed 

artifacts/Test Results (Protocol)/protocol-report.xml [took 7s]
Raw output 
Failed
Dec 29 17:40:42 INF setting log level loglevel=debug
Dec 29 17:40:42 DBG batched nodeUrls by services batch="map[|websocket|:{NetworkAddress:{Address: KeyPem: CertPem: DisableTLS:false} ChainID:LAV1 ApiInterface:tendermintrpc Geolocation:1 NodeUrls:[ws://127.0.0.1:34009, addons: (websocket), internal-path: ]} ||:{NetworkAddress:{Address: KeyPem: CertPem: DisableTLS:false} ChainID:LAV1 ApiInterface:tendermintrpc Geolocation:1 NodeUrls:[http://127.0.0.1:45375]}]"
Dec 29 17:40:42 INF Finished adding Clients Asynchronously free clients=1 url=http://127.0.0.1:45375
Dec 29 17:40:42 DBG router keys chainProxyRouter="map[|websocket|:[{ChainProxy:0xc0010bb9e0 addonsSupported:map[:{}] methodsRouted:map[]}] ||:[{ChainProxy:0xc001095680 addonsSupported:map[:{}] methodsRouted:map[]}]]"
Dec 29 17:40:42 DBG chainRouter created chainProxyRouter="map[|websocket|:[{ChainProxy:0xc0010bb9e0 addonsSupported:map[:{}] methodsRouted:map[]}] ||:[{ChainProxy:0xc001095680 addonsSupported:map[:{}] methodsRouted:map[]}]]"
Dec 29 17:40:42 INF Finished adding Clients Asynchronously free clients=1 url="ws://127.0.0.1:34009, addons: (websocket), internal-path: "
badger 2024/12/29 17:40:42 INFO: Set nextTxnTs to 0
Dec 29 17:40:42 DBG Chain Tracker Updated block hashes ApiInterface= ChainID= blocksKept=1 blocksQueried=0 blocksQueueLen=1 latestHash=stubHash-1000 latest_block=1000 nextBlocksUpdate=1100
Dec 29 17:40:42 DBG ChainTracker fetched init data successfully
Dec 29 17:40:42 WRN Warning: Using Self signed certificate is not recommended, this will not allow https connections to be established
Dec 29 17:40:42 INF [++] Provider Listening on Address Address="{Address:localhost:1027 KeyPem: CertPem: DisableTLS:false}" apiInterface=tendermintrpc chainID=LAV1
Dec 29 17:40:42 INF New provider listener active address="{Address:localhost:1027 KeyPem: CertPem: DisableTLS:false}"
Dec 29 17:40:42 INF setting log level loglevel=debug
Dec 29 17:40:42 DBG batched nodeUrls by services batch="map[|websocket|:{NetworkAddress:{Address: KeyPem: CertPem: DisableTLS:false} ChainID:LAV1 ApiInterface:tendermintrpc Geolocation:1 NodeUrls:[ws://127.0.0.1:38999, addons: (websocket), internal-path: ]} ||:{NetworkAddress:{Address: KeyPem: CertPem: DisableTLS:false} ChainID:LAV1 ApiInterface:tendermintrpc Geolocation:1 NodeUrls:[http://127.0.0.1:34203]}]"
Dec 29 17:40:42 INF Finished adding Clients Asynchronously free clients=1 url=http://127.0.0.1:34203
Dec 29 17:40:42 DBG router keys chainProxyRouter="map[|websocket|:[{ChainProxy:0xc0015485a0 addonsSupported:map[:{}] methodsRouted:map[]}] ||:[{ChainProxy:0xc001548360 addonsSupported:map[:{}] methodsRouted:map[]}]]"
Dec 29 17:40:42 DBG chainRouter created chainProxyRouter="map[|websocket|:[{ChainProxy:0xc0015485a0 addonsSupported:map[:{}] methodsRouted:map[]}] ||:[{ChainProxy:0xc001548360 addonsSupported:map[:{}] methodsRouted:map[]}]]"
Dec 29 17:40:42 INF Finished adding Clients Asynchronously free clients=1 url="ws://127.0.0.1:38999, addons: (websocket), internal-path: "
badger 2024/12/29 17:40:42 INFO: Set nextTxnTs to 0
Dec 29 17:40:42 DBG Chain Tracker Updated block hashes ApiInterface= ChainID= blocksKept=1 blocksQueried=0 blocksQueueLen=1 latestHash=stubHash-1000 latest_block=1000 nextBlocksUpdate=1100
Dec 29 17:40:42 DBG ChainTracker fetched init data successfully
Dec 29 17:40:42 WRN Warning: Using Self signed certificate is not recommended, this will not allow https connections to be established
Dec 29 17:40:42 INF [++] Provider Listening on Address Address="{Address:localhost:1028 KeyPem: CertPem: DisableTLS:false}" apiInterface=tendermintrpc chainID=LAV1
Dec 29 17:40:42 INF New provider listener active address="{Address:localhost:1028 KeyPem: CertPem: DisableTLS:false}"
Dec 29 17:40:42 INF setting log level loglevel=debug
Dec 29 17:40:42 DBG batched nodeUrls by services batch="map[|websocket|:{NetworkAddress:{Address: KeyPem: CertPem: DisableTLS:false} ChainID:LAV1 ApiInterface:tendermintrpc Geolocation:1 NodeUrls:[ws://127.0.0.1:33815, addons: (websocket), internal-path: ]} ||:{NetworkAddress:{Address: KeyPem: CertPem: DisableTLS:false} ChainID:LAV1 ApiInterface:tendermintrpc Geolocation:1 NodeUrls:[http://127.0.0.1:40067]}]"
Dec 29 17:40:42 INF Finished adding Clients Asynchronously free clients=1 url=http://127.0.0.1:40067
Dec 29 17:40:42 DBG router keys chainProxyRouter="map[|websocket|:[{ChainProxy:0xc000150120 addonsSupported:map[:{}] methodsRouted:map[]}] ||:[{ChainProxy:0xc000b9e480 addonsSupported:map[:{}] methodsRouted:map[]}]]"
Dec 29 17:40:42 DBG chainRouter created chainProxyRouter="map[|websocket|:[{ChainProxy:0xc000150120 addonsSupported:map[:{}] methodsRouted:map[]}] ||:[{ChainProxy:0xc000b9e480 addonsSupported:map[:{}] methodsRouted:map[]}]]"
Dec 29 17:40:42 INF Finished adding Clients Asynchronously free clients=1 url="ws://127.0.0.1:33815, addons: (websocket), internal-path: "
badger 2024/12/29 17:40:42 INFO: Set nextTxnTs to 0
Dec 29 17:40:42 DBG Chain Tracker Updated block hashes ApiInterface= ChainID= blocksKept=1 blocksQueried=0 blocksQueueLen=1 latestHash=stubHash-1000 latest_block=1000 nextBlocksUpdate=1100
Dec 29 17:40:42 DBG ChainTracker fetched init data successfully
Dec 29 17:40:42 WRN Warning: Using Self signed certificate is not recommended, this will not allow https connections to be established
Dec 29 17:40:42 INF [++] Provider Listening on Address Address="{Address:localhost:1029 KeyPem: CertPem: DisableTLS:false}" apiInterface=tendermintrpc chainID=LAV1
Dec 29 17:40:42 INF New provider listener active address="{Address:localhost:1029 KeyPem: CertPem: DisableTLS:false}"
Dec 29 17:40:42 INF setting log level loglevel=debug
Dec 29 17:40:42 DBG batched nodeUrls by services batch="map[|websocket|:{NetworkAddress:{Address: KeyPem: CertPem: DisableTLS:false} ChainID:LAV1 ApiInterface:tendermintrpc Geolocation:1 NodeUrls:[ws://127.0.0.1:43219, addons: (websocket), internal-path: ]} ||:{NetworkAddress:{Address: KeyPem: CertPem: DisableTLS:false} ChainID:LAV1 ApiInterface:tendermintrpc Geolocation:1 NodeUrls:[http://127.0.0.1:37263]}]"
Dec 29 17:40:42 INF Finished adding Clients Asynchronously free clients=1 url=http://127.0.0.1:37263
Dec 29 17:40:42 DBG router keys chainProxyRouter="map[|websocket|:[{ChainProxy:0xc00102e240 addonsSupported:map[:{}] methodsRouted:map[]}] ||:[{ChainProxy:0xc00102e000 addonsSupported:map[:{}] methodsRouted:map[]}]]"
Dec 29 17:40:42 DBG chainRouter created chainProxyRouter="map[|websocket|:[{ChainProxy:0xc00102e240 addonsSupported:map[:{}] methodsRouted:map[]}] ||:[{ChainProxy:0xc00102e000 addonsSupported:map[:{}] methodsRouted:map[]}]]"
Dec 29 17:40:42 INF Finished adding Clients Asynchronously free clients=1 url="ws://127.0.0.1:43219, addons: (websocket), internal-path: "
badger 2024/12/29 17:40:42 INFO: Set nextTxnTs to 0
Dec 29 17:40:42 DBG Chain Tracker Updated block hashes ApiInterface= ChainID= blocksKept=1 blocksQueried=0 blocksQueueLen=1 latestHash=stubHash-1000 latest_block=1000 nextBlocksUpdate=1100
Dec 29 17:40:42 DBG ChainTracker fetched init data successfully
Dec 29 17:40:42 WRN Warning: Using Self signed certificate is not recommended, this will not allow https connections to be established
Dec 29 17:40:43 INF New provider listener active address="{Address:localhost:1030 KeyPem: CertPem: DisableTLS:false}"
Dec 29 17:40:43 INF [++] Provider Listening on Address Address="{Address:localhost:1030 KeyPem: CertPem: DisableTLS:false}" apiInterface=tendermintrpc chainID=LAV1
Dec 29 17:40:43 INF setting log level loglevel=debug
Dec 29 17:40:43 DBG batched nodeUrls by services batch="map[|websocket|:{NetworkAddress:{Address: KeyPem: CertPem: DisableTLS:false} ChainID:LAV1 ApiInterface:tendermintrpc Geolocation:1 NodeUrls:[ws://127.0.0.1:44149, addons: (websocket), internal-path: ]} ||:{NetworkAddress:{Address: KeyPem: CertPem: DisableTLS:false} ChainID:LAV1 ApiInterface:tendermintrpc Geolocation:1 NodeUrls:[http://127.0.0.1:35539]}]"
Dec 29 17:40:43 INF Finished adding Clients Asynchronously free clients=1 url=http://127.0.0.1:35539
Dec 29 17:40:43 DBG router keys chainProxyRouter="map[|websocket|:[{ChainProxy:0xc0009c2000 addonsSupported:map[:{}] methodsRouted:map[]}] ||:[{ChainProxy:0xc001549d40 addonsSupported:map[:{}] methodsRouted:map[]}]]"
Dec 29 17:40:43 DBG chainRouter created chainProxyRouter="map[|websocket|:[{ChainProxy:0xc0009c2000 addonsSupported:map[:{}] methodsRouted:map[]}] ||:[{ChainProxy:0xc001549d40 addonsSupported:map[:{}] methodsRouted:map[]}]]"
Dec 29 17:40:43 INF Finished adding Clients Asynchronously free clients=1 url="ws://127.0.0.1:44149, addons: (websocket), internal-path: "
badger 2024/12/29 17:40:43 INFO: Set nextTxnTs to 0
Dec 29 17:40:43 DBG Chain Tracker Updated block hashes ApiInterface= ChainID= blocksKept=1 blocksQueried=0 blocksQueueLen=1 latestHash=stubHash-1000 latest_block=1000 nextBlocksUpdate=1100
Dec 29 17:40:43 DBG ChainTracker fetched init data successfully
Dec 29 17:40:43 WRN Warning: Using Self signed certificate is not recommended, this will not allow https connections to be established
Dec 29 17:40:43 INF [++] Provider Listening on Address Address="{Address:localhost:1031 KeyPem: CertPem: DisableTLS:false}" apiInterface=tendermintrpc chainID=LAV1
Dec 29 17:40:43 INF New provider listener active address="{Address:localhost:1031 KeyPem: CertPem: DisableTLS:false}"
Dec 29 17:40:43 INF setting log level loglevel=debug
Dec 29 17:40:43 DBG batched nodeUrls by services batch="map[|websocket|:{NetworkAddress:{Address: KeyPem: CertPem: DisableTLS:false} ChainID:LAV1 ApiInterface:tendermintrpc Geolocation:1 NodeUrls:[ws://127.0.0.1:37483, addons: (websocket), internal-path: ]} ||:{NetworkAddress:{Address: KeyPem: CertPem: DisableTLS:false} ChainID:LAV1 ApiInterface:tendermintrpc Geolocation:1 NodeUrls:[http://127.0.0.1:39023]}]"
Dec 29 17:40:43 INF Finished adding Clients Asynchronously free clients=1 url=http://127.0.0.1:39023
Dec 29 17:40:43 DBG router keys chainProxyRouter="map[|websocket|:[{ChainProxy:0xc000965560 addonsSupported:map[:{}] methodsRouted:map[]}] ||:[{ChainProxy:0xc000965320 addonsSupported:map[:{}] methodsRouted:map[]}]]"
Dec 29 17:40:43 DBG chainRouter created chainProxyRouter="map[|websocket|:[{ChainProxy:0xc000965560 addonsSupported:map[:{}] methodsRouted:map[]}] ||:[{ChainProxy:0xc000965320 addonsSupported:map[:{}] methodsRouted:map[]}]]"
Dec 29 17:40:43 INF Finished adding Clients Asynchronously free clients=1 url="ws://127.0.0.1:37483, addons: (websocket), internal-path: "
Dec 29 17:40:43 DBG updated providers epoch=100 spec=LAV1tendermintrpc
Dec 29 17:40:43 INF New relic missing environment file
Dec 29 17:40:43 DBG Sending crafted relays apiInterface=tendermintrpc chainId=LAV1

 ┌───────────────────────────────────────────────────┐ 
 │                   Fiber v2.52.5                   │ 
 │               http://127.0.0.1:1026               │ 
 │                                                   │ 
 │ Handlers ............ 13  Processes ........... 1 │ 
 │ Prefork ....... Disabled  PID ............. 18336 │ 
 └───────────────────────────────────────────────────┘ 

Dec 29 17:40:43 WRN provider data not found, using default address=cosmos1lmw6rr0eyr7vvteup3vu2u6d28cu2ldsl0kmcy
Dec 29 17:40:43 DBG Provider got relay request GUID=15844534012294149396 relay addon= relay extensions= relay_timeout=29.999249054s request.SessionId=6261736967665671606 request.cu=10 request.relayNumber=1 requestBlock=-2 seenBlock=0
Dec 29 17:40:43 DBG provider registered consumer consumer=cosmos160a805emduttlflnhgqj9qcn8dd3ufpyanmu0k epoch=100
Dec 29 17:40:43 DBG Provider creating new sessionID SessionID=6261736967665671606 epoch=100
Dec 29 17:40:43 DBG Before Update Normal PrepareSessionForUsage GUID=15844534012294149396 relayNum=0 relayRequestTotalCU=10 sps.CuSum=10 sps.LatestRelayCu=10 sps.sessionId=6261736967665671606
Dec 29 17:40:43 ERR failed to unmarshal id from response error="invalid character '\x00' looking for beginning of value" id=
Dec 29 17:40:43 ERR tendermintRPC error error="failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value"
Dec 29 17:40:43 ERR Sending chainMsg failed error="tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value" GUID=15844534012294149396 attempt=0 specID=LAV1
Dec 29 17:40:43 ERR TryRelay Failed error="Sending chainMsg failed ErrMsg: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {attempt:0,GUID:15844534012294149396,specID:LAV1}: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value" GUID=15844534012294149396 request.SessionId=6261736967665671606 request.userAddr=cosmos160a805emduttlflnhgqj9qcn8dd3ufpyanmu0k timed_out=false
Dec 29 17:40:43 DBG Provider returned a relay response GUID=15844534012294149396 relay_timeout=29.997680422s request.SessionId=6261736967665671606 request.cu=10 request.relayNumber=1 timeTaken=1.571848ms
Dec 29 17:40:43 DBG could not send relay to provider error="rpc error: code = Unknown desc = failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: Sending chainMsg failed ErrMsg: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {attempt:0,GUID:15844534012294149396,specID:LAV1}: TryRelay Failed ErrMsg: Sending chainMsg failed ErrMsg: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {attempt:0,GUID:15844534012294149396,specID:LAV1}: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {request.SessionId:6261736967665671606,request.userAddr:cosmos160a805emduttlflnhgqj9qcn8dd3ufpyanmu0k,GUID:15844534012294149396,timed_out:false}" GUID=15844534012294149396 provider=cosmos1wlg3elwf9snuhvkmpqc0md83ke42y03p2nrq49
Dec 29 17:40:43 ERR failed relay, insufficient results error="rpc error: code = Unknown desc = failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: Sending chainMsg failed ErrMsg: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {attempt:0,GUID:15844534012294149396,specID:LAV1}: TryRelay Failed ErrMsg: Sending chainMsg failed ErrMsg: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {attempt:0,GUID:15844534012294149396,specID:LAV1}: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {request.SessionId:6261736967665671606,request.userAddr:cosmos160a805emduttlflnhgqj9qcn8dd3ufpyanmu0k,GUID:15844534012294149396,timed_out:false}"
Dec 29 17:40:43 ERR [-] failed sending init relay error="failed relay, insufficient results ErrMsg: rpc error: code = Unknown desc = failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: Sending chainMsg failed ErrMsg: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {attempt:0,GUID:15844534012294149396,specID:LAV1}: TryRelay Failed ErrMsg: Sending chainMsg failed ErrMsg: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {attempt:0,GUID:15844534012294149396,specID:LAV1}: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {request.SessionId:6261736967665671606,request.userAddr:cosmos160a805emduttlflnhgqj9qcn8dd3ufpyanmu0k,GUID:15844534012294149396,timed_out:false}: rpc error: code = Unknown desc = failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: Sending chainMsg failed ErrMsg: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {attempt:0,GUID:15844534012294149396,specID:LAV1}: TryRelay Failed ErrMsg: Sending chainMsg failed ErrMsg: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {attempt:0,GUID:15844534012294149396,specID:LAV1}: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {request.SessionId:6261736967665671606,request.userAddr:cosmos160a805emduttlflnhgqj9qcn8dd3ufpyanmu0k,GUID:15844534012294149396,timed_out:false}" APIInterface=tendermintrpc chainID=LAV1 relayProcessor="relayProcessor {resultsManager {success 0, nodeErrors:0, protocolErrors:1}, unwantedAddresses: ,currentlyUsedAddresses:cosmos1wlg3elwf9snuhvkmpqc0md83ke42y03p2nrq49}"
Dec 29 17:40:43 DBG Provider got relay request GUID=15844534012294149396 relay addon= relay extensions= relay_timeout=29.999913252s request.SessionId=5107937594721718039 request.cu=10 request.relayNumber=1 requestBlock=-2 seenBlock=0
Dec 29 17:40:43 DBG provider registered consumer consumer=cosmos160a805emduttlflnhgqj9qcn8dd3ufpyanmu0k epoch=100
Dec 29 17:40:43 DBG Provider creating new sessionID SessionID=5107937594721718039 epoch=100
Dec 29 17:40:43 DBG Before Update Normal PrepareSessionForUsage GUID=15844534012294149396 relayNum=0 relayRequestTotalCU=10 sps.CuSum=10 sps.LatestRelayCu=10 sps.sessionId=5107937594721718039
Dec 29 17:40:43 ERR failed to unmarshal id from response error="invalid character '\x00' looking for beginning of value" id=
Dec 29 17:40:43 ERR tendermintRPC error error="failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value"
Dec 29 17:40:43 ERR Sending chainMsg failed error="tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value" GUID=15844534012294149396 attempt=0 specID=LAV1
Dec 29 17:40:43 ERR TryRelay Failed error="Sending chainMsg failed ErrMsg: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {attempt:0,GUID:15844534012294149396,specID:LAV1}: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value" GUID=15844534012294149396 request.SessionId=5107937594721718039 request.userAddr=cosmos160a805emduttlflnhgqj9qcn8dd3ufpyanmu0k timed_out=false
Dec 29 17:40:43 DBG Provider returned a relay response GUID=15844534012294149396 relay_timeout=29.998926273s request.SessionId=5107937594721718039 request.cu=10 request.relayNumber=1 timeTaken="990.035µs"
Dec 29 17:40:43 DBG could not send relay to provider error="rpc error: code = Unknown desc = failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: Sending chainMsg failed ErrMsg: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {attempt:0,GUID:15844534012294149396,specID:LAV1}: TryRelay Failed ErrMsg: Sending chainMsg failed ErrMsg: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {attempt:0,GUID:15844534012294149396,specID:LAV1}: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {request.SessionId:5107937594721718039,request.userAddr:cosmos160a805emduttlflnhgqj9qcn8dd3ufpyanmu0k,GUID:15844534012294149396,timed_out:false}" GUID=15844534012294149396 provider=cosmos1sj062282hu9gckm9fyeglamrjevppng0jpj0wj
Dec 29 17:40:43 ERR failed relay, insufficient results error="rpc error: code = Unknown desc = failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: Sending chainMsg failed ErrMsg: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {attempt:0,GUID:15844534012294149396,specID:LAV1}: TryRelay Failed ErrMsg: Sending chainMsg failed ErrMsg: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {attempt:0,GUID:15844534012294149396,specID:LAV1}: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {request.SessionId:6261736967665671606,request.userAddr:cosmos160a805emduttlflnhgqj9qcn8dd3ufpyanmu0k,GUID:15844534012294149396,timed_out:false}"
Dec 29 17:40:43 ERR [-] failed sending init relay error="failed relay, insufficient results ErrMsg: rpc error: code = Unknown desc = failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: Sending chainMsg failed ErrMsg: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {attempt:0,GUID:15844534012294149396,specID:LAV1}: TryRelay Failed ErrMsg: Sending chainMsg failed ErrMsg: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {attempt:0,GUID:15844534012294149396,specID:LAV1}: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {request.SessionId:6261736967665671606,request.userAddr:cosmos160a805emduttlflnhgqj9qcn8dd3ufpyanmu0k,GUID:15844534012294149396,timed_out:false}: rpc error: code = Unknown desc = failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: Sending chainMsg failed ErrMsg: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {attempt:0,GUID:15844534012294149396,specID:LAV1}: TryRelay Failed ErrMsg: Sending chainMsg failed ErrMsg: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {attempt:0,GUID:15844534012294149396,specID:LAV1}: tendermintRPC error ErrMsg: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value: failed to unmarshal id from response ErrMsg: invalid character '\x00' looking for beginning of value {id:}: invalid character '\x00' looking for beginning of value {request.SessionId:6261736967665671606,request.userAddr:cosmos160a805emduttlflnhgqj9qcn8dd3ufpyanmu0k,GUID:15844534012294149396,timed_out:false}" APIInterface=tendermintrpc chainID=LAV1 relayProcessor="relayProcessor {resultsManager {success 0, nodeErrors:0, protocolErrors:2}, unwantedAddresses: cosmos1wlg3elwf9snuhvkmpqc0md83ke42y03p2nrq49,currentlyUsedAddresses:cosmos1sj062282hu9gckm9fyeglamrjevppng0jpj0wj}"
Dec 29 17:40:43 DBG Provider got relay request GUID=15844534012294149396 relay addon= relay extensions= relay_timeout=29.999932963s request.SessionId=2257155218637031369 request.cu=10 request.relayNumber=1 requestBlock=-2 seenBlock=0
Dec 29 17:40:43 DBG provider registered consumer consumer=cosmos160a805emduttlflnhgqj9qcn8dd3ufpyanmu0k epoch=100
Dec 29 17:40:43 DBG Provider creating new sessionID SessionID=2257155218637031369 epoch=100
Dec 29 17:40:43 DBG Before Update Normal PrepareSessionForUsage GUID=1584453401229414…timeout=29.996133373s request.SessionId=8294456863756572456 request.cu=5010 request.relayNumber=502 timeTaken=3.782557ms
Dec 29 17:40:49 INF Saved rewards snapshot to the DB successfully proofs=1
Dec 29 17:40:49 DBG QoS Availability report Availability=0.980079681274900400 down percent=0.001992031872509960
Dec 29 17:40:49 DBG tendermint http in/out GUID=17084880298653519355 HasError=false method=GET path=http://localhost:1026/status request= response="{\"reply\": 1}" timeTaken=5.239471ms
Dec 29 17:40:49 DBG urirpc in <<< GUID=16078112890198813789 _msg=status dappID=DefaultDappID headers="[{Name:Host Value:localhost:1026} {Name:User-Agent Value:Go-http-client/1.1} {Name:Accept-Encoding Value:gzip}]"
Dec 29 17:40:49 DBG Provider got relay request GUID=16078112890198813789 relay addon= relay extensions= relay_timeout=29.999927374s request.SessionId=7148650274790175531 request.cu=4800 request.relayNumber=481 requestBlock=-2 seenBlock=1000
Dec 29 17:40:49 DBG Before Update Normal PrepareSessionForUsage GUID=16078112890198813789 relayNum=480 relayRequestTotalCU=4800 sps.CuSum=4800 sps.LatestRelayCu=10 sps.sessionId=7148650274790175531
Dec 29 17:40:49 DBG Provider Finished Relay Successfully GUID=16078112890198813789 method=status replyBlock=1000 request.SessionId=7148650274790175531 request.relayNumber=481 requestedBlock=1000
Dec 29 17:40:49 DBG Provider returned a relay response GUID=16078112890198813789 relay_timeout=29.996015364s request.SessionId=7148650274790175531 request.cu=4800 request.relayNumber=481 timeTaken=3.913673ms
Dec 29 17:40:49 DBG saving rewards snapshot to the DB proofs=1
Dec 29 17:40:49 INF Saved rewards snapshot to the DB successfully proofs=1
Dec 29 17:40:49 DBG QoS Availability report Availability=0.979209979209979210 down percent=0.002079002079002079
Dec 29 17:40:49 DBG tendermint http in/out GUID=16078112890198813789 HasError=false method=GET path=http://localhost:1026/status request= response="{\"reply\": 2}" timeTaken=5.150638ms
Dec 29 17:40:49 DBG urirpc in <<< GUID=2467172066561896091 _msg=status dappID=DefaultDappID headers="[{Name:Host Value:localhost:1026} {Name:User-Agent Value:Go-http-client/1.1} {Name:Accept-Encoding Value:gzip}]"
Dec 29 17:40:49 DBG Provider got relay request GUID=2467172066561896091 relay addon= relay extensions= relay_timeout=29.999911708s request.SessionId=8294456863756572456 request.cu=5020 request.relayNumber=503 requestBlock=-2 seenBlock=1000
Dec 29 17:40:49 DBG Before Update Normal PrepareSessionForUsage GUID=2467172066561896091 relayNum=502 relayRequestTotalCU=5020 sps.CuSum=5020 sps.LatestRelayCu=10 sps.sessionId=8294456863756572456
Dec 29 17:40:49 DBG Provider Finished Relay Successfully GUID=2467172066561896091 method=status replyBlock=1000 request.SessionId=8294456863756572456 request.relayNumber=503 requestedBlock=1000
Dec 29 17:40:49 DBG Provider returned a relay response GUID=2467172066561896091 relay_timeout=29.99605474s request.SessionId=8294456863756572456 request.cu=5020 request.relayNumber=503 timeTaken=3.85856ms
Dec 29 17:40:49 DBG saving rewards snapshot to the DB proofs=1
Dec 29 17:40:49 INF Saved rewards snapshot to the DB successfully proofs=1
Dec 29 17:40:49 DBG QoS Availability report Availability=0.980119284294234590 down percent=0.001988071570576541
Dec 29 17:40:49 DBG tendermint http in/out GUID=2467172066561896091 HasError=false method=GET path=http://localhost:1026/status request= response="{\"reply\": 1}" timeTaken=5.157047ms
Dec 29 17:40:49 DBG urirpc in <<< GUID=10811730975792783615 _msg=status dappID=DefaultDappID headers="[{Name:Host Value:localhost:1026} {Name:User-Agent Value:Go-http-client/1.1} {Name:Accept-Encoding Value:gzip}]"
Dec 29 17:40:49 DBG Provider got relay request GUID=10811730975792783615 relay addon= relay extensions= relay_timeout=29.99991055s request.SessionId=7148650274790175531 request.cu=4810 request.relayNumber=482 requestBlock=-2 seenBlock=1000
Dec 29 17:40:49 DBG Before Update Normal PrepareSessionForUsage GUID=10811730975792783615 relayNum=481 relayRequestTotalCU=4810 sps.CuSum=4810 sps.LatestRelayCu=10 sps.sessionId=7148650274790175531
Dec 29 17:40:49 DBG Provider Finished Relay Successfully GUID=10811730975792783615 method=status replyBlock=1000 request.SessionId=7148650274790175531 request.relayNumber=482 requestedBlock=1000
Dec 29 17:40:49 DBG Provider returned a relay response GUID=10811730975792783615 relay_timeout=29.996020959s request.SessionId=7148650274790175531 request.cu=4810 request.relayNumber=482 timeTaken=3.891384ms
Dec 29 17:40:49 DBG saving rewards snapshot to the DB proofs=1
Dec 29 17:40:49 INF Saved rewards snapshot to the DB successfully proofs=1
Dec 29 17:40:49 DBG QoS Availability report Availability=0.979253112033195020 down percent=0.002074688796680498
Dec 29 17:40:49 DBG tendermint http in/out GUID=10811730975792783615 HasError=false method=GET path=http://localhost:1026/status request= response="{\"reply\": 2}" timeTaken=5.167115ms
Dec 29 17:40:49 DBG urirpc in <<< GUID=6902074642430456425 _msg=status dappID=DefaultDappID headers="[{Name:Host Value:localhost:1026} {Name:User-Agent Value:Go-http-client/1.1} {Name:Accept-Encoding Value:gzip}]"
Dec 29 17:40:49 DBG Provider got relay request GUID=6902074642430456425 relay addon= relay extensions= relay_timeout=29.999920038s request.SessionId=8294456863756572456 request.cu=5030 request.relayNumber=504 requestBlock=-2 seenBlock=1000
Dec 29 17:40:49 DBG Before Update Normal PrepareSessionForUsage GUID=6902074642430456425 relayNum=503 relayRequestTotalCU=5030 sps.CuSum=5030 sps.LatestRelayCu=10 sps.sessionId=8294456863756572456
Dec 29 17:40:49 DBG Provider Finished Relay Successfully GUID=6902074642430456425 method=status replyBlock=1000 request.SessionId=8294456863756572456 request.relayNumber=504 requestedBlock=1000
Dec 29 17:40:49 DBG Provider returned a relay response GUID=6902074642430456425 relay_timeout=29.995969163s request.SessionId=8294456863756572456 request.cu=5030 request.relayNumber=504 timeTaken=3.953029ms
Dec 29 17:40:49 DBG saving rewards snapshot to the DB proofs=1
Dec 29 17:40:49 INF Saved rewards snapshot to the DB successfully proofs=1
Dec 29 17:40:49 DBG QoS Availability report Availability=0.980158730158730160 down percent=0.001984126984126984
Dec 29 17:40:49 DBG tendermint http in/out GUID=6902074642430456425 HasError=false method=GET path=http://localhost:1026/status request= response="{\"reply\": 1}" timeTaken=5.195181ms
Dec 29 17:40:49 DBG urirpc in <<< GUID=3704338412754416276 _msg=status dappID=DefaultDappID headers="[{Name:Host Value:localhost:1026} {Name:User-Agent Value:Go-http-client/1.1} {Name:Accept-Encoding Value:gzip}]"
Dec 29 17:40:49 DBG Provider got relay request GUID=3704338412754416276 relay addon= relay extensions= relay_timeout=29.999933616s request.SessionId=7148650274790175531 request.cu=4820 request.relayNumber=483 requestBlock=-2 seenBlock=1000
Dec 29 17:40:49 DBG Before Update Normal PrepareSessionForUsage GUID=3704338412754416276 relayNum=482 relayRequestTotalCU=4820 sps.CuSum=4820 sps.LatestRelayCu=10 sps.sessionId=7148650274790175531
Dec 29 17:40:49 DBG Provider Finished Relay Successfully GUID=3704338412754416276 method=status replyBlock=1000 request.SessionId=7148650274790175531 request.relayNumber=483 requestedBlock=1000
Dec 29 17:40:49 DBG Provider returned a relay response GUID=3704338412754416276 relay_timeout=29.996042963s request.SessionId=7148650274790175531 request.cu=4820 request.relayNumber=483 timeTaken=3.892236ms
Dec 29 17:40:49 DBG saving rewards snapshot to the DB proofs=1
Dec 29 17:40:49 INF Saved rewards snapshot to the DB successfully proofs=1
Dec 29 17:40:49 DBG QoS Availability report Availability=0.979296066252587990 down percent=0.002070393374741201
Dec 29 17:40:49 DBG tendermint http in/out GUID=3704338412754416276 HasError=false method=GET path=http://localhost:1026/status request= response="{\"reply\": 2}" timeTaken=5.18263ms
Dec 29 17:40:49 DBG urirpc in <<< GUID=8605934749717829741 _msg=status dappID=DefaultDappID headers="[{Name:Host Value:localhost:1026} {Name:User-Agent Value:Go-http-client/1.1} {Name:Accept-Encoding Value:gzip}]"
Dec 29 17:40:49 DBG Provider got relay request GUID=8605934749717829741 relay addon= relay extensions= relay_timeout=29.999919874s request.SessionId=7148650274790175531 request.cu=4830 request.relayNumber=484 requestBlock=-2 seenBlock=1000
Dec 29 17:40:49 DBG Before Update Normal PrepareSessionForUsage GUID=8605934749717829741 relayNum=483 relayRequestTotalCU=4830 sps.CuSum=4830 sps.LatestRelayCu=10 sps.sessionId=7148650274790175531
Dec 29 17:40:49 DBG Provider Finished Relay Successfully GUID=8605934749717829741 method=status replyBlock=1000 request.SessionId=7148650274790175531 request.relayNumber=484 requestedBlock=1000
Dec 29 17:40:49 DBG Provider returned a relay response GUID=8605934749717829741 relay_timeout=29.996102274s request.SessionId=7148650274790175531 request.cu=4830 request.relayNumber=484 timeTaken=3.819794ms
Dec 29 17:40:49 DBG saving rewards snapshot to the DB proofs=1
Dec 29 17:40:49 INF Saved rewards snapshot to the DB successfully proofs=1
Dec 29 17:40:49 DBG QoS Availability report Availability=0.979338842975206610 down percent=0.002066115702479339
Dec 29 17:40:49 DBG tendermint http in/out GUID=8605934749717829741 HasError=false method=GET path=http://localhost:1026/status request= response="{\"reply\": 2}" timeTaken=5.076467ms
Dec 29 17:40:49 DBG urirpc in <<< GUID=12651533490410738595 _msg=status dappID=DefaultDappID headers="[{Name:Host Value:localhost:1026} {Name:User-Agent Value:Go-http-client/1.1} {Name:Accept-Encoding Value:gzip}]"
Dec 29 17:40:49 DBG Provider got relay request GUID=12651533490410738595 relay addon= relay extensions= relay_timeout=29.999910781s request.SessionId=8294456863756572456 request.cu=5040 request.relayNumber=505 requestBlock=-2 seenBlock=1000
Dec 29 17:40:49 DBG Before Update Normal PrepareSessionForUsage GUID=12651533490410738595 relayNum=504 relayRequestTotalCU=5040 sps.CuSum=5040 sps.LatestRelayCu=10 sps.sessionId=8294456863756572456
Dec 29 17:40:49 DBG Provider Finished Relay Successfully GUID=12651533490410738595 method=status replyBlock=1000 request.SessionId=8294456863756572456 request.relayNumber=505 requestedBlock=1000
Dec 29 17:40:49 DBG Provider returned a relay response GUID=12651533490410738595 relay_timeout=29.996066657s request.SessionId=8294456863756572456 request.cu=5040 request.relayNumber=505 timeTaken=3.84698ms
Dec 29 17:40:49 DBG saving rewards snapshot to the DB proofs=1
Dec 29 17:40:49 INF Saved rewards snapshot to the DB successfully proofs=1
Dec 29 17:40:49 DBG QoS Availability report Availability=0.980198019801980200 down percent=0.001980198019801980
Dec 29 17:40:49 DBG tendermint http in/out GUID=12651533490410738595 HasError=false method=GET path=http://localhost:1026/status request= response="{\"reply\": 1}" timeTaken=5.170427ms
Dec 29 17:40:49 DBG urirpc in <<< GUID=13855104584952123090 _msg=status dappID=DefaultDappID headers="[{Name:Host Value:localhost:1026} {Name:User-Agent Value:Go-http-client/1.1} {Name:Accept-Encoding Value:gzip}]"
Dec 29 17:40:49 DBG Provider got relay request GUID=13855104584952123090 relay addon= relay extensions= relay_timeout=29.999924407s request.SessionId=7148650274790175531 request.cu=4840 request.relayNumber=485 requestBlock=-2 seenBlock=1000
Dec 29 17:40:49 DBG Before Update Normal PrepareSessionForUsage GUID=13855104584952123090 relayNum=484 relayRequestTotalCU=4840 sps.CuSum=4840 sps.LatestRelayCu=10 sps.sessionId=7148650274790175531
Dec 29 17:40:49 DBG Provider Finished Relay Successfully GUID=13855104584952123090 method=status replyBlock=1000 request.SessionId=7148650274790175531 request.relayNumber=485 requestedBlock=1000
Dec 29 17:40:49 DBG Provider returned a relay response GUID=13855104584952123090 relay_timeout=29.996076854s request.SessionId=7148650274790175531 request.cu=4840 request.relayNumber=485 timeTaken=3.849496ms
Dec 29 17:40:49 DBG saving rewards snapshot to the DB proofs=1
Dec 29 17:40:49 INF Saved rewards snapshot to the DB successfully proofs=1
Dec 29 17:40:49 DBG QoS Availability report Availability=0.979381443298969070 down percent=0.002061855670103093
Dec 29 17:40:49 DBG tendermint http in/out GUID=13855104584952123090 HasError=false method=GET path=http://localhost:1026/status request= response="{\"reply\": 2}" timeTaken=5.060578ms
Dec 29 17:40:49 DBG urirpc in <<< GUID=7104227533308231087 _msg=status dappID=DefaultDappID headers="[{Name:Host Value:localhost:1026} {Name:User-Agent Value:Go-http-client/1.1} {Name:Accept-Encoding Value:gzip}]"
Dec 29 17:40:49 DBG Provider got relay request GUID=7104227533308231087 relay addon= relay extensions= relay_timeout=29.999923199s request.SessionId=8294456863756572456 request.cu=5050 request.relayNumber=506 requestBlock=-2 seenBlock=1000
Dec 29 17:40:49 DBG Before Update Normal PrepareSessionForUsage GUID=7104227533308231087 relayNum=505 relayRequestTotalCU=5050 sps.CuSum=5050 sps.LatestRelayCu=10 sps.sessionId=8294456863756572456
Dec 29 17:40:49 DBG Provider Finished Relay Successfully GUID=7104227533308231087 method=status replyBlock=1000 request.SessionId=8294456863756572456 request.relayNumber=506 requestedBlock=1000
Dec 29 17:40:49 DBG Provider returned a relay response GUID=7104227533308231087 relay_timeout=29.996120242s request.SessionId=8294456863756572456 request.cu=5050 request.relayNumber=506 timeTaken=3.805863ms
Dec 29 17:40:49 DBG saving rewards snapshot to the DB proofs=1
Dec 29 17:40:49 DBG QoS Availability report Availability=0.980237154150197630 down percent=0.001976284584980237
Dec 29 17:40:49 DBG tendermint http in/out GUID=7104227533308231087 HasError=false method=GET path=http://localhost:1026/status request= response="{\"reply\": 1}" timeTaken=5.141013ms
Dec 29 17:40:49 INF Saved rewards snapshot to the DB successfully proofs=1
Dec 29 17:40:49 DBG urirpc in <<< GUID=16125116208976736858 _msg=status dappID=DefaultDappID headers="[{Name:Host Value:localhost:1026} {Name:User-Agent Value:Go-http-client/1.1} {Name:Accept-Encoding Value:gzip}]"
Dec 29 17:40:49 DBG Provider got relay request GUID=16125116208976736858 relay addon= relay extensions= relay_timeout=29.999922388s request.SessionId=8294456863756572456 request.cu=5060 request.relayNumber=507 requestBlock=-2 seenBlock=1000
Dec 29 17:40:49 DBG Before Update Normal PrepareSessionForUsage GUID=16125116208976736858 relayNum=506 relayRequestTotalCU=5060 sps.CuSum=5060 sps.LatestRelayCu=10 sps.sessionId=8294456863756572456
Dec 29 17:40:49 DBG Provider Finished Relay Successfully GUID=16125116208976736858 method=status replyBlock=1000 request.SessionId=8294456863756572456 request.relayNumber=507 requestedBlock=1000
Dec 29 17:40:49 DBG Provider returned a relay response GUID=16125116208976736858 relay_timeout=29.996013068s request.SessionId=8294456863756572456 request.cu=5060 request.relayNumber=507 timeTaken=3.911465ms
Dec 29 17:40:49 DBG saving rewards snapshot to the DB proofs=1
Dec 29 17:40:49 INF Saved rewards snapshot to the DB successfully proofs=1
Dec 29 17:40:49 DBG QoS Availability report Availability=0.980276134122287970 down percent=0.001972386587771203
Dec 29 17:40:49 DBG tendermint http in/out GUID=16125116208976736858 HasError=false method=GET path=http://localhost:1026/status request= response="{\"reply\": 1}" timeTaken=5.294661ms
Dec 29 17:40:49 DBG urirpc in <<< GUID=15006873196241340046 _msg=status dappID=DefaultDappID headers="[{Name:Accept-Encoding Value:gzip} {Name:Host Value:localhost:1026} {Name:User-Agent Value:Go-http-client/1.1}]"
Dec 29 17:40:49 DBG Provider got relay request GUID=15006873196241340046 relay addon= relay extensions= relay_timeout=29.999917164s request.SessionId=8294456863756572456 request.cu=5070 request.relayNumber=508 requestBlock=-2 seenBlock=1000
Dec 29 17:40:49 DBG Before Update Normal PrepareSessionForUsage GUID=15006873196241340046 relayNum=507 relayRequestTotalCU=5070 sps.CuSum=5070 sps.LatestRelayCu=10 sps.sessionId=8294456863756572456
Dec 29 17:40:49 DBG Provider Finished Relay Successfully GUID=15006873196241340046 method=status replyBlock=1000 request.SessionId=8294456863756572456 request.relayNumber=508 requestedBlock=1000
Dec 29 17:40:49 DBG Provider returned a relay response GUID=15006873196241340046 relay_timeout=29.995975766s request.SessionId=8294456863756572456 request.cu=5070 request.relayNumber=508 timeTaken=3.944824ms
Dec 29 17:40:49 DBG saving rewards snapshot to the DB proofs=1
Dec 29 17:40:49 INF Saved rewards snapshot to the DB successfully proofs=1
Dec 29 17:40:49 DBG QoS Availability report Availability=0.980314960629921260 down percent=0.001968503937007874
Dec 29 17:40:49 DBG tendermint http in/out GUID=15006873196241340046 HasError=false method=GET path=http://localhost:1026/status request= response="{\"reply\": 1}" timeTaken=5.229465ms
Dec 29 17:40:49 DBG urirpc in <<< GUID=1789841773545168120 _msg=status dappID=DefaultDappID headers="[{Name:Host Value:localhost:1026} {Name:User-Agent Value:Go-http-client/1.1} {Name:Accept-Encoding Value:gzip}]"
Dec 29 17:40:49 DBG Provider got relay request GUID=1789841773545168120 relay addon= relay extensions= relay_timeout=29.999923618s request.SessionId=8294456863756572456 request.cu=5080 request.relayNumber=509 requestBlock=-2 seenBlock=1000
Dec 29 17:40:49 DBG Before Update Normal PrepareSessionForUsage GUID=1789841773545168120 relayNum=508 relayRequestTotalCU=5080 sps.CuSum=5080 sps.LatestRelayCu=10 sps.sessionId=8294456863756572456
Dec 29 17:40:49 DBG Provider Finished Relay Successfully GUID=1789841773545168120 method=status replyBlock=1000 request.SessionId=8294456863756572456 request.relayNumber=509 requestedBlock=1000
Dec 29 17:40:49 DBG Provider returned a relay response GUID=1789841773545168120 relay_timeout=29.996073986s request.SessionId=8294456863756572456 request.cu=5080 request.relayNumber=509 timeTaken=3.851375ms
Dec 29 17:40:49 DBG saving rewards snapshot to the DB proofs=1
Dec 29 17:40:49 INF Saved rewards snapshot to the DB successfully proofs=1
Dec 29 17:40:49 DBG QoS Availability report Availability=0.980353634577603140 down percent=0.001964636542239686
Dec 29 17:40:49 DBG tendermint http in/out GUID=1789841773545168120 HasError=false method=GET path=http://localhost:1026/status request= response="{\"reply\": 1}" timeTaken=5.130771ms
Dec 29 17:40:49 DBG urirpc in <<< GUID=2593113776355827855 _msg=status dappID=DefaultDappID headers="[{Name:User-Agent Value:Go-http-client/1.1} {Name:Accept-Encoding Value:gzip} {Name:Host Value:localhost:1026}]"
Dec 29 17:40:49 DBG Provider got relay request GUID=2593113776355827855 relay addon= relay extensions= relay_timeout=29.999919998s request.SessionId=7148650274790175531 request.cu=4850 request.relayNumber=486 requestBlock=-2 seenBlock=1000
Dec 29 17:40:49 DBG Before Update Normal PrepareSessionForUsage GUID=2593113776355827855 relayNum=485 relayRequestTotalCU=4850 sps.CuSum=4850 sps.LatestRelayCu=10 sps.sessionId=7148650274790175531
Dec 29 17:40:49 DBG Provider Finished Relay Successfully GUID=2593113776355827855 method=status replyBlock=1000 request.SessionId=7148650274790175531 request.relayNumber=486 requestedBlock=1000
Dec 29 17:40:49 DBG Provider returned a relay response GUID=2593113776355827855 relay_timeout=29.996049475s request.SessionId=7148650274790175531 request.cu=4850 request.relayNumber=486 timeTaken=3.872146ms
Dec 29 17:40:49 DBG saving rewards snapshot to the DB proofs=1
Dec 29 17:40:49 INF Saved rewards snapshot to the DB successfully proofs=1
Dec 29 17:40:49 DBG QoS Availability report Availability=0.979423868312757200 down percent=0.002057613168724280
Dec 29 17:40:49 DBG tendermint http in/out GUID=2593113776355827855 HasError=false method=GET path=http://localhost:1026/status request= response="{\"reply\": 2}" timeTaken=5.07241ms
Dec 29 17:40:49 DBG urirpc in <<< GUID=14694409479553461896 _msg=status dappID=DefaultDappID headers="[{Name:Host Value:localhost:1026} {Name:User-Agent Value:Go-http-client/1.1} {Name:Accept-Encoding Value:gzip}]"
Dec 29 17:40:49 DBG Provider got relay request GUID=14694409479553461896 relay addon= relay extensions= relay_timeout=29.999923144s request.SessionId=8294456863756572456 request.cu=5090 request.relayNumber=510 requestBlock=-2 seenBlock=1000
Dec 29 17:40:49 DBG Before Update Normal PrepareSessionForUsage GUID=14694409479553461896 relayNum=509 relayRequestTotalCU=5090 sps.CuSum=5090 sps.LatestRelayCu=10 sps.sessionId=8294456863756572456
Dec 29 17:40:49 DBG Provider Finished Relay Successfully GUID=14694409479553461896 method=status replyBlock=1000 request.SessionId=8294456863756572456 request.relayNumber=510 requestedBlock=1000
Dec 29 17:40:49 DBG Provider returned a relay response GUID=14694409479553461896 relay_timeout=29.996093224s request.SessionId=8294456863756572456 request.cu=5090 request.relayNumber=510 timeTaken=3.832585ms
Dec 29 17:40:49 DBG saving rewards snapshot to the DB proofs=1
Dec 29 17:40:49 INF Saved rewards snapshot to the DB successfully proofs=1
Dec 29 17:40:49 DBG QoS Availability report Availability=0.980392156862745100 down percent=0.001960784313725490
Dec 29 17:40:49 DBG tendermint http in/out GUID=14694409479553461896 HasError=false method=GET path=http://localhost:1026/status request= response="{\"reply\": 1}" timeTaken=5.203518ms
Dec 29 17:40:49 DBG urirpc in <<< GUID=6080867371939042866 _msg=status dappID=DefaultDappID headers="[{Name:Host Value:localhost:1026} {Name:User-Agent Value:Go-http-client/1.1} {Name:Accept-Encoding Value:gzip}]"
Dec 29 17:40:49 DBG Provider got relay request GUID=6080867371939042866 relay addon= relay extensions= relay_timeout=29.999922121s request.SessionId=8294456863756572456 request.cu=5100 request.relayNumber=511 requestBlock=-2 seenBlock=1000
Dec 29 17:40:49 DBG Before Update Normal PrepareSessionForUsage GUID=6080867371939042866 relayNum=510 relayRequestTotalCU=5100 sps.CuSum=5100 sps.LatestRelayCu=10 sps.sessionId=8294456863756572456
Dec 29 17:40:49 DBG Provider Finished Relay Successfully GUID=6080867371939042866 method=status replyBlock=1000 request.SessionId=8294456863756572456 request.relayNumber=511 requestedBlock=1000
Dec 29 17:40:49 DBG saving rewards snapshot to the DB proofs=1
Dec 29 17:40:49 DBG Provider returned a relay response GUID=6080867371939042866 relay_timeout=29.996007116s request.SessionId=8294456863756572456 request.cu=5100 request.relayNumber=511 timeTaken=3.917179ms
Dec 29 17:40:49 INF Saved rewards snapshot to the DB successfully proofs=1
Dec 29 17:40:49 DBG QoS Availability report Availability=0.980430528375733860 down percent=0.001956947162426614
Dec 29 17:40:49 DBG tendermint http in/out GUID=6080867371939042866 HasError=false method=GET path=http://localhost:1026/status request= response="{\"reply\": 1}" timeTaken=5.179314ms
Dec 29 17:40:49 DBG urirpc in <<< GUID=12647718020384580697 _msg=status dappID=DefaultDappID headers="[{Name:Host Value:localhost:1026} {Name:User-Agent Value:Go-http-client/1.1} {Name:Accept-Encoding Value:gzip}]"
Dec 29 17:40:49 DBG Provider got relay request GUID=12647718020384580697 relay addon= relay extensions= relay_timeout=29.999915322s request.SessionId=8294456863756572456 request.cu=5110 request.relayNumber=512 requestBlock=-2 seenBlock=1000
Dec 29 17:40:49 DBG Before Update Normal PrepareSessionForUsage GUID=12647718020384580697 relayNum=511 relayRequestTotalCU=5110 sps.CuSum=5110 sps.LatestRelayCu=10 sps.sessionId=8294456863756572456
Dec 29 17:40:49 DBG Provider Finished Relay Successfully GUID=12647718020384580697 method=status replyBlock=1000 request.SessionId=8294456863756572456 request.relayNumber=512 requestedBlock=1000
Dec 29 17:40:49 DBG Provider returned a relay response GUID=12647718020384580697 relay_timeout=29.996026943s request.SessionId=8294456863756572456 request.cu=5110 request.relayNumber=512 timeTaken=3.890142ms
Dec 29 17:40:49 DBG saving rewards snapshot to the DB proofs=1
Dec 29 17:40:49 INF Saved rewards snapshot to the DB successfully proofs=1
Dec 29 17:40:49 DBG QoS Availability report Availability=0.980468750000000000 down percent=0.001953125000000000
Dec 29 17:40:49 DBG tendermint http in/out GUID=12647718020384580697 HasError=false method=GET path=http://localhost:1026/status request= response="{\"reply\": 1}" timeTaken=5.21434ms
Dec 29 17:40:49 DBG urirpc in <<< GUID=16009214723034381922 _msg=status dappID=DefaultDappID headers="[{Name:Host Value:localhost:1026} {Name:User-Agent Value:Go-http-client/1.1} {Name:Accept-Encoding Value:gzip}]"
Dec 29 17:40:49 DBG Provider got relay request GUID=16009214723034381922 relay addon= relay extensions= relay_timeout=29.999916185s request.SessionId=8294456863756572456 request.cu=5120 request.relayNumber=513 requestBlock=-2 seenBlock=1000
Dec 29 17:40:49 DBG Before Update Normal PrepareSessionForUsage GUID=16009214723034381922 relayNum=512 relayRequestTotalCU=5120 sps.CuSum=5120 sps.LatestRelayCu=10 sps.sessionId=8294456863756572456
Dec 29 17:40:49 DBG Provider Finished Relay Successfully GUID=16009214723034381922 method=status replyBlock=1000 request.SessionId=8294456863756572456 request.relayNumber=513 requestedBlock=1000
Dec 29 17:40:49 DBG Provider returned a relay response GUID=16009214723034381922 relay_timeout=29.996046478s request.SessionId=8294456863756572456 request.cu=5120 request.relayNumber=513 timeTaken=3.87133ms
Dec 29 17:40:49 DBG saving rewards snapshot to the DB proofs=1
Dec 29 17:40:49 INF Saved rewards snapshot to the DB successfully proofs=1
Dec 29 17:40:49 DBG QoS Availability report Availability=0.980506822612085770 down percent=0.001949317738791423
Dec 29 17:40:49 DBG tendermint http in/out GUID=16009214723034381922 HasError=false method=GET path=http://localhost:1026/status request= response="{\"reply\": 1}" timeTaken=5.297835ms
Dec 29 17:40:49 DBG urirpc in <<< GUID=5102980179688672815 _msg=status dappID=DefaultDappID headers="[{Name:Host Value:localhost:1026} {Name:User-Agent Value:Go-http-client/1.1} {Name:Accept-Encoding Value:gzip}]"
Dec 29 17:40:49 DBG Provider got relay request GUID=5102980179688672815 relay addon= relay extensions= relay_timeout=29.999909966s request.SessionId=7148650274790175531 request.cu=4860 request.relayNumber=487 requestBlock=-2 seenBlock=1000
Dec 29 17:40:49 DBG Before Update Normal PrepareSessionForUsage GUID=5102980179688672815 relayNum=486 relayRequestTotalCU=4860 sps.CuSum=4860 sps.LatestRelayCu=10 sps.sessionId=7148650274790175531
Dec 29 17:40:49 DBG Provider Finished Relay Successfully GUID=5102980179688672815 method=status replyBlock=1000 request.SessionId=7148650274790175531 request.relayNumber=487 requestedBlock=1000
Dec 29 17:40:49 DBG Provider returned a relay response GUID=5102980179688672815 relay_timeout=29.996073252s request.SessionId=7148650274790175531 request.cu=4860 request.relayNumber=487 timeTaken=3.838618ms
Dec 29 17:40:49 DBG saving rewards snapshot to the DB proofs=1
Dec 29 17:40:49 INF Saved rewards snapshot to the DB successfully proofs=1
Dec 29 17:40:49 DBG QoS Availability report Availability=0.979466119096509240 down percent=0.002053388090349076
Dec 29 17:40:49 DBG tendermint http in/out GUID=5102980179688672815 HasError=false method=GET path=http://localhost:1026/status request= response="{\"reply\": 2}" timeTaken=5.139895ms
Dec 29 17:40:49 DBG urirpc in <<< GUID=3830066724271166959 _msg=status dappID=DefaultDappID headers="[{Name:Host Value:localhost:1026} {Name:User-Agent Value:Go-http-client/1.1} {Name:Accept-Encoding Value:gzip}]"
Dec 29 17:40:49 DBG Provider got relay request GUID=3830066724271166959 relay addon= relay extensions= relay_timeout=29.999935596s request.SessionId=8294456863756572456 request.cu=5130 request.relayNumber=514 requestBlock=-2 seenBlock=1000
Dec 29 17:40:49 DBG Before Update Normal PrepareSessionForUsage GUID=3830066724271166959 relayNum=513 relayRequestTotalCU=5130 sps.CuSum=5130 sps.LatestRelayCu=10 sps.sessionId=8294456863756572456
Dec 29 17:40:49 DBG Provider Finished Relay Successfully GUID=3830066724271166959 method=status replyBlock=1000 request.SessionId=8294456863756572456 request.relayNumber=514 requestedBlock=1000
Dec 29 17:40:49 DBG Provider returned a relay response GUID=3830066724271166959 relay_timeout=29.996038191s request.SessionId=8294456863756572456 request.cu=5130 request.relayNumber=514 timeTaken=3.898858ms
Dec 29 17:40:49 DBG saving rewards snapshot to the DB proofs=1
Dec 29 17:40:49 INF Saved rewards snapshot to the DB successfully proofs=1
Dec 29 17:40:49 DBG QoS Availability report Availability=0.980544747081712060 down percent=0.001945525291828794
Dec 29 17:40:49 DBG tendermint http in/out GUID=3830066724271166959 HasError=false method=GET path=http://localhost:1026/status request= response="{\"reply\": 1}" timeTaken=5.252628ms
Dec 29 17:40:49 DBG urirpc in <<< GUID=275260434969420573 _msg=status dappID=DefaultDappID headers="[{Name:User-Agent Value:Go-http-client/1.1} {Name:Accept-Encoding Value:gzip} {Name:Host Value:localhost:1026}]"
Dec 29 17:40:49 DBG Provider got relay request GUID=275260434969420573 relay addon= relay extensions= relay_timeout=29.999929891s request.SessionId=8294456863756572456 request.cu=5140 request.relayNumber=515 requestBlock=-2 seenBlock=1000
Dec 29 17:40:49 DBG Before Update Normal PrepareSessionForUsage GUID=275260434969420573 relayNum=514 relayRequestTotalCU=5140 sps.CuSum=5140 sps.LatestRelayCu=10 sps.sessionId=8294456863756572456
Dec 29 17:40:49 DBG Provider Finished Relay Successfully GUID=275260434969420573 method=status replyBlock=1000 request.SessionId=8294456863756572456 request.relayNumber=515 requestedBlock=1000
Dec 29 17:40:49 DBG Provider returned a relay response GUID=275260434969420573 relay_timeout=29.99607169s request.SessionId=8294456863756572456 request.cu=5140 request.relayNumber=515 timeTaken=3.859803ms
Dec 29 17:40:49 DBG saving rewards snapshot to the DB proofs=1
Dec 29 17:40:49 INF Saved rewards snapshot to the DB successfully proofs=1
Dec 29 17:40:49 DBG QoS Availability report Availability=0.980582524271844660 down percent=0.001941747572815534
Dec 29 17:40:49 DBG tendermint http in/out GUID=275260434969420573 HasError=false method=GET path=http://localhost:1026/status request= response="{\"reply\": 1}" timeTaken=5.104081ms
Dec 29 17:40:49 DBG urirpc in <<< GUID=3991159707539138782 _msg=status dappID=DefaultDappID headers="[{Name:Host Value:localhost:1026} {Name:User-Agent Value:Go-http-client/1.1} {Name:Accept-Encoding Value:gzip}]"
Dec 29 17:40:49 DBG Provider got relay request GUID=3991159707539138782 relay addon= relay extensions= relay_timeout=29.99992071s request.SessionId=7148650274790175531 request.cu=4870 request.relayNumber=488 requestBlock=-2 seenBlock=1000
Dec 29 17:40:49 DBG Before Update Normal PrepareSessionForUsage GUID=3991159707539138782 relayNum=487 relayRequestTotalCU=4870 sps.CuSum=4870 sps.LatestRelayCu=10 sps.sessionId=7148650274790175531
Dec 29 17:40:49 DBG Provider Finished Relay Successfully GUID=3991159707539138782 method=status replyBlock=1000 request.SessionId=7148650274790175531 request.relayNumber=488 requestedBlock=1000
Dec 29 17:40:49 DBG Provider returned a relay response GUID=3991159707539138782 relay_timeout=29.996054876s request.SessionId=7148650274790175531 request.cu=4870 request.relayNumber=488 timeTaken=3.867418ms
Dec 29 17:40:49 DBG saving rewards snapshot to the DB proofs=1
Dec 29 17:40:49 INF Saved rewards snapshot to the DB successfully proofs=1
Dec 29 17:40:49 DBG QoS Availability report Availability=0.979508196721311480 down percent=0.002049180327868852
Dec 29 17:40:49 DBG tendermint http in/out GUID=3991159707539138782 HasError=false method=GET path=http://localhost:1026/status request= response="{\"reply\": 2}" timeTaken=5.135797ms
    protocol_test.go:626: 
        	Error Trace:	/home/runner/work/lava/lava/protocol/integration/protocol_test.go:626
        	Error:      	"map[1:514 2:487]" should have 5 item(s), but has 2
        	Test:       	TestConsumerProviderWithProviders/basic-success

Check failure on line 0 in github.com/lavanet/lava/v4/testutil/e2e

See this annotation in the file changed.

@github-actions github-actions / Test Results

TestLavaProtocol (github.com/lavanet/lava/v4/testutil/e2e) with error 

artifacts/Test Results (Protocol E2E)/protocol-e2e-report.xml [took 0s]
Raw output 
No test result found
Dec 29 17:40:15 INF Starting Lava
Dec 29 17:40:15 INF Executing Command: ./scripts/start_env_dev.sh
Dec 29 17:40:15 INF Waiting for Lava
Dec 29 17:40:25 INF Waiting for Lava
Dec 29 17:40:35 INF Waiting for Lava
Dec 29 17:40:45 INF Waiting for Lava
Dec 29 17:40:55 INF Waiting for Lava
Dec 29 17:41:05 INF Waiting for Lava
Dec 29 17:41:15 INF Waiting for Lava
Dec 29 17:41:25 INF Waiting for Lava
Dec 29 17:41:35 INF Waiting for Lava
Dec 29 17:41:45 INF Waiting for Lava
Dec 29 17:41:55 INF Waiting for Lava
Dec 29 17:42:05 INF Waiting for Lava
Dec 29 17:42:15 INF Starting Lava OK
Dec 29 17:42:15 INF Staking Lava
Dec 29 17:42:15 INF Executing Command: ./scripts/test/init_e2e.sh
Dec 29 17:43:21 INF stakeLava OK
ETH1
provider lava@15vhfk0lsjrhfvnztmjkqzqegvfjdgnu0tr9raj [{127.0.0.1:2224 1 [] [jsonrpc] []}]
provider lava@16zzq6xmt46fv0nvf8q4kf0pvypxh75el84m0rv [{127.0.0.1:2225 1 [] [jsonrpc] []}]
provider lava@18yu97lwsxt2epkj7a5sfyqygf048fn0q589k0c [{127.0.0.1:2222 1 [] [jsonrpc] []}]
provider lava@1a69vqxj3ehjlp4cqg49qe9ufaquqgt4vwj8sds [{127.0.0.1:2223 1 [] [jsonrpc] []}]
provider lava@1mmaj4trcnx65wgzadr8d62y42d4zl4rlsy3r6j [{127.0.0.1:2221 1 [debug] [jsonrpc] [archive]}]
LAV1
provider lava@14dxk09vqtnnnvedylpxcthm7gvfgw0cr8r6xwc [{127.0.0.1:2265 1 [] [grpc rest tendermintrpc] []}]
provider lava@19fy6m8jg5mry67d4yrfgnv2chgva67jwfdqha8 [{127.0.0.1:2262 1 [] [grpc rest tendermintrpc] []}]
provider lava@1e0afdm5rvktthaz0yuqw03acvnkpdgm8szd056 [{127.0.0.1:2261 1 [] [grpc rest tendermintrpc] []}]
provider lava@1lz8069eq3nxk4jnymke4pkf9k5tm5k3q4ngj3p [{127.0.0.1:2263 1 [] [grpc rest tendermintrpc] []}]
provider lava@1p4t3a8p07wl3wscpt7q632sha4384u69fc8ksa [{127.0.0.1:2264 1 [] [grpc rest tendermintrpc] []}]
Dec 29 17:43:21 INF Staking Lava OK
Dec 29 17:43:21 INF RUNNING TESTS
Dec 29 17:43:21 INF Executing Command: /opt/hostedtoolcache/go/1.23.4/x64/bin/go test ./testutil/e2e/proxy/. -v -timeout 0 eth
Dec 29 17:43:21 INF startJSONRPCProxy OK
Dec 29 17:43:21 INF Waiting JSONRPC Consumer
Dec 29 17:43:22 INF Waiting JSONRPC Consumer
Dec 29 17:43:23 INF Waiting JSONRPC Consumer
Dec 29 17:43:24 INF Waiting JSONRPC Consumer
Dec 29 17:43:25 INF Waiting JSONRPC Consumer
Dec 29 17:43:26 INF Waiting JSONRPC Consumer
Dec 29 17:43:27 INF Waiting JSONRPC Consumer
Dec 29 17:43:28 INF Waiting JSONRPC Consumer
Dec 29 17:43:29 INF Waiting JSONRPC Consumer
Dec 29 17:43:30 INF Waiting JSONRPC Consumer
Dec 29 17:43:31 INF Waiting JSONRPC Consumer
Dec 29 17:43:33 INF Waiting JSONRPC Consumer
Dec 29 17:43:34 INF Waiting JSONRPC Consumer
Dec 29 17:43:35 INF Waiting JSONRPC Consumer
Dec 29 17:43:36 INF Waiting JSONRPC Consumer
Dec 29 17:43:37 INF Waiting JSONRPC Consumer
Dec 29 17:43:38 INF Waiting JSONRPC Consumer
Dec 29 17:43:39 INF Waiting JSONRPC Consumer
Dec 29 17:43:39 INF JSONRPCProxy OK
Dec 29 17:43:39 INF Validated proxy is alive got response res=16482926
Dec 29 17:43:39 DBG Executing command /home/runner/go/bin/lavap rpcprovider ./testutil/e2e/e2eConfigs/provider/jsonrpcProvider1.yml --cache-be 127.0.0.1:2777 --chain-id=lava --from servicer1 --geolocation 1 --log_level debug
Dec 29 17:43:39 DBG Executing command /home/runner/go/bin/lavap rpcprovider ./testutil/e2e/e2eConfigs/provider/jsonrpcProvider2.yml --cache-be 127.0.0.1:2777 --chain-id=lava --from servicer2 --geolocation 1 --log_level debug
Dec 29 17:43:39 DBG Executing command /home/runner/go/bin/lavap rpcprovider ./testutil/e2e/e2eConfigs/provider/jsonrpcProvider3.yml --cache-be 127.0.0.1:2777 --chain-id=lava --from servicer3 --geolocation 1 --log_level debug
Dec 29 17:43:39 DBG Executing command /home/runner/go/bin/lavap rpcprovider ./testutil/e2e/e2eConfigs/provider/jsonrpcProvider4.yml --cache-be 127.0.0.1:2777 --chain-id=lava --from servicer4 --geolocation 1 --log_level debug
Dec 29 17:43:39 DBG Executing command /home/runner/go/bin/lavap rpcprovider ./testutil/e2e/e2eConfigs/provider/jsonrpcProvider5.yml --cache-be 127.0.0.1:2777 --chain-id=lava --from servicer5 --geolocation 1 --log_level debug
Dec 29 17:43:39 INF Waiting Provider 127.0.0.1:2221
Dec 29 17:43:41 INF Waiting Provider 127.0.0.1:2221
Dec 29 17:43:43 INF Waiting Provider 127.0.0.1:2221
Dec 29 17:43:45 INF Waiting Provider 127.0.0.1:2221
Dec 29 17:43:47 INF Waiting Provider 127.0.0.1:2221
Dec 29 17:43:49 INF Waiting Provider 127.0.0.1:2221
Dec 29 17:43:51 INF Waiting Provider 127.0.0.1:2221
Dec 29 17:43:53 INF Waiting Provider 127.0.0.1:2221
Dec 29 17:43:55 INF Waiting Provider 127.0.0.1:2221
Dec 29 17:43:57 INF Waiting Provider 127.0.0.1:2221
Dec 29 17:43:59 INF Waiting Provider 127.0.0.1:2221
Dec 29 17:44:01 INF Waiting Provider 127.0.0.1:2221
Dec 29 17:44:03 INF Waiting Provider 127.0.0.1:2221
Dec 29 17:44:05 INF Waiting Provider 127.0.0.1:2221
Dec 29 17:44:05 INF Waiting Provider 127.0.0.1:2222
Dec 29 17:44:05 INF Waiting Provider 127.0.0.1:2223
Dec 29 17:44:05 INF Waiting Provider 127.0.0.1:2224
Dec 29 17:44:05 INF startJSONRPCProvider OK
Dec 29 17:44:05 INF Executing Command: /home/runner/go/bin/lavap rpcprovider ./testutil/e2e/e2eConfigs/provider/lavaProvider6 --cache-be 127.0.0.1:2777 --chain-id=lava --from servicer6 --geolocation 1 --log_level debug
Dec 29 17:44:05 INF Executing Command: /home/runner/go/bin/lavap rpcprovider ./testutil/e2e/e2eConfigs/provider/lavaProvider7 --cache-be 127.0.0.1:2777 --chain-id=lava --from servicer7 --geolocation 1 --log_level debug
Dec 29 17:44:05 INF Executing Command: /home/runner/go/bin/lavap rpcprovider ./testutil/e2e/e2eConfigs/provider/lavaProvider8 --cache-be 127.0.0.1:2777 --chain-id=lava --from servicer8 --geolocation 1 --log_level debug
Dec 29 17:44:05 INF Executing Command: /home/runner/go/bin/lavap rpcprovider ./testutil/e2e/e2eConfigs/provider/lavaProvider9 --cache-be 127.0.0.1:2777 --chain-id=lava --from servicer9 --geolocation 1 --log_level debug
Dec 29 17:44:05 INF Executing Command: /home/runner/go/bin/lavap rpcprovider ./testutil/e2e/e2eConfigs/provider/lavaProvider10 --cache-be 127.0.0.1:2777 --chain-id=lava --from servicer10 --geolocation 1 --log_level debug
Dec 29 17:44:05 INF Waiting Provider 127.0.0.1:2261
Dec 29 17:44:07 INF Waiting Provider 127.0.0.1:2261
Dec 29 17:44:09 INF Waiting Provider 127.0.0.1:2261
Dec 29 17:44:11 INF Waiting Provider 127.0.0.1:2261
Dec 29 17:44:11 INF Waiting Provider 127.0.0.1:2262
Dec 29 17:44:11 INF Waiting Provider 127.0.0.1:2263
Dec 29 17:44:11 INF Waiting Provider 127.0.0.1:2264
Dec 29 17:44:11 INF Waiting Provider 127.0.0.1:2265
Dec 29 17:44:11 INF startLavaProviders OK
Dec 29 17:44:18 INF Executing Command: /home/runner/go/bin/lavap rpcconsumer ./testutil/e2e/e2eConfigs/consumer/ethConsumer1.yml --cache-be 127.0.0.1:2778 --chain-id=lava --from user1 --geolocation 1 --log_level debug --allow-insecure-provider-dialing
Dec 29 17:44:18 INF startJSONRPCConsumer OK
Dec 29 17:44:18 INF Waiting JSONRPC Consumer
Dec 29 17:44:19 INF Waiting JSONRPC Consumer
Dec 29 17:44:20 INF Waiting JSONRPC Consumer
Dec 29 17:44:21 INF Waiting JSONRPC Consumer
Dec 29 17:44:22 INF Waiting JSONRPC Consumer
Dec 29 17:44:23 INF JSONRPCConsumer1 OK
Dec 29 17:44:23 INF Validated proxy is alive got response res=16482926
Dec 29 17:44:23 INF Executing Command: /home/runner/go/bin/lavap rpcconsumer ./testutil/e2e/e2eConfigs/consumer/lavaConsumer1.yml --cache-be 127.0.0.1:2778 --chain-id=lava --from user3 --geolocation 1 --log_level debug --allow-insecure-provider-dialing
Dec 29 17:44:23 INF startRPCConsumer OK
Dec 29 17:44:23 INF Waiting TENDERMINT Consumer
Dec 29 17:44:24 INF Waiting TENDERMINT Consumer
Dec 29 17:44:25 INF Waiting TENDERMINT Consumer
Dec 29 17:44:26 INF Waiting TENDERMINT Consumer
Dec 29 17:44:27 INF Waiting TENDERMINT Consumer
Dec 29 17:44:27 INF checkTendermintConsumer OK
Dec 29 17:44:27 INF Waiting REST Consumer
Dec 29 17:44:27 INF checkRESTConsumer OK
Dec 29 17:44:27 INF Waiting GRPC Consumer
Dec 29 17:44:27 INF checkGRPCConsumer OK
Dec 29 17:44:27 INF Starting JSONRPC Tests
Dec 29 17:44:45 DBG success writing to file bytesWritten=19876 fileName=03_EthProvider_01 lines=19876
Dec 29 17:44:45 DBG success writing to file bytesWritten=24298 fileName=03_EthProvider_02 lines=24298
Dec 29 17:44:45 DBG success writing to file bytesWritten=33140 fileName=06_RPCConsumer_01 lines=33140
Dec 29 17:44:45 DBG success writing to file bytesWritten=2946156 fileName=02_jsonProxy lines=2946156
Dec 29 17:44:45 ERR startJSONRPCConsumer (consumer 01) cmd wait err error="signal: killed"
Dec 29 17:44:45 DBG success writing to file bytesWritten=19876 fileName=03_EthProvider_01 lines=19876
Dec 29 17:44:45 DBG success writing to file bytesWritten=24298 fileName=03_EthProvider_02 lines=24298
Dec 29 17:44:45 DBG success writing to file bytesWritten=33140 fileName=06_RPCConsumer_01 lines=33140
Dec 29 17:44:45 ERR startLavaProviders (provider 03) cmd wait err error="signal: killed"
Dec 29 17:44:45 DBG success writing to file bytesWritten=7746 fileName=03_EthProvider_05 lines=7746
Dec 29 17:44:45 DBG success writing to file bytesWritten=16832 fileName=05_LavaProvider_01 lines=16832
Dec 29 17:44:45 DBG success writing to file bytesWritten=15721 fileName=05_LavaProvider_03 lines=15721
Dec 29 17:44:45 DBG success writing to file bytesWritten=17595 fileName=05_LavaProvider_04 lines=17595
Dec 29 17:44:45 DBG success writing to file bytesWritten=394263 fileName=00_StartLava lines=394263
Dec 29 17:44:45 DBG success writing to file bytesWritten=8316 fileName=01_stakeLava lines=8316
Dec 29 17:44:45 DBG success writing to file bytesWritten=7906 fileName=03_EthProvider_04 lines=7906
Dec 29 17:44:45 DBG success writing to file bytesWritten=24435 fileName=03_EthProvider_03 lines=24435
Dec 29 17:44:45 DBG success writing to file bytesWritten=81032 fileName=04_jsonConsumer_01 lines=81032
Dec 29 17:44:45 DBG success writing to file bytesWritten=19876 fileName=03_EthProvider_01 lines=19876
Dec 29 17:44:45 DBG success writing to file bytesWritten=24298 fileName=03_EthProvider_02 lines=24298
Dec 29 17:44:45 DBG success writing to file bytesWritten=33140 fileName=06_RPCConsumer_01 lines=33140
Dec 29 17:44:45 ERR startJSONRPCProxy cmd wait err error="signal: killed"
Dec 29 17:44:45 DBG success writing to file bytesWritten=24435 fileName=03_EthProvider_03 lines=24435
Dec 29 17:44:45 DBG success writing to file bytesWritten=81032 fileName=04_jsonConsumer_01 lines=81032
Dec 29 17:44:45 DBG success writing to file bytesWritten=19876 fileName=03_EthProvider_01 lines=19876
Dec 29 17:44:45 DBG success writing to file bytesWritten=24298 fileName=03_EthProvider_02 lines=24298
Dec 29 17:44:45 ERR startLavaProviders (provider 02) cmd wait err error="signal: killed"
Dec 29 17:44:45 DBG success writing to file bytesWritten=7746 fileName=03_EthProvider_05 lines=7746
Dec 29 17:44:45 DBG success writing to file bytesWritten=33140 fileName=06_RPCConsumer_01 lines=33140
Dec 29 17:44:45 DBG success writing to file bytesWritten=16832 fileName=05_LavaProvider_01 lines=16832
Dec 29 17:44:45 DBG success writing to file bytesWritten=15721 fileName=05_LavaProvider_03 lines=15721
Dec 29 17:44:45 DBG success writing to file bytesWritten=17595 fileName=05_LavaProvider_04 lines=17595
Dec 29 17:44:45 DBG success writing to file bytesWritten=394263 fileName=00_StartLava lines=394263
Dec 29 17:44:45 DBG success writing to file bytesWritten=8316 fileName=01_stakeLava lines=8316
Dec 29 17:44:45 ERR startJSONRPCProvider (provider 03) cmd wait err error="signal: killed"
Dec 29 17:44:45 DBG success writing to file bytesWritten=7906 fileName=03_EthProvider_04 lines=7906
Dec 29 17:44:45 DBG success writing to file bytesWritten=7746 fileName=03_EthProvider_05 lines=7746
Dec 29 17:44:45 DBG success writing to file bytesWritten=16832 fileName=05_LavaProvider_01 lines=16832
Dec 29 17:44:45 DBG success writing to file bytesWritten=24435 fileName=03_EthProvider_03 lines=24435
Dec 29 17:44:45 DBG success writing to file bytesWritten=15721 fileName=05_LavaProvider_03 lines=15721
Dec 29 17:44:45 DBG success writing to file bytesWritten=17595 fileName=05_LavaProvider_04 lines=17595
Dec 29 17:44:45 DBG success writing to file bytesWritten=81032 fileName=04_jsonConsumer_01 lines=81032
Dec 29 17:44:45 DBG success writing to file bytesWritten=394263 fileName=00_StartLava lines=394263
Dec 29 17:44:45 DBG success writing to file bytesWritten=19876 fileName=03_EthProvider_01 lines=19876
Dec 29 17:44:45 ERR startJSONRPCProvider (provider 02) cmd wait err error="signal: killed"
Dec 29 17:44:45 DBG success writing to file bytesWritten=24435 fileName=03_EthProvider_03 lines=24435
Dec 29 17:44:45 DBG success writing to file bytesWritten=81032 fileName=04_jsonConsumer_01 lines=81032
Dec 29 17:44:45 DBG success writing to file bytesWritten=19876 fileName=03_EthProvider_01 lines=19876
Dec 29 17:44:45 DBG success writing to file bytesWritten=24298 fileName=03_EthProvider_02 lines=24298
Dec 29 17:44:45 ERR startLavaProviders (provider 04) cmd wait err error="signal: killed"
Dec 29 17:44:45 DBG success writing to file bytesWritten=7906 fileName=03_EthProvider_04 lines=7906
Dec 29 17:44:45 DBG success writing to file bytesWritten=7746 fileName=03_EthProvider_05 lines=7746
Dec 29 17:44:45 DBG success writing to file bytesWritten=16832 fileName=05_LavaProvider_01 lines=16832
Dec 29 17:44:45 DBG success writing to file bytesWritten=33140 fileName=06_RPCConsumer_01 lines=33140
Dec 29 17:44:45 DBG success writing to file bytesWritten=15721 fileName=05_LavaProvider_03 lines=15721
Dec 29 17:44:45 DBG success writing to file bytesWritten=17595 fileName=05_LavaProvider_04 lines=17595
Dec 29 17:44:45 DBG success writing to file bytesWritten=394263 fileName=00_StartLava lines=394263
Dec 29 17:44:45 DBG success writing to file bytesWritten=8316 fileName=01_stakeLava lines=8316
Dec 29 17:44:45 DBG success writing to file bytesWritten=24435 fileName=03_EthProvider_03 lines=24435
Dec 29 17:44:45 DBG success writing to file bytesWritten=81032 fileName=04_jsonConsumer_01 lines=81032
Dec 29 17:44:45 DBG success writing to file bytesWritten=33140 fileName=06_RPCConsumer_01 lines=33140
Dec 29 17:44:45 DBG success writing to file bytesWritten=19876 fileName=03_EthProvider_01 lines=19876
Dec 29 17:44:45 DBG success writing to file bytesWritten=24298 fileName=03_EthProvider_02 lines=24298
Dec 29 17:44:45 DBG success writing to file bytesWritten=33140 fileName=06_RPCConsumer_01 lines=33140
Dec 29 17:44:45 DBG success writing to file bytesWritten=8316 fileName=01_stakeLava lines=8316
Dec 29 17:44:45 DBG success writing to file bytesWritten=24298 fileName=03_EthProvider_02 lines=24298
Dec 29 17:44:45 ERR startLavaProviders (provider 01) cmd wait err error="signal: killed"
Dec 29 17:44:45 DBG success writing to file bytesWritten=15630 fileName=05_LavaProvider_05 lines=15630
Dec 29 17:44:45 DBG success writing to file bytesWritten=7906 fileName=03_EthProvider_04 lines=7906
Dec 29 17:44:45 DBG success writing to file bytesWritten=19876 fileName=03_EthProvider_01 lines=19876
Dec 29 17:44:45 DBG success writing to file bytesWritten=24435 fileName=03_EthProvider_03 lines=24435
Dec 29 17:44:45 DBG success writing to file bytesWritten=24298 fileName=03_EthProvider_02 lines=24298
Dec 29 17:44:45 DBG success writing to file bytesWritten=81032 fileName=04_jsonConsumer_01 lines=81032
Dec 29 17:44:45 DBG success writing to file bytesWritten=33140 fileName=06_RPCConsumer_01 lines=33140
Dec 29 17:44:45 DBG success writing to file bytesWritten=19876 fileName=03_EthProvider_01 lines=19876
Dec 29 17:44:45 ERR startRPCConsumer (consumer 01) cmd wait err error="signal: killed"
Dec 29 17:44:45 DBG success writing to file bytesWritten=24298 fileName=03_EthProvider_02 lines=24298
Dec 29 17:44:45 DBG success writing to file bytesWritten=33140 fileName=06_RPCConsumer_01 lines=33140
Dec 29 17:44:45 ERR startJSONRPCProvider (provider 04) cmd wait err error="signal: killed"
Dec 29 17:44:45 DBG success writing to file bytesWritten=24435 fileName=03_EthProvider_03 lines=24435
Dec 29 17:44:45 DBG success writing to file bytesWritten=81032 fileName=04_jsonConsumer_01 lines=81032
Dec 29 17:44:45 ERR startJSONRPCProvider (provider 01) cmd wait err error="signal: killed"
Dec 29 17:44:45 ERR startJSONRPCProvider (provider 05) cmd wait err error="signal: killed"
Dec 29 17:44:45 DBG success writing to file bytesWritten=19876 fileName=03_EthProvider_01 lines=19876
Dec 29 17:44:45 DBG success writing to file bytesWritten=24298 fileName=03_EthProvider_02 lines=24298
Dec 29 17:44:45 DBG success writing to file bytesWritten=424363 fileName=00_StartLava lines=424363
Dec 29 17:44:45 DBG success writing to file bytesWritten=19457 fileName=05_LavaProvider_02 lines=19457
Dec 29 17:44:45 DBG success writing to file bytesWritten=15630 fileName=05_LavaProvider_05 lines=15630
Dec 29 17:44:45 DBG success writing to file bytesWritten=8316 fileName=01_stakeLava lines=8316
Dec 29 17:44:45 DBG success writing to file bytesWritten=7906 fileName=03_EthProvider_04 lines=7906
Dec 29 17:44:45 DBG success writing to file bytesWritten=7746 fileName=03_EthProvider_05 lines=7746
Dec 29 17:44:45 DBG success writing to file bytesWritten=16832 fileName=05_LavaProvider_01 lines=16832
Dec 29 17:44:45 DBG success writing to file bytesWritten=15721 fileName=05_LavaProvider_03 lines=15721
Dec 29 17:44:45 DBG success writing to file bytesWritten=17595 fileName=05_LavaProvider_04 lines=17595
Dec 29 17:44:45 DBG success writing to file bytesWritten=24435 fileName=03_EthProvider_03 lines=24435
Dec 29 17:44:45 DBG success writing to file bytesWritten=81032 fileName=04_jsonConsumer_01 lines=81032
Dec 29 17:44:45 DBG success writing to file bytesWritten=2946156 fileName=02_jsonProxy lines=2946156
Dec 29 17:44:45 DBG success writing to file bytesWritten=2946156 fileName=02_jsonProxy lines=2946156
Dec 29 17:44:45 ERR startLavaProviders (provider 05) cmd wait err error="signal: killed"
Dec 29 17:44:45 DBG success writing to file bytesWritten=2946156 fileName=02_jsonProxy lines=2946156
Dec 29 17:44:45 DBG success writing to file bytesWritten=24298 fileName=03_EthProvider_02 lines=24298
Dec 29 17:44:45 DBG success writing to file bytesWritten=33140 fileName=06_RPCConsumer_01 lines=33140
Dec 29 17:44:45 DBG success writing to file bytesWritten=2946156 fileName=02_jsonProxy lines=2946156
Dec 29 17:44:45 DBG success writing to file bytesWritten=2946156 fileName=02_jsonProxy lines=2946156
Dec 29 17:44:45 DBG success writing to file bytesWritten=424363 fileName=00_StartLava lines=424363
Dec 29 17:44:45 DBG success writing to file bytesWritten=33140 fileName=06_RPCConsumer_01 lines=33140
Dec 29 17:44:45 DBG success writing to file bytesWritten=19876 fileName=03_EthProvider_01 lines=19876
Dec 29 17:44:45 DBG success writing to file bytesWritten=8316 fileName=01_stakeLava lines=8316
Dec 29 17:44:45 DBG success writing to file bytesWritten=7906 fileName=03_EthProvider_04 lines=7906
Dec 29 17:44:45 DBG success writing to file bytesWritten=7746 fileName=03_EthProvider_05 lines=7746
Dec 29 17:44:45 DBG success writing to file bytesWritten=16832 fileName=05_LavaProvider_01 lines=16832
Dec 29 17:44:45 DBG success writing to file bytesWritten=2946156 fileName=02_jsonProxy lines=2946156
Dec 29 17:44:45 DBG success writing to file bytesWritten=24298 fileName=03_EthProvider_02 lines=24298
Dec 29 17:44:45 DBG success writing to file bytesWritten=19457 fileName=05_LavaProvider_02 lines=19457
Dec 29 17:44:45 DBG success writing to file bytesWritten=15630 fileName=05_LavaProvider_05 lines=15630
ERROR:  Dec 29 17:43:42 ERR Failed To Connect to cache at address error="context deadline exceeded" address=127.0.0.1:2777
ERROR:  Dec 29 17:44:08 ERR Failed To Connect to cache at address error="context deadline exceeded" address=127.0.0.1:2777
ERROR:  Dec 29 17:43:42 ERR Failed To Connect to cache at address error="context deadline exceeded" address=127.0.0.1:2777
ERROR:  Dec 29 17:43:42 ERR Failed To Connect to cache at address error="context deadline exceeded" address=127.0.0.1:2777
ERROR:  Dec 29 17:44:26 ERR Failed To Connect to cache at address error="context deadline exceeded" address=127.0.0.1:2778
ERROR:  Dec 29 17:44:08 ERR Failed To Connect to cache at address error="context deadline exceeded" address=127.0.0.1:2777
ERROR:  Dec 29 17:44:08 ERR Failed To Connect to cache at address error="context deadline exceeded" address=127.0.0.1:2777
ERROR:  Dec 29 17:44:08 ERR Failed To Connect to cache at address error="context deadline exceeded" address=127.0.0.1:2777
ERROR:  Dec 29 17:44:08 ERR Failed To Connect to cache at address error="context deadline exceeded" address=127.0.0.1:2777
ERROR:  Dec 29 17:44:21 ERR Failed To Connect to cache at address error="context deadline exceeded" address=127.0.0.1:2778
Dec 29 17:44:31 ERR failed getting responses from providers error="No pairings available." GUID=14161156833455468682 endpoint=ETH1jsonrpc relayProcessor="relayProcessor {resultsManager {success 0, nodeErrors:0, protocolErrors:0}, unwantedAddresses: ,currentlyUsedAddresses:}" userIp=127.0.0.1
Dec 29 17:44:31 ERR UniqueGuidResponseForError error="No pairings available." msgSeed=14161156833455468682
Dec 29 17:44:31 ERR jsonrpc http error="No pairings available." GUID=14161156833455468682 HasError=true method=POST path=http://127.0.0.1:3331/ request="{\"jsonrpc\":\"2.0\",\"id\":10,\"method\":\"eth_getBlockByNumber\",\"params\":[\"0x0\",true]}" response="{\"Error_GUID\":\"14161156833455468682\",\"Error\":\"No pairings available.\"}" timeTaken=17.328008ms
Dec 29 17:44:36 ERR failed getting responses from providers error="No pairings available." GUID=10963357731365886617 endpoint=ETH1jsonrpc relayProcessor="relayProcessor {resultsManager {success 0, nodeErrors:0, protocolErrors:0}, unwantedAddresses: ,currentlyUsedAddresses:}" userIp=127.0.0.1
ERROR:  Dec 29 17:43:42 ERR Failed To Connect to cache at address error="context deadline exceeded" address=127.0.0.1:2777
ERROR:  Dec 29 17:43:42 ERR Failed To Connect to cache at address error="context deadline exceeded" address=127.0.0.1:2777
panic: Error found in logs on ./testutil/e2e/protocolLogs/03_EthProvider_05, 05_LavaProvider_01, 05_LavaProvider_03, 05_LavaProvider_04, 03_EthProvider_04, 03_EthProvider_03, 04_jsonConsumer_01, 03_EthProvider_01, 03_EthProvider_02, 06_RPCConsumer_01, 05_LavaProvider_02, 05_LavaProvider_05

goroutine 265 [running]:
github.com/lavanet/lava/v4/testutil/e2e.(*lavaTest).saveLogs(0xc00061d500)
	/home/runner/work/lava/lava/testutil/e2e/protocolE2E.go:939 +0x8e5
github.com/lavanet/lava/v4/testutil/e2e.(*lavaTest).listenCmdCommand(0xc00061d500, 0xc000a0c9c0?, {0xc001361e00, 0x3e}, {0xc000a0c9c0, 0x20})
	/home/runner/work/lava/lava/testutil/e2e/protocolE2E.go:175 +0xb1
github.com/lavanet/lava/v4/testutil/e2e.(*lavaTest).execCommand.func2()
	/home/runner/work/lava/lava/testutil/e2e/protocolE2E.go:162 +0x65
created by github.com/lavanet/lava/v4/testutil/e2e.(*lavaTest).execCommand in goroutine 13
	/home/runner/work/lava/lava/testutil/e2e/protocolE2E.go:161 +0x386
View more details on GitHub Actions