Incorrect Danelaw Amoy Activation Height

[nhovsmith-cb]

The amoy activation height for the danelaw hardfork listed in v1.2.0-beta release notes, height: 6490424, occurred last year. Given that danelaw has not yet rolled out yet, this seems incorrect.

[avalkov]

@nhovsmith-cb You can see current amoy heimdall height here - https://heimdall-api-amoy.polygon.technology/bor/latest-span

[MrFreezeDZ]

Today I saw a log line in an instance with Heimdall 1.2.0-beta which stated that the new v2 span is already written somewhere:

INFO [2025-01-21|05:49:39.768] Committed state                              module=state height=6458191 txs=0 appHash=5EE59F700B5EACFE973D5CE6C9A63EA6E7E3F7E68CBF7DBA88FE6B2CA02D18B6
INFO [2025-01-21|05:49:45.921] Executed block                               module=state height=6458192 validTxs=4 invalidTxs=0
INFO [2025-01-21|05:49:45.933] Committed state                              module=state height=6458192 txs=4 appHash=7FBB40AB24A39684D40D95787D1D2FEA6426B4491788713B408E5AB77ECCBC69
ERROR[2025-01-21|05:49:51.457] msg span v2 is not allowed before Danelaw hardfork height module=bor
INFO [2025-01-21|05:49:51.458] Executed block                               module=state height=6458193 validTxs=0 invalidTxs=1
INFO [2025-01-21|05:49:51.469] Committed state                              module=state height=6458193 txs=1 appHash=BCBAC7025B3F6122F14F82833276F1BAEB893A543DC33589A0A170239498795C
INFO [2025-01-21|05:49:57.512] Executed block                               module=state height=6458194 validTxs=0 invalidTxs=0
INFO [2025-01-21|05:49:57.524] Committed state                              module=state height=6458194 txs=0 appHash=2C26C559125ADC5788D6B8EAF75F0F78CAC6529C1385FF7556FA570BFF9FCA24

But at the same block height another instance running still with Heimdall 1.1.0-beta logged:

INFO [2025-01-21|05:49:39.761] Committed state                              module=state height=6458191 txs=0 appHash=5EE59F700B5EACFE973D5CE6C9A63EA6E7E3F7E68CBF7DBA88FE6B2CA02D18B6
INFO [2025-01-21|05:49:45.992] Executed block                               module=state height=6458192 validTxs=4 invalidTxs=0
INFO [2025-01-21|05:49:46.020] Committed state                              module=state height=6458192 txs=4 appHash=7FBB40AB24A39684D40D95787D1D2FEA6426B4491788713B408E5AB77ECCBC69
INFO [2025-01-21|05:49:51.457] Executed block                               module=state height=6458193 validTxs=0 invalidTxs=1
INFO [2025-01-21|05:49:51.483] Committed state                              module=state height=6458193 txs=1 appHash=7FBB40AB24A39684D40D95787D1D2FEA6426B4491788713B408E5AB77ECCBC69
ERROR[2025-01-21|05:49:56.783] enterPrevote: ProposalBlock is invalid       module=consensus height=6458194 round=0 err="Wrong Block.Header.AppHash.  Expected 7FBB40AB24A39684D40D95787D1D2FEA6426B4491788713B408E5AB77ECCBC69, got B
CBAC7025B3F6122F14F82833276F1BAEB893A543DC33589A0A170239498795C"
ERROR[2025-01-21|05:49:57.096] CONSENSUS FAILURE!!!                         module=consensus err="enterPrecommit: +2/3 prevoted for an invalid block: Wrong Block.Header.AppHash.  Expected 7FBB40AB24A39684D40D95787D1D2FEA6426B4491788713B408E5AB77ECCBC69, got BCBAC7025B3F6122F14F82833276F1BAEB893A543DC33589A0A170239498795C" stack="goroutine 238357 [running]:\nruntime/debug.Stack()\n\t/usr/local/go/src/runtime/debug/stack.go:24 +0x5e\ngithub.com/tendermint/tendermint/consensus.(*ConsensusState).receiveRoutine.func2()\n\t/root/go/pkg/mod/github.com/maticnetwork/[email protected]/consensus/state.go:602 +0x46\npanic({0x19b21e0?, 0xc03180c9f0?})\n\t/usr/local/go/src/runtime/panic.go:770 +0x132\ngithub.com/tendermint/tendermint/consensus.(*ConsensusState).enterPrecommit(0xc001428a88, 0x628b52, 0x0)\n\t/root/go/pkg/mod/github.com/maticnetwork/[email protected]/consensus/state.go:1154 +0x10c8\ngithub.com/tendermint/tendermint/consensus.(*ConsensusState).addVote(0xc001428a88, 0xc00b732840, {0xc02587bcb0, 0x28})\n\t/root/go/pkg/mod/github.com/maticnetwork/[email protected]/consensus/state.go:1668 +0xe59\ngithub.com/tendermint/tendermint/consensus.(*ConsensusState).tryAddVote(0xc001428a88, 0xc00b732840, {0xc02587bcb0?, 0x1b36820?})\n\t/root/go/pkg/mod/github.com/maticnetwork/[email protected]/consensus/state.go:1532 +0x26\ngithub.com/tendermint/tendermint/consensus.(*ConsensusState).handleMsg(0xc001428a88, {{0x27d6160, 0xc09e646110}, {0xc02587bcb0, 0x28}})\n\t/root/go/pkg/mod/github.com/maticnetwork/[email protected]/consensus/state.go:691 +0x127\ngithub.com/tendermint/tendermint/consensus.(*ConsensusState).receiveRoutine(0xc001428a88, 0x0)\n\t/root/go/pkg/mod/github.com/maticnetwork/[email protected]/consensus/state.go:633 +0x345\ncreated by github.com/tendermint/tendermint/consensus.(*ConsensusState).OnStart in goroutine 81\n\t/root/go/pkg/mod/github.com/maticnetwork/[email protected]/consensus/state.go:334 +0x40f\n"
ERROR[2025-01-21|05:51:12.750] Connection failed @ sendRoutine              module=p2p [email protected]:26656 conn=MConn{204.16.244.84:26656} err="pong timeout"
ERROR[2025-01-21|05:52:42.370] Connection failed @ sendRoutine              module=p2p [email protected]:26656 conn=MConn{34.147.224.69:26656} err="pong timeout"
ERROR[2025-01-21|05:53:12.370] Connection failed @ sendRoutine              module=p2p [email protected]:26656 conn=MConn{34.105.158.174:26656} err="pong timeout"
ERROR[2025-01-21|05:53:12.372] Connection failed @ sendRoutine              module=p2p [email protected]:26656 conn=MConn{34.147.251.138:26656} err="pong timeout"
ERROR[2025-01-21|05:54:12.347] Connection failed @ sendRoutine              module=p2p [email protected]:26656 conn=MConn{148.251.87.182:26656} err="pong timeout"
ERROR[2025-01-21|05:54:42.334] Connection failed @ sendRoutine              module=p2p [email protected]:38656 conn=MConn{169.155.45.63:38656} err="pong timeout"
ERROR[2025-01-21|05:54:42.401] Connection failed @ sendRoutine              module=p2p [email protected]:26656 conn=MConn{52.208.81.179:26656} err="pong timeout"
ERROR[2025-01-21|05:54:42.834] Connection failed @ sendRoutine              module=p2p [email protected]:26656 conn=MConn{52.76.37.145:26656} err="pong timeout"
ERROR[2025-01-21|05:55:12.345] Connection failed @ sendRoutine              module=p2p [email protected]:56 conn=MConn{173.249.52.149:56} err="pong timeout"
ERROR[2025-01-21|05:56:12.368] Connection failed @ sendRoutine              module=p2p [email protected]:26656 conn=MConn{34.147.221.100:26656} err="pong timeout"
ERROR[2025-01-21|05:56:42.603] Connection failed @ sendRoutine              module=p2p [email protected]:38656 conn=MConn{169.155.46.35:38656} err="pong timeout"
ERROR[2025-01-21|05:57:12.634] Connection failed @ sendRoutine              module=p2p [email protected]:36656 conn=MConn{185.8.106.40:36656} err="pong timeout"
ERROR[2025-01-21|05:57:12.798] Connection failed @ sendRoutine              module=p2p [email protected]:36656 conn=MConn{174.127.69.23:36656} err="pong timeout"
ERROR[2025-01-21|05:57:42.346] Connection failed @ sendRoutine              module=p2p [email protected]:26656 conn=MConn{144.76.218.86:26656} err="pong timeout"
ERROR[2025-01-21|05:58:42.347] Connection failed @ sendRoutine              module=p2p [email protected]:26656 conn=MConn{148.251.87.182:26656} err="pong timeout"
ERROR[2025-01-21|05:59:42.612] Connection failed @ sendRoutine              module=p2p [email protected]:26656 conn=MConn{204.16.244.89:26656} err="pong timeout"
ERROR[2025-01-21|05:59:42.807] Connection failed @ sendRoutine              module=p2p [email protected]:26656 conn=MConn{52.74.18.182:26656} err="pong timeout"
ERROR[2025-01-21|06:00:12.362] Connection failed @ sendRoutine              module=p2p [email protected]:56 conn=MConn{173.249.52.149:56} err="pong timeout"
ERROR[2025-01-21|06:00:42.616] Connection failed @ sendRoutine              module=p2p [email protected]:38656 conn=MConn{169.155.46.35:38656} err="pong timeout"
ERROR[2025-01-21|06:01:42.799] Connection failed @ sendRoutine              module=p2p [email protected]:26656 conn=MConn{52.76.37.145:26656} err="pong timeout"

So what do we have to do with this 1.1.0-beta version? The upgrade to 1.2.0-beta did not fix the problem. Do we have to sync from scratch?

[avalkov]

Please update to Heimdall 1.2.0-beta, the error ERROR[2025-01-21|05:49:51.457] msg span v2 is not allowed before Danelaw hardfork height module=bor is fine. Also you can rollback the committed block.

heimdalld rollback --home /path/to/heimdall-dir --force

[github-actions]

This issue is stale because it has been open 14 days with no activity. Remove stale label or comment or this will be closed in 14 days.