Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Venus Node Cannot Sync to Chain and Report Finished Sync in Local Development Filecoin Network After Reconnect to Miner Node #6338

Closed
1 of 7 tasks
frystal opened this issue May 20, 2024 · 1 comment
Closed
1 of 7 tasks

Venus Node Cannot Sync to Chain and Report Finished Sync in Local Development Filecoin Network After Reconnect to Miner Node #6338

frystal opened this issue May 20, 2024 · 1 comment
Labels
C-bug Category: This is a bug

Comments

@frystal
Copy link

frystal commented May 20, 2024 •
edited
Loading

Sophon Service / 智子服务

  • venus
  • sophon-messager
  • sophon-miner
  • sophon-auth
  • sophon-gateway
  • sophon-co
  • 文档 / docs

Version / 版本

{
        "Version": "1.15.1+git.4dd92bac"
}

Describe the Bug / 描述

While running the local Filecoin network following the instructions from https://lotus.filecoin.io/lotus/developers/local-network/, I let Venus join the local Filecoin network along with Forest and Lotus. After connection between Loter miner and Venus node is breaked due to the network packet drop. The Lotus miner is applied for a 100s clock skew. Then we reconnect the Venus node to the Lotus miner. We find the Venus node can not synced with the latest block from Lotus and report it has finished sync.

Logging Information / 日志

<details>
  <summary>Venus node sync status</summary>
  
{sender:12D3KooWHm5aBpFWeXQ8C7i6tCfbxCuKHHakgqTQrvqff7xRovhV height=1218 head={ bafy2bzacebms7sy5thlkvzlllz7aheq6ogj72etgjizxn2j2aro64hos5xbcq }}
Done!
Lotus miner block list ``` 1690: (May 17 16:35:10) [ bafy2bzaceclixbuye35xsnlvpdwtek7ovzr5kd3g7g2w4vpy4h4r3trr7ckxg: t01000, ] 1691: (May 17 16:35:14) [ bafy2bzaceaix6nhhec4s2jwxsy25gl6z7jmtfe4vgtgxzzgymdomziyxzceig: t01000, ] 1692: (May 17 16:35:18) [ bafy2bzacec7qef7cvol5qxkvrbxm4zl2tdpah6nzxd6cxpldu7hyq3ekws43c: t01000, ] 1693: (May 17 16:35:22) [ bafy2bzacealsoqwpjzfhcehytg7etyyeu6sytsmgqsdrscz3stzfvdvp6olda: t01000, ] 1694: (May 17 16:35:26) [ bafy2bzacedpty7firaylfioy256citknfqvdmxwlfjnaib4a5hdgkkqsvlhae: t01000, ] 1695: (May 17 16:35:30) [ bafy2bzaceatzgbfuumz5dknlwertsn3lnsbkot3dhu7qyr7vux5et473rakus: t01000, ] 1696: (May 17 16:35:34) [ bafy2bzaceczukjhtbboko4pyer3abqohv72kz2ptbsfra5ywot5bjjalnh7c4: t01000, ] 1697: (May 17 16:35:38) [ bafy2bzacebtim5pxs2y6fmrtwlsv5fcpnkrkrc7g4o27yg2hg6wadis5cvmzq: t01000, ] 1698: (May 17 16:35:42) [ bafy2bzacedxhurpsqfhybxmaznmhh2rnvd55pttp7q64ynupg23fysp42x7ua: t01000, ] 1699: (May 17 16:35:46) [ bafy2bzacec3d35ovrzfjz3iahsav273lfvobltwc5kxtvrorlg4hirkt2du64: t01000, ] 1700: (May 17 16:35:50) [ bafy2bzaceda7r3lsbiukymohlq3ofeukylec6exby64cn2joefy4aphsgs4oi: t01000, ] 1701: (May 17 16:35:54) [ bafy2bzacecpab5y6oz27fuqly2mmaphwuwc3xxrpcqcayuwabw5ledku5iiou: t01000, ] 1702: (May 17 16:35:58) [ bafy2bzaceaao24v5oualy55cobqx7eif2dsnytw4ejhgelerr2nijhgm5b7ze: t01000, ] 1703: (May 17 16:36:02) [ bafy2bzacedtydzeeigrqw62vqk44xwog5zm37tkk2pgxjzcn6uol7ptcrtime: t01000, ] 1704: (May 17 16:36:06) [ bafy2bzacedkvebgi4uesum7gbtrgxios7p2u7ntzi3ozq7pdxlqsf27iwva5u: t01000, ] 1705: (May 17 16:36:10) [ bafy2bzacebmg2ucactaih7ped6stql42waafm73xqa6rm6im2mnyrp3dyehzc: t01000, ] 1706: (May 17 16:36:14) [ bafy2bzaceb7qlzki7vqrl6ff4dx2jxfwrm4pzicsz3lxstvufujrlo2bcxpj2: t01000, ] 1707: (May 17 16:36:18) [ bafy2bzaceag6h2ypjonq7by3yszdoyfoc2yrhqkketzby2mugvrga7eabqwc2: t01000, ] 1708: (May 17 16:36:22) [ bafy2bzaceaskb65cqfv3nbxqn4fmqzcrbcynknheswg2ahwxnpcf6tayqyixg: t01000, ] 1709: (May 17 16:36:26) [ bafy2bzacectfhj6y34l323enpoe734k3bvdfgrqi7bonxjh45st3thotp5y7e: t01000, ] 1710: (May 17 16:36:30) [ bafy2bzacediuvdhtifm2sj6xwadaslmqqfbeos43vy6hgrcvg2klolefx6ig2: t01000, ] 1711: (May 17 16:36:34) [ bafy2bzaced6wh6aziuft6mrk7t27kzak46w3oi75finbrxqigr57ptorew3c6: t01000, ] 1712: (May 17 16:36:38) [ bafy2bzacedaw6uoxdfvve2w3oynt6wimhrjrfyseqlqnnkni2bcyf63fwjjms: t01000, ] 1713: (May 17 16:36:42) [ bafy2bzacebwovfov2cermvobgz2rp67iwymz6zecbzvi6ymelvq4j26pmmvu2: t01000, ] 1714: (May 17 16:36:46) [ bafy2bzacebjl5bq5tv4thctmttalhozzifluvmd5umndlwseucip5ryi727pi: t01000, ] 1715: (May 17 16:36:50) [ bafy2bzacedm3jdrrevusdlyoi6lyhnbsqakplcyg2u2nxbgbehn5lvu6eotp6: t01000, ] 1716: (May 17 16:36:54) [ bafy2bzaceaexsfo5j5s5uyw2cw5pffad7zw25rdpa64ozwoedmwzrmir6mb6w: t01000, ] 1717: (May 17 16:36:58) [ bafy2bzaced62trbdfhfqrlwld4taq75rqjwmfnf6qsgdnrdh4qmqbqf47beus: t01000, ] 1718: (May 17 16:37:02) [ bafy2bzacecwwdroxtatp7csi6iwytboo6tqxk6hmsbuasbzaac7rl3ccr4gxu: t01000, ] 1719: (May 17 16:37:06) [ bafy2bzacebrqxfc3bjvwk5dwijcdaiyljs77srvu3pvnv75my5wwblpzln53o: t01000, ] ```
Venus node swarm peers ``` root@venus-node-0:~/venus# ./venus swarm peers 12D3KooWHm5aBpFWeXQ8C7i6tCfbxCuKHHakgqTQrvqff7xRovhV, [/ip4/10.244.1.188/udp/4001/quic-v1] (Lotus miner) ```
Lotus miner net peers 
QmfG5gmg4r3S59wmC15H6TtphBAethWtTFH5HKZogvHQdy, [/ip4/10.244.1.191/udp/45565/quic-v1] (Venus node)
Venus daemon logs 
2024-05-20T13:16:47.329Z	INFO	chainsync.dispatcher	dispatcher/dispatcher.go:292	failed sync of { bafy2bzaceaz3nvnnhn3u33zd5blqpqbtadu5omyqb2mwpm56len7kj6naw66e } at 1687  process message failed failed to sync tipset { bafy2bzacealq5u6cb5g2c35livqc4hkthkebmhx2lzqltpngpml32yjvkhxuk }, number 0 of 8 in chain: validate mining failed 3 errors occurred:
  * hand fork error: migrating actors v11 state: upgrading to actors v13: failed to run migration: running deferred job: state migration failed for actor code bafk2bzaceaw6dslv6pfqha4ynghq2imij5khnnjrie22kmfgtpie3bvxho6jq, addr t05: using cache: migrating state: failed to load market state for t05: cbor input had wrong number of fields
error validating tipset
github.com/filecoin-project/venus/pkg/consensus.(*Expected).RunStateTransition
  /root/venus/pkg/consensus/expected.go:233
github.com/filecoin-project/venus/pkg/statemanger.(*Stmgr).RunStateTransition
  /root/venus/pkg/statemanger/state_manger.go:310
github.com/filecoin-project/venus/pkg/consensus.(*BlockValidator).validateBlock.func1
  /root/venus/pkg/consensus/block_validator.go:199
github.com/Gurpartap/async.Err.func1
  /go/pkg/mod/github.com/!gurpartap/[email protected]/error.go:29
runtime.goexit
  /usr/local/go/src/runtime/asm_amd64.s:1650
  * hand fork error: migrating actors v11 state: upgrading to actors v13: failed to run migration: running deferred job: state migration failed for actor code bafk2bzaceaw6dslv6pfqha4ynghq2imij5khnnjrie22kmfgtpie3bvxho6jq, addr t05: using cache: migrating state: failed to load market state for t05: cbor input had wrong number of fields
error validating tipset
github.com/filecoin-project/venus/pkg/consensus.(*Expected).RunStateTransition
  /root/venus/pkg/consensus/expected.go:233
github.com/filecoin-project/venus/pkg/statemanger.(*Stmgr).RunStateTransition
  /root/venus/pkg/statemanger/state_manger.go:310
github.com/filecoin-project/venus/pkg/consensus.(*BlockValidator).validateBlock.func8
  /root/venus/pkg/consensus/block_validator.go:266
github.com/Gurpartap/async.Err.func1
  /go/pkg/mod/github.com/!gurpartap/[email protected]/error.go:29
runtime.goexit
  /usr/local/go/src/runtime/asm_amd64.s:1650
  * get tipsetstate(22, [bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk]) failed: error validating tipset: hand fork error: migrating actors v11 state: upgrading to actors v13: failed to run migration: running deferred job: state migration failed for actor code bafk2bzaceaw6dslv6pfqha4ynghq2imij5khnnjrie22kmfgtpie3bvxho6jq, addr t05: using cache: migrating state: failed to load market state for t05: cbor input had wrong number of fields


2024-05-20T13:16:52.546Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:16:52.546Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:17:00.208Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:17:00.208Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:17:07.246Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:17:07.246Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:17:14.562Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:17:14.562Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:17:22.044Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:17:22.044Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:17:29.240Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:17:29.240Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:17:36.483Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:17:36.483Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:17:39.490Z	INFO	bufbs	blockstore/cache_store.go:76	lru database cache hitrate:0.011765
2024-05-20T13:17:39.719Z	INFO	bufbs	blockstore/cache_store.go:76	lru database cache hitrate:0.946834
2024-05-20T13:17:43.682Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:17:43.682Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:17:51.100Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:17:51.100Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:17:58.427Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:17:58.427Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:18:05.576Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:18:05.576Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:18:12.876Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:18:12.876Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:18:20.455Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:18:20.455Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:18:27.856Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:18:27.856Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:18:35.381Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:18:35.381Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:18:39.489Z	INFO	bufbs	blockstore/cache_store.go:76	lru database cache hitrate:0.011765
2024-05-20T13:18:39.719Z	INFO	bufbs	blockstore/cache_store.go:76	lru database cache hitrate:0.946834
2024-05-20T13:18:42.796Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:18:42.796Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:18:50.093Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:18:50.093Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:18:57.461Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:18:57.461Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:19:04.990Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:19:04.990Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:19:11.914Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:19:11.915Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:19:19.323Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:19:19.323Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:19:26.668Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:19:26.668Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:19:33.881Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:19:33.882Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:19:39.490Z	INFO	bufbs	blockstore/cache_store.go:76	lru database cache hitrate:0.011765
2024-05-20T13:19:39.718Z	INFO	bufbs	blockstore/cache_store.go:76	lru database cache hitrate:0.946834
2024-05-20T13:19:40.965Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:19:40.966Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:19:47.894Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:19:47.894Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:19:55.064Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:19:55.064Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:20:02.548Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:20:02.549Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:20:10.202Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:20:10.203Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:20:17.742Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:20:17.742Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:20:25.199Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:20:25.200Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:20:32.597Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:20:32.597Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:20:39.489Z	INFO	bufbs	blockstore/cache_store.go:76	lru database cache hitrate:0.011765
2024-05-20T13:20:39.718Z	INFO	bufbs	blockstore/cache_store.go:76	lru database cache hitrate:0.946834
2024-05-20T13:20:40.017Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:20:40.017Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:20:47.478Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:20:47.478Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:20:54.779Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:20:54.779Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:21:02.221Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:21:02.221Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:21:09.460Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:21:09.460Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:21:16.760Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:21:16.760Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:21:23.750Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:21:23.750Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:21:31.364Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:21:31.364Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:21:38.886Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:21:38.886Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:21:39.489Z	INFO	bufbs	blockstore/cache_store.go:76	lru database cache hitrate:0.011765
2024-05-20T13:21:39.718Z	INFO	bufbs	blockstore/cache_store.go:76	lru database cache hitrate:0.946834
2024-05-20T13:21:46.056Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:21:46.056Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:21:53.627Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:21:53.627Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
2024-05-20T13:22:00.885Z	WARN	consensus	consensus/block_validator.go:437	failed to load lookback tipset for incoming block: state not exit: { bafy2bzaceck7r5kswyarx5kg444unej5vypsmn2qtyouuhwxo3iszoo72ksvk }
2024-05-20T13:22:00.885Z	ERROR	consensus	consensus/block_validator.go:359	cannot validate block message; unknown miner or miner that doesn't meet min power in unsynced chain
```

Repo Steps / 重现步骤

  1. Follow the instructions from Lotus to set up a local Filecoin network with 1 Lotus miner, 1 Lotus nodes, 1 Forest nodes .
  2. Start the Venus with the following command: "./venus daemon --swarmlisten=/ip4/0.0.0.0/tcp/4000 --genesisfile=./devgen.car --network=2k --password=123456"
  3. Wait 30 seconds until the Venus node is synced with the latest block.
  4. Apply 80 packet drop for 1m for the Venus node so that it break the connection towards the Lotus miner
  5. Apply 100s clock skew for 60s for the Lotus miner
  6. Reconnect the Venus node to the Lotus miner
  7. Find the Venus can not sync with latest block from Lotus miner
@frystal frystal added the C-bug Category: This is a bug label May 20, 2024
@simlecode
Copy link
Collaborator

Repeat with #6337

@simlecode simlecode closed this as not planned Won't fix, can't repro, duplicate, stale Jul 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
C-bug Category: This is a bug
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@frystal @simlecode