v1.11.2

[jennijuju]

lotus v1.11.2 is a feature release that's highly recommended for ALL lotus users to upgrade, including node operators, storage providers and clients.

Highlights

• 🌟🌟🌟 Introduce Dagstore and CARv2 for deal-making (integrate DAG store and CARv2 in deal-making #6671) (filecoin-project/lotus#6671)
  • lotus miner markets' Dagstore is a
    component of the markets subsystem in lotus-miner. It is a sharded store to hold large IPLD graphs efficiently,
    packaged as location-transparent attachable CAR files and it replaces the former Badger staging blockstore. It
    is designed to provide high efficiency and throughput, and minimize resource utilization during deal-making operations.
    The dagstore also leverages the indexing features of CARv2 to enable plan CAR files to act as read and write
    blockstores, which are served as the direct medium for data exchanges in markets for both storage and retrieval
    deal making without requiring intermediate buffers.
  • In the future, lotus will leverage and interact with Dagstore a lot for new features and improvements for deal
    making, therefore, it's highly recommended to lotus users to go through Lotus Miner: About the markets dagstore thoroughly to learn more about Dagstore's
    conceptual overview, terminology, directory structure, configuration and so on.
  • Note:
    • When you first start your lotus-miner or market subsystem with this release, a one-time/first-time dagstore migration will be triggered which replaces the former Badger staging blockstore with dagstore. We highly
      recommend storage providers to read this section to learn more about
      what the process does, what to expect and how monitor it.
    • It is highly recommended to wait all ongoing data transfer to finish or cancel inbound storage deals that
      are still transferring, using the lotus-miner data-transfers cancel command before upgrade your market nodes. Reason being that the new dagstore changes attributes in the internal deal state objects, and the paths to the staging CARs where the deal data was being placed will be lost.
    • ‼️Having your dags initialized will become important in the near feature for you to provide a better storage
      and retrieval service. We'd suggest you to start [forced bulk initialization] soon if possible as this process
      places relatively high IP workload on your storage system and is better to be carried out gradually and over a
      longer timeframe. Read how to do properly perform a force bulk initialization here.
    • ⏮ Rollback Alert(from v1.11.2-rcX to any version lower): If a storages deal is initiated with M1/v1.11.2(-rcX)
      release, it needs to get to the StorageDealAwaitingPrecommit state before you can do a version rollback or the markets process may panic.
  • 💙 Special thanks to MinerX fellows for testing and providing valuable feedbacks for Dagstore in the past month!
• 🌟🌟 rpcenc: Support reader redirect (filecoin-project/lotus#6952)
  • This allows market processes to send piece bytes directly to workers involved on AddPiece.
• Extending sectors: more practical and flexible tools (filecoin-project/lotus#6097)
  • lotus-miner sectors check-expire to inspect expiring sectors.
  • lotus-miner sectors renew for renewing expiring sectors, see the command help menu for customizable option
    like extension, new-expiration and so on.
• ‼️ MpoolReplaceCmd ( lotus mpool replace`) now takes FIL for fee-limit (filecoin-project/lotus#6927)
• Drop townhall/chainwatch (filecoin-project/lotus#6912)
  • ChainWatch is no longer supported by lotus.
• Configurable CC Sector Expiration (filecoin-project/lotus#6803)
  • Set CommittedCapacitySectorLifetime in lotus-miner/config.toml to specify the default expiration for a new CC
    sector, value must be between 180-540 days inclusive.

New Features

• api/command for encoding actor params (filecoin-project/lotus#7150)
• shed: Support raw encoding in cid id (filecoin-project/lotus#7149)
• feat(miner deals): create subdir to miner repo for staged deals (filecoin-project/lotus#6853)
• Support --actor in miner actor control list (filecoin-project/lotus#7027)
• Shed: Include network name in genesis-verify (filecoin-project/lotus#7019)
• feat: add ChainGetTipSetAfterHeight (filecoin-project/lotus#6990)
• lotus-shed splitstore clear command (filecoin-project/lotus#6967)

Improvements

• improve get api error messages (filecoin-project/lotus#7088)
• Strict major minor version checking on v0 and v1 apis (filecoin-project/lotus#7038)
• make lotus-miner net commands hit markets subsystem. (filecoin-project/lotus#7042)
• Test with latest actors version (filecoin-project/lotus#6998)
• Reduce splitstore memory usage during chain walks (filecoin-project/lotus#6949)
• Remove forgotten non-functioning config from the pre-mainnet days (filecoin-project/lotus#6970)
• add explicit error msg if repo dir does not exist (filecoin-project/lotus#6909)
• Test/pledge batching msg prop (filecoin-project/lotus#6537)
• reasonable max value for initial sector expiration (filecoin-project/lotus#6099)
• support MARKETS_API_INFO env var, and markets-repo, markets-api-url CLI flags. (filecoin-project/lotus#6936)
• Improve formatting of workers CLI (filecoin-project/lotus#6942)
• make: set default GOCC earlier (filecoin-project/lotus#6932)
• Moving GC Followup (filecoin-project/lotus#6905)
• Log more call context during errors (filecoin-project/lotus#6918)
• polish(errors): better state tree errors (filecoin-project/lotus#6923)
• adding an RuntimeSubsystems API to storage miner; fix lotus-miner info (filecoin-project/lotus#6906)
• Reduce entropy in the chain package (filecoin-project/lotus#6889)
• make: Allow setting Go compiler with GOCC (filecoin-project/lotus#6911)

Bug Fixes

• sealing: Fix RecoverDealIDs loop with changed PieceCID (filecoin-project/lotus#7117)
• Fix error handling in SectorAddPieceToAny api impl (filecoin-project/lotus#7135)
• add rice box to required binaries (filecoin-project/lotus#7125)
• fix(miner): always create miner deal staging directory (fix(miner): always create miner deal staging directory #7098) (filecoin-project/lotus#7098)
• fix build after merging Extending sectors: more practical and flexible tools #6097. (fix build after merging #6097. #7096) (filecoin-project/lotus#7096)
• fix: don't check for t_aux when proving (filecoin-project/lotus#7011)
• fix: vet actors shims (filecoin-project/lotus#6999)
• fix: more logging in maybeStartBatch error (filecoin-project/lotus#6996)
• fix flaky TestDealPublisher and re-enable (filecoin-project/lotus#6991)
• fix skipCount (filecoin-project/lotus#6940)
• fix bug in MpoolPending message exclusion (filecoin-project/lotus#6945)
• PreCommitPolicy: Don't try to align expirations on proving period boundaries (filecoin-project/lotus#7018)
• make: fix version check when using gotip (filecoin-project/lotus#6916)
• fix ticket check (filecoin-project/lotus#6882)

Dependency Updates

• github.com/filecoin-project/go-data-transfer (v1.7.2 -> v1.7.8):
• github.com/filecoin-project/go-fil-markets (v1.6.2 -> v1.8.1):
• update go-libp2p-pubsub to v0.5.4 (filecoin-project/lotus#6958)
• integrate the proof patch: tag proofs-v9-revert-deps-hotfix
• Update markets, dt and graphsync (filecoin-project/lotus#7160)
• Remove replace directive for multihash dep (Remove replace directive for multihash dep #7113) (filecoin-project/lotus#7113)
• upgrade upstream dependencies. (filecoin-project/lotus#7115)
• Update to latest FFI (filecoin-project/lotus#7110)
• Update state machine deps for logging (filecoin-project/lotus#6941)
• Update deps for more logging in data transfer and markets (filecoin-project/lotus#6937)
• Update to branches with improved logging (filecoin-project/lotus#6919)
• update go-libp2p-pubsub to v0.5.3 (filecoin-project/lotus#6907)

Others

• Fix nits and see if codecov works now with auto (filecoin-project/lotus#7151)
• Codecov Projects (filecoin-project/lotus#7147)
• remove m1 templates and make area selection multi-optionable (filecoin-project/lotus#7121)
• release -> master (filecoin-project/lotus#7105)
• Lotus release process - how we make releases (filecoin-project/lotus#6944)
• codecov: fix mock name (filecoin-project/lotus#7039)
• codecov: fix regexes (filecoin-project/lotus#7037)
• chore: disable flaky test (filecoin-project/lotus#6957)
• set buildtype in nerpa and butterfly (filecoin-project/lotus#6085)
• release v1.11.1 backport -> master (filecoin-project/lotus#6929)
• chore: fixup issue templates (filecoin-project/lotus#6899)
• bump master version to v1.11.2-dev (filecoin-project/lotus#6903)
• releases -> master for v1.11.0 (filecoin-project/lotus#6894)

Contributors

Contributor	Commits	Lines ±	Files Changed
@magik6k	23	+5040/-8389	114
@aarshkshah1992	11	+4859/-1078	101
@raulk	5	+4170/-1662	104
@vyzo	30	+1092/-702	49
@nonsense	6	+630/-472	19
@ZenGround0	31	+556/-274	74
@he Weidong	16	+680/-128	16
@raulk	16	+444/-277	49
@Stebalien	11	+403/-259	48
@jennijuju	17	+276/-281	42
@dirkmc	5	+204/-138	20
@placer14	7	+178/-77	17
@BlocksOnAChain	1	+138/-0	1
@frrist	1	+63/-56	2
@arajasek	7	+74/-42	13
@frrist	2	+67/-6	6
@hannahhoward	2	+13/-11	3
@coryschwartz	1	+16/-6	3
@whyrusleeping	1	+7/-7	1
@hunjixin	1	+8/-6	1
@aarshkshah1992	1	+6/-6	2
@dirkmc	2	+8/-0	2
@mx	2	+6/-1	2
@travisperson	1	+3/-2	1
@jennijuju	2	+2/-2	2
@ribasushi	1	+1/-2	2

---

This discussion was created from the release v1.11.2.

[zlhwdsz]

The 7th contributor seems to be me?