Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: introduce SyntheticPoRep #11057

Closed
wants to merge 92 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
92 commits
Select commit Hold shift + click to select a range
c7b9633
feat: introduce local nv21 skeleton
rjan90 Jul 7, 2023
68a03c4
Set local devnet-genesis to nv20
rjan90 Jul 11, 2023
1db45f4
synthetic-porep subpackages
snadrus May 26, 2023
b43665a
synthPoRep in PreferredSeal..()
snadrus May 29, 2023
f4fe4ca
synthetic porep config
snadrus May 29, 2023
0803854
Impl synthPoRep
snadrus Jun 1, 2023
5ed8a5c
clearSynthProofs
snadrus Jun 1, 2023
7f306a5
Synthetic PoRep Impl
snadrus Jun 9, 2023
8281b26
Synthetic PoRep provider interface solution
snadrus Jun 9, 2023
1a799ae
fixes
snadrus Jun 28, 2023
a43f066
fix deps
magik6k Jul 12, 2023
c7dd001
ffiwrapper: Synth cleanup fixes
magik6k Jul 12, 2023
518c2cd
rename synth porep config to a shorter name
magik6k Jul 12, 2023
2f19a5f
gen, fix build with new state-types
magik6k Jul 12, 2023
f8c1510
itests: Add test for synth-porep pledge
magik6k Jul 12, 2023
c58ab3e
more correct actor bundles
magik6k Jul 12, 2023
50cf197
Make Synthetic PoRep work
magik6k Jul 13, 2023
85efa3e
Use state-types with correct v12 migration
magik6k Jul 13, 2023
f7d51da
docsgen
magik6k Jul 13, 2023
b649ebd
TestPledgeSynth: must-post mining
magik6k Jul 13, 2023
a396947
ffiwrapper: Test synth porep
magik6k Jul 13, 2023
34996df
update state-types to include fixed MaxProveCommitDuration policy
magik6k Jul 13, 2023
85b78f9
update ffi to use lowercased synth challenges file name
magik6k Jul 13, 2023
9eb4bb8
make gen
magik6k Jul 13, 2023
5743ed0
test: fix fevm recursive call
Stebalien Jul 14, 2023
4534416
Update butterfly-schedule
rjan90 Jul 17, 2023
9aaa00b
Add butterfly artifacts
rjan90 Jul 17, 2023
c4b469b
Update butterfly-bootstraps
rjan90 Jul 18, 2023
7adf823
add synthPoRep support to bench simple
magik6k Jul 18, 2023
1eca520
Added support for Filecoin network version 21 (v12 state types)
snissn Aug 2, 2023
4f0e2f3
Added CPU profiling option to lotus-shed
snissn Aug 2, 2023
c8f8095
update ffi with synth porep fixes
magik6k Aug 3, 2023
607e8cc
Updated Butterfly-assets
rjan90 Aug 3, 2023
7f4d8b3
add go-state-types with nv21 migration code
snissn Aug 3, 2023
dbb166b
Set upgrade epoch on Butterfly earlier
rjan90 Aug 7, 2023
9539f59
Add new butterfly-assets
rjan90 Aug 7, 2023
cd9fdcf
update go state types to use the experiment speed up branch in order …
snissn Aug 7, 2023
0b68348
initial skeleton for nv21 migrations test. migration succesfully exec…
snissn Aug 10, 2023
f57b5bd
spelling
snissn Aug 10, 2023
fa0e512
Merge pull request #11149 from filecoin-project/feat/nv21-migrations-…
arajasek Aug 14, 2023
e6b0231
Add more post-migration sanity checks
arajasek Aug 14, 2023
1eec816
Merge pull request #11168 from filecoin-project/asr/more-migration-check
arajasek Aug 17, 2023
37f6cd3
Register SynthPoRep in ResourceTable
rjan90 Aug 29, 2023
7db6f31
sealing: pc batch: Call PreCommitSectorBatch2
magik6k Aug 8, 2023
d6aed7b
pc batch: drop individual precommit processing
magik6k Aug 8, 2023
79b6ffe
ci: Drop legacy cc-replace itests
magik6k Aug 8, 2023
ecb6dee
sealing pipeline: Drop legacy single-pc1 submit path
magik6k Aug 8, 2023
1c447b2
sealing pipeline: Fix unit tests
magik6k Aug 8, 2023
556815f
sealing pipeline: Set commd in precommit params
magik6k Aug 8, 2023
3887bf9
sealing pipeline: Only set pc commd when deals are present
magik6k Aug 8, 2023
d94b1ca
itests: Drop sealing itests for legacy network versions
magik6k Aug 8, 2023
2ebd080
itests: Port deadline-toggling itest to nv20
magik6k Aug 9, 2023
4ee2096
chore: chain/actors: Use type proxies instead of versioned GST imports
magik6k Aug 29, 2023
d3b31d5
Merge pull request #11216 from filecoin-project/chore/actor-type-proxies
magik6k Aug 29, 2023
a939662
Merge pull request #11215 from filecoin-project/backport/nv21/feat/ac…
magik6k Aug 29, 2023
cf27bcf
feat: introduce local nv21 skeleton
rjan90 Jul 7, 2023
40e23bf
synthetic-porep subpackages
snadrus May 26, 2023
43e060f
synthPoRep in PreferredSeal..()
snadrus May 29, 2023
c013455
synthetic porep config
snadrus May 29, 2023
0c01998
Impl synthPoRep
snadrus Jun 1, 2023
7209418
clearSynthProofs
snadrus Jun 1, 2023
c16fe1a
Synthetic PoRep Impl
snadrus Jun 9, 2023
de470e5
Synthetic PoRep provider interface solution
snadrus Jun 9, 2023
33b6512
fixes
snadrus Jun 28, 2023
d194a8c
fix deps
magik6k Jul 12, 2023
717449e
ffiwrapper: Synth cleanup fixes
magik6k Jul 12, 2023
3bc3e5f
rename synth porep config to a shorter name
magik6k Jul 12, 2023
76eb1ce
gen, fix build with new state-types
magik6k Jul 12, 2023
cdf9d15
itests: Add test for synth-porep pledge
magik6k Jul 12, 2023
9ada570
more correct actor bundles
magik6k Jul 12, 2023
9c64cb7
Make Synthetic PoRep work
magik6k Jul 13, 2023
777bf87
Use state-types with correct v12 migration
magik6k Jul 13, 2023
8e608f1
docsgen
magik6k Jul 13, 2023
a8f9705
TestPledgeSynth: must-post mining
magik6k Jul 13, 2023
a1273cd
ffiwrapper: Test synth porep
magik6k Jul 13, 2023
bc16bbb
update ffi to use lowercased synth challenges file name
magik6k Jul 13, 2023
5d44497
make gen
magik6k Jul 13, 2023
af14077
test: fix fevm recursive call
Stebalien Jul 14, 2023
4077db2
Update butterfly-schedule
rjan90 Jul 17, 2023
abffd1c
Add butterfly artifacts
rjan90 Jul 17, 2023
4a335e0
Update butterfly-bootstraps
rjan90 Jul 18, 2023
d46df80
add synthPoRep support to bench simple
magik6k Jul 18, 2023
acccb09
Updated Butterfly-assets
rjan90 Aug 3, 2023
8e0aed1
Set upgrade epoch on Butterfly earlier
rjan90 Aug 7, 2023
3f6e3a8
Add new butterfly-assets
rjan90 Aug 7, 2023
7990bb8
Added support for Filecoin network version 21 (v12 state types)
snissn Aug 2, 2023
54e0ff7
Added CPU profiling option to lotus-shed
snissn Aug 2, 2023
fcfe16d
initial skeleton for nv21 migrations test. migration succesfully exec…
snissn Aug 10, 2023
b7543db
spelling
snissn Aug 10, 2023
17cbe98
Add more post-migration sanity checks
arajasek Aug 14, 2023
5a16589
Register SynthPoRep in ResourceTable
rjan90 Aug 29, 2023
9cf6cf7
Merge branch 'feat/nv21-skeleton' of https://github.com/filecoin-proj…
rjan90 Sep 7, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
36 changes: 0 additions & 36 deletions .circleci/config.yml
Original file line number Diff line number Diff line change
Expand Up @@ -545,12 +545,6 @@ workflows:
- build
suite: itest-batch_deal
target: "./itests/batch_deal_test.go"
- test:
name: test-itest-ccupgrade
requires:
- build
suite: itest-ccupgrade
target: "./itests/ccupgrade_test.go"
- test:
name: test-itest-cli
requires:
Expand Down Expand Up @@ -876,12 +870,6 @@ workflows:
- build
suite: itest-remove_verifreg_datacap
target: "./itests/remove_verifreg_datacap_test.go"
- test:
name: test-itest-sdr_upgrade
requires:
- build
suite: itest-sdr_upgrade
target: "./itests/sdr_upgrade_test.go"
- test:
name: test-itest-sealing_resources
requires:
Expand All @@ -906,12 +894,6 @@ workflows:
- build
suite: itest-sector_import_simple
target: "./itests/sector_import_simple_test.go"
- test:
name: test-itest-sector_make_cc_avail
requires:
- build
suite: itest-sector_make_cc_avail
target: "./itests/sector_make_cc_avail_test.go"
- test:
name: test-itest-sector_miner_collateral
requires:
Expand All @@ -930,18 +912,6 @@ workflows:
- build
suite: itest-sector_pledge
target: "./itests/sector_pledge_test.go"
- test:
name: test-itest-sector_prefer_no_upgrade
requires:
- build
suite: itest-sector_prefer_no_upgrade
target: "./itests/sector_prefer_no_upgrade_test.go"
- test:
name: test-itest-sector_revert_available
requires:
- build
suite: itest-sector_revert_available
target: "./itests/sector_revert_available_test.go"
- test:
name: test-itest-sector_terminate
requires:
Expand All @@ -966,12 +936,6 @@ workflows:
- build
suite: itest-splitstore
target: "./itests/splitstore_test.go"
- test:
name: test-itest-tape
requires:
- build
suite: itest-tape
target: "./itests/tape_test.go"
- test:
name: test-itest-verifreg
requires:
Expand Down
7 changes: 3 additions & 4 deletions api/api_full.go
Original file line number Diff line number Diff line change
Expand Up @@ -21,15 +21,14 @@ import (
"github.com/filecoin-project/go-state-types/big"
"github.com/filecoin-project/go-state-types/builtin/v8/paych"
"github.com/filecoin-project/go-state-types/builtin/v9/market"
"github.com/filecoin-project/go-state-types/builtin/v9/miner"
verifregtypes "github.com/filecoin-project/go-state-types/builtin/v9/verifreg"
"github.com/filecoin-project/go-state-types/crypto"
"github.com/filecoin-project/go-state-types/dline"
abinetwork "github.com/filecoin-project/go-state-types/network"

apitypes "github.com/filecoin-project/lotus/api/types"
"github.com/filecoin-project/lotus/chain/actors/builtin"
lminer "github.com/filecoin-project/lotus/chain/actors/builtin/miner"
"github.com/filecoin-project/lotus/chain/actors/builtin/miner"
"github.com/filecoin-project/lotus/chain/actors/builtin/power"
"github.com/filecoin-project/lotus/chain/types"
"github.com/filecoin-project/lotus/chain/types/ethtypes"
Expand Down Expand Up @@ -499,9 +498,9 @@ type FullNode interface {
// expiration epoch
StateSectorGetInfo(context.Context, address.Address, abi.SectorNumber, types.TipSetKey) (*miner.SectorOnChainInfo, error) //perm:read
// StateSectorExpiration returns epoch at which given sector will expire
StateSectorExpiration(context.Context, address.Address, abi.SectorNumber, types.TipSetKey) (*lminer.SectorExpiration, error) //perm:read
StateSectorExpiration(context.Context, address.Address, abi.SectorNumber, types.TipSetKey) (*miner.SectorExpiration, error) //perm:read
// StateSectorPartition finds deadline/partition with the specified sector
StateSectorPartition(ctx context.Context, maddr address.Address, sectorNumber abi.SectorNumber, tok types.TipSetKey) (*lminer.SectorLocation, error) //perm:read
StateSectorPartition(ctx context.Context, maddr address.Address, sectorNumber abi.SectorNumber, tok types.TipSetKey) (*miner.SectorLocation, error) //perm:read
// StateSearchMsg looks back up to limit epochs in the chain for a message, and returns its receipt and the tipset where it was executed
//
// NOTE: If a replacing message is found on chain, this method will return
Expand Down
2 changes: 1 addition & 1 deletion api/api_gateway.go
Original file line number Diff line number Diff line change
Expand Up @@ -9,10 +9,10 @@ import (
"github.com/filecoin-project/go-address"
"github.com/filecoin-project/go-jsonrpc"
"github.com/filecoin-project/go-state-types/abi"
"github.com/filecoin-project/go-state-types/builtin/v9/miner"
"github.com/filecoin-project/go-state-types/dline"

apitypes "github.com/filecoin-project/lotus/api/types"
"github.com/filecoin-project/lotus/chain/actors/builtin/miner"
"github.com/filecoin-project/lotus/chain/types"
"github.com/filecoin-project/lotus/chain/types/ethtypes"
"github.com/filecoin-project/lotus/node/modules/dtypes"
Expand Down
7 changes: 6 additions & 1 deletion api/api_storage.go
Original file line number Diff line number Diff line change
Expand Up @@ -19,10 +19,10 @@ import (
"github.com/filecoin-project/go-state-types/abi"
"github.com/filecoin-project/go-state-types/big"
"github.com/filecoin-project/go-state-types/builtin/v9/market"
"github.com/filecoin-project/go-state-types/builtin/v9/miner"
abinetwork "github.com/filecoin-project/go-state-types/network"

builtinactors "github.com/filecoin-project/lotus/chain/actors/builtin"
"github.com/filecoin-project/lotus/chain/actors/builtin/miner"
"github.com/filecoin-project/lotus/chain/types"
"github.com/filecoin-project/lotus/storage/pipeline/sealiface"
"github.com/filecoin-project/lotus/storage/sealer/fsutil"
Expand Down Expand Up @@ -461,10 +461,15 @@ type SectorOffset struct {

// DealInfo is a tuple of deal identity and its schedule
type PieceDealInfo struct {
// "Old" builtin-market deal info
PublishCid *cid.Cid
DealID abi.DealID
DealProposal *market.DealProposal

// Common deal info
DealSchedule DealSchedule

// Best-effort deal asks
KeepUnsealed bool
}

Expand Down
15 changes: 7 additions & 8 deletions api/proxy_gen.go

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion api/types.go
Original file line number Diff line number Diff line change
Expand Up @@ -19,8 +19,8 @@ import (
datatransfer "github.com/filecoin-project/go-data-transfer/v2"
"github.com/filecoin-project/go-fil-markets/retrievalmarket"
"github.com/filecoin-project/go-state-types/abi"
"github.com/filecoin-project/go-state-types/builtin/v9/miner"

"github.com/filecoin-project/lotus/chain/actors/builtin/miner"
"github.com/filecoin-project/lotus/chain/types"
"github.com/filecoin-project/lotus/node/modules/dtypes"
)
Expand Down
7 changes: 3 additions & 4 deletions api/v0api/full.go
Original file line number Diff line number Diff line change
Expand Up @@ -15,15 +15,14 @@ import (
"github.com/filecoin-project/go-fil-markets/storagemarket"
"github.com/filecoin-project/go-state-types/abi"
"github.com/filecoin-project/go-state-types/builtin/v8/paych"
"github.com/filecoin-project/go-state-types/builtin/v9/miner"
verifregtypes "github.com/filecoin-project/go-state-types/builtin/v9/verifreg"
"github.com/filecoin-project/go-state-types/crypto"
"github.com/filecoin-project/go-state-types/dline"
abinetwork "github.com/filecoin-project/go-state-types/network"

"github.com/filecoin-project/lotus/api"
apitypes "github.com/filecoin-project/lotus/api/types"
lminer "github.com/filecoin-project/lotus/chain/actors/builtin/miner"
"github.com/filecoin-project/lotus/chain/actors/builtin/miner"
"github.com/filecoin-project/lotus/chain/types"
marketevents "github.com/filecoin-project/lotus/markets/loggers"
"github.com/filecoin-project/lotus/node/modules/dtypes"
Expand Down Expand Up @@ -450,9 +449,9 @@ type FullNode interface {
// expiration epoch
StateSectorGetInfo(context.Context, address.Address, abi.SectorNumber, types.TipSetKey) (*miner.SectorOnChainInfo, error) //perm:read
// StateSectorExpiration returns epoch at which given sector will expire
StateSectorExpiration(context.Context, address.Address, abi.SectorNumber, types.TipSetKey) (*lminer.SectorExpiration, error) //perm:read
StateSectorExpiration(context.Context, address.Address, abi.SectorNumber, types.TipSetKey) (*miner.SectorExpiration, error) //perm:read
// StateSectorPartition finds deadline/partition with the specified sector
StateSectorPartition(ctx context.Context, maddr address.Address, sectorNumber abi.SectorNumber, tok types.TipSetKey) (*lminer.SectorLocation, error) //perm:read
StateSectorPartition(ctx context.Context, maddr address.Address, sectorNumber abi.SectorNumber, tok types.TipSetKey) (*miner.SectorLocation, error) //perm:read
// StateSearchMsg searches for a message in the chain, and returns its receipt and the tipset where it was executed
//
// NOTE: If a replacing message is found on chain, this method will return
Expand Down
2 changes: 1 addition & 1 deletion api/v0api/gateway.go
Original file line number Diff line number Diff line change
Expand Up @@ -8,11 +8,11 @@ import (

"github.com/filecoin-project/go-address"
"github.com/filecoin-project/go-state-types/abi"
"github.com/filecoin-project/go-state-types/builtin/v9/miner"
"github.com/filecoin-project/go-state-types/dline"
abinetwork "github.com/filecoin-project/go-state-types/network"

"github.com/filecoin-project/lotus/api"
"github.com/filecoin-project/lotus/chain/actors/builtin/miner"
"github.com/filecoin-project/lotus/chain/types"
"github.com/filecoin-project/lotus/node/modules/dtypes"
)
Expand Down
15 changes: 7 additions & 8 deletions api/v0api/proxy_gen.go

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion api/v0api/v1_wrapper.go
Original file line number Diff line number Diff line change
Expand Up @@ -12,11 +12,11 @@ import (
"github.com/filecoin-project/go-fil-markets/storagemarket"
"github.com/filecoin-project/go-state-types/abi"
"github.com/filecoin-project/go-state-types/big"
"github.com/filecoin-project/go-state-types/builtin/v9/miner"
"github.com/filecoin-project/go-state-types/crypto"

"github.com/filecoin-project/lotus/api"
"github.com/filecoin-project/lotus/api/v1api"
"github.com/filecoin-project/lotus/chain/actors/builtin/miner"
"github.com/filecoin-project/lotus/chain/types"
marketevents "github.com/filecoin-project/lotus/markets/loggers"
)
Expand Down
Binary file modified build/actors/v12.tar.zst
Binary file not shown.
4 changes: 2 additions & 2 deletions build/bootstrap/butterflynet.pi
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
/dns4/bootstrap-0.butterfly.fildev.network/tcp/1347/p2p/12D3KooWD5mtdmjHQ1Puj9Md7SEfoa7kWMpwqUhAKsyYsBP56LQC
/dns4/bootstrap-1.butterfly.fildev.network/tcp/1347/p2p/12D3KooWEoYPkm6o87ES6AppFY7d7WHJUQg7XVPRAyQZjEU31efQ
/dns4/bootstrap-0.butterfly.fildev.network/tcp/1347/p2p/12D3KooWMH8fFcfL6K7dwRo2wqa4UjdM5pxg9DAnoWPrVRx4Dioj
/dns4/bootstrap-1.butterfly.fildev.network/tcp/1347/p2p/12D3KooWArCrw1TLyJ5r37pYvHgv9kkXNC8tu2t1Sx7hyoCHpRje
Loading