Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parse indexed deals for data segment index #1495

Merged
merged 131 commits into from
Oct 9, 2023

Commits on Mar 21, 2023

  1. feat: add local index directory

    Internally this is still refered to as the piece directory
    
    Co-authored-by: dirkmc <[email protected]>
    Co-authored-by: Anton Evangelatov <[email protected]>
    3 people committed Mar 21, 2023
    Configuration menu
    Copy the full SHA
    7b745c3 View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2023

  1. Configuration menu
    Copy the full SHA
    2172161 View commit details
    Browse the repository at this point in the history

Commits on Apr 13, 2023

  1. merge: main to lid (#1370)

    * add free check (#1315)
    
    * chore: bump version to 1.6.1 (#1317)
    
    * fix legacy deal verified status (#1324)
    
    * fix: update go-unixfsnode enough to make sure unixfs-preload is available (#1323)
    
    * release v1.6.2-rc1 (#1328)
    
    * use full path (#1330)
    
    * fix bug (#1332)
    
    * use forks of graphsync, go-data-transfer and go-fil-markets (#1333)
    
    * refactor: use forks of graphsync, go-data-transfer and go-fil-markets
    
    * refactor: convert from data transfer v1 to v2 voucher type
    
    * fix: index provider validation voucher type
    
    * fix: pass index provider engine link system through to graphsync's transport configurer
    
    * feat: use tagged version of boost-gfm
    
    * fix: retrieval client imports
    
    * feat: tagged version of lotus
    
    * feat: require go 1.19
    
    * lint: fix lint errors
    
    * fix: itests
    
    * fix: cbor-gen, docsgen
    
    * fix: update CI lint version
    
    * fix: lint
    
    * fix: docgen
    
    * fix: go mod tidy
    
    * fix: protocol proxy TestOutboundForwarding
    
    * fix: docsgen
    
    * fix: update filecoin-ffi submodule
    
    * fix: prometheus duplicate register panic
    
    * fix: cleanup imports
    
    * fix: legs voucher processing
    
    * chore: release v1.6.2-rc2 (#1340)
    
    * release v1.6.2-rc2
    
    * fix test
    
    * fix: flaky TestLibp2pCarServerNewTransferCancelsPreviousTransfer (#1350)
    
    * fix: flaky TestDealCompletionOnProcessResumption (#1351)
    
    * fix: occasional panic on shutdown (#1353)
    
    * feat: query UI (#1352)
    
    * log insert
    
    * fix display error
    
    * refactor code
    
    * shorten status strings
    
    * remove comment
    
    * apply suggestion
    
    * feat: add download block link to inspect page (#1312)
    
    * fix(devnet): update golang and lotus default versions (#1354)
    
    * fix(devnet): bump golang to 1.19
    
    * chore(devnet): bump lotus default version
    
    * chore(devnet): remove unused stable env
    
    * booster-http: implement IPFS HTTP gateway (#1225)
    
    * feat: implement http api gateway
    
    * feat: use go-libipfs lib (instead of copying to extern)
    
    * feat: bump booster-bitswap info minor version
    
    * feat: http gateway metrics
    
    * fix: TestHttpInfo
    
    * feat: by default only serve blocks and CARs, with option to serve original files (jpg, mov etc)
    
    * fix: correct link for download root block (#1355)
    
    * feat: option to cleanup data for offline deals after add piece (#1341)
    
    * chore: add support for multiple node.js versions in makefile (#1356)
    
    * chore: release v.1.7.0-rc1 (#1357)
    
    * release v.1.7.0-rc1
    
    * fix version
    
    * fix: dagstore initialize-all parameter (#1363)
    
    * fix: show verifying commp state for offline deals (#1364)
    
    * fix: boost run missing staging-area dir (#1368)
    
    * merge(wip): main to lid
    
    TODO: remoteblockstore needs to handle nil metrics
    
    * fix: flaky TestNewHttpServer (#1372)
    
    * feat: group agent version by binary name (#1369)
    
    * fix: wrap stats in nil checks for now
    
    we should probably revisit how stats are handled now that we have all 3 transports being tracked
    
    * test(fix): incorrect test urls
    
    ---------
    
    Co-authored-by: LexLuthr <[email protected]>
    Co-authored-by: Rod Vagg <[email protected]>
    Co-authored-by: dirkmc <[email protected]>
    4 people authored Apr 13, 2023
    Configuration menu
    Copy the full SHA
    d9923e6 View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2023

  1. fix: make devnet work for lid (#1375)

    * feat: support full addr config in boostd-data
    
    * chore: fix linting for boostd-data
    
    * feat: use addr instead of port for lid
    
    chore: update devnet to work with lid setup
    
    * chore: resolve feedback on lint changes
    jacobheun authored Apr 15, 2023
    Configuration menu
    Copy the full SHA
    2606bb0 View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2023

  1. Configuration menu
    Copy the full SHA
    caf39ac View commit details
    Browse the repository at this point in the history
  2. feat: fail deal if start epoch passed (#1319)

    * fail deal if start epoch passed
    
    * add suggestion
    
    * test: add deal expiry on startup test
    
    ---------
    
    Co-authored-by: Dirk McCormick <[email protected]>
    2 people authored and jacobheun committed Apr 16, 2023
    Configuration menu
    Copy the full SHA
    55a719c View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2023

  1. Configuration menu
    Copy the full SHA
    c451816 View commit details
    Browse the repository at this point in the history
  2. fix: makefile

    jacobheun committed Apr 17, 2023
    Configuration menu
    Copy the full SHA
    624f3ea View commit details
    Browse the repository at this point in the history
  3. fix: db migration ordering

    jacobheun committed Apr 17, 2023
    Configuration menu
    Copy the full SHA
    1e4fa15 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    c48a8fa View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2023

  1. Configuration menu
    Copy the full SHA
    80dcdc9 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2023

  1. fix: prevent accidental removal of valid sector index announcements

    fix: add cache tests and dont announce cache state
    fix: add unique index to sector state db
    fix: sealed and unsealed sector state conflict
    fix: ensure index provider wrapper starts after db migration has completed
    jacobheun committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    0a72cc7 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6d50bcf View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2023

  1. Configuration menu
    Copy the full SHA
    2bb534a View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2023

  1. chore: go mod tidy

    jacobheun committed Apr 28, 2023
    Configuration menu
    Copy the full SHA
    3d54850 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    a4fdb4d View commit details
    Browse the repository at this point in the history

Commits on May 9, 2023

  1. fix: download block (#1440)

    dirkmc authored May 9, 2023
    Configuration menu
    Copy the full SHA
    dac04ee View commit details
    Browse the repository at this point in the history

Commits on May 10, 2023

  1. LID yugabyte db impl (#1391)

    * feat: yugabyte db impl
    
    * feat: run yugabyte tests against a dockerized yugabyte
    
    * fix: use out own yugabyte docker image
    
    * fix: use yugabyte 2.17.2.0 docker image
    
    * feat: piece doctor yugabyte impl
    
    * fix: go mod tidy
    
    * refactor: remove SetCarSize as its not longer being used
    
    * refactor: remove functionality to mark index as errored (not being used)
    
    * feat: implement delete commands
    
    * refactor: consolidate test params
    
    * feat: add lid yugabyte config
    
    * fix: port map yugabyte postgres to standard port
    
    * Fix yugabyte CI (#1433)
    
    * fix: yugabyte tests in CI
    
    * docker-compose.yml ; Dockerfile.test ; connect to `yugabyte` and not localhost
    
    * add tag
    
    * test lid
    
    * make gen
    
    * fixup
    
    * move couchbase settings under build tag
    
    ---------
    
    Co-authored-by: Anton Evangelatov <[email protected]>
    
    ---------
    
    Co-authored-by: Anton Evangelatov <[email protected]>
    dirkmc and nonsense authored May 10, 2023
    Configuration menu
    Copy the full SHA
    f5de340 View commit details
    Browse the repository at this point in the history

Commits on May 12, 2023

  1. script to migrate from couchbase to yugabyte (#1445)

    * feat: script to migrate from couchbase to yugabyte
    
    * fix: reduce batch size for yugabyte inserts
    dirkmc authored May 12, 2023
    Configuration menu
    Copy the full SHA
    aeb34d3 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    1316ee5 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2023

  1. Change service GetIndex / AddIndex to return channel instead of array (

    …#1444)
    
    * feat: yugabyte db impl
    
    * feat: run yugabyte tests against a dockerized yugabyte
    
    * fix: use out own yugabyte docker image
    
    * fix: use yugabyte 2.17.2.0 docker image
    
    * feat: piece doctor yugabyte impl
    
    * fix: go mod tidy
    
    * refactor: remove SetCarSize as its not longer being used
    
    * refactor: remove functionality to mark index as errored (not being used)
    
    * feat: implement delete commands
    
    * refactor: consolidate test params
    
    * feat: add lid yugabyte config
    
    * fix: port map yugabyte postgres to standard port
    
    * Fix yugabyte CI (#1433)
    
    * fix: yugabyte tests in CI
    
    * docker-compose.yml ; Dockerfile.test ; connect to `yugabyte` and not localhost
    
    * add tag
    
    * test lid
    
    * make gen
    
    * fixup
    
    * move couchbase settings under build tag
    
    ---------
    
    Co-authored-by: Anton Evangelatov <[email protected]>
    
    * wip: service GetIndex returns channel of records instead of array
    
    * feat: return channel from AddIndex and GetIndex
    
    ---------
    
    Co-authored-by: Anton Evangelatov <[email protected]>
    dirkmc and nonsense authored May 17, 2023
    Configuration menu
    Copy the full SHA
    2b4de7c View commit details
    Browse the repository at this point in the history

Commits on May 19, 2023

  1. local index directory: recover tool (#1410)

    * initial disaster recovery tool for LID
    
    * wip
    
    * do not block on individual error
    
    * instantiate lid
    
    * report
    
    * catch signal
    
    * fixup
    
    * comment out sector already in progress
    
    * fixup
    
    * start containers with init: true
    
    * record that we dont have an unsealed copy
    
    * match deals with boost sqlite db and piece store
    
    * fixup
    
    * fixup
    
    * use logger
    
    * fixup
    
    * disable stacktrace
    
    * fixup
    
    * extract piece store away from disaster recovery struct
    
    * add more sanity checks
    
    * compare IsUnsealed vs storage find
    
    * improve safeIsUnseal
    
    * fixup
    
    * better logs
    
    * expand repodir
    
    * calc properly next offset
    
    * fixup
    
    * add sector id to logs
    
    * incr offset
    
    * break after finding expired deal
    
    * more logs
    
    * fewer logs
    
    * better logs
    
    * better error
    
    * refactor
    
    * refactor minerApi
    
    * better logs
    
    * add time around add index
    
    * pd.Start
    nonsense authored May 19, 2023
    Configuration menu
    Copy the full SHA
    3dc7e5a View commit details
    Browse the repository at this point in the history
  2. LID benchmarking tool (#1276)

    * feat: LID benchmarking tool
    
    * fix: bench thread safety
    
    * refactor: structured logging
    
    * refactor: postgres bulk insert
    
    * lid bench: Add foundationdb impl
    
    * lid fdb: Fix Tx sizing, parallel chunk puts
    
    * lid fdb: More efficient sample generation
    
    * feat: array of piece count / blocks per piece (#1314)
    
    * lid bench: print add rate
    
    * lid bench: Add retry to postgres put (#1316)
    
    * lid bench: Make cassandra put much more robust (#1318)
    
    * instrumentation for bench tool (#1337)
    
    * instrument postgres
    
    * more instrumentation
    
    * check for err getoffsetsize
    
    * emit metrics every 10sec
    
    * ignore errors
    
    * add postgres-drop
    
    * use directly tables
    
    * fix: go mod tidy
    
    * use INSERT INTO instead of tmp tables
    
    * try to catch sig
    
    * remove transaction commit
    
    * fixup
    
    * add postgres-init
    
    * fixuop
    
    * split create and init
    
    * fixup
    
    * remove if not exist
    
    ---------
    
    Co-authored-by: Dirk McCormick <[email protected]>
    
    * feat: batch insert queries for postgres
    
    * feat: add flag to insert into postgres using tmp table
    
    * refactor: merge changes from nonsense/lid-bench
    
    * refactor: just use one database (dont create bench database)
    
    * refactor: remove unused params
    
    * refactor: command structure
    
    * fix: cassandra - dont use batch insert for PayloadToPieces
    
    * fix: create tables CQL
    
    * fix: increase payload to pieces insert parallelism
    
    * fix: use simple replication strategy
    
    * feat: use yugabyte cassandra driver
    
    * fix: remove bench binary
    
    * update metrics endpoint
    
    * fix random generated piece cid
    
    * fixup
    
    * fix: cassandra bitswap benchmark
    
    * remove foundationdb
    
    ---------
    
    Co-authored-by: Łukasz Magiera <[email protected]>
    Co-authored-by: Łukasz Magiera <[email protected]>
    Co-authored-by: Anton Evangelatov <[email protected]>
    4 people authored May 19, 2023
    Configuration menu
    Copy the full SHA
    4ef9a56 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    a80b6e3 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    e61fd62 View commit details
    Browse the repository at this point in the history

Commits on May 22, 2023

  1. more logs

    nonsense committed May 22, 2023
    Configuration menu
    Copy the full SHA
    93e3346 View commit details
    Browse the repository at this point in the history

Commits on Jun 1, 2023

  1. piece doctor and sector state manager refactor (#1463)

    * fix timer.Reset and improve logs
    
    * revert randomization
    
    * piece doc: handle errors
    
    * adjust piece check
    
    * refactor unsealsectormanager
    
    * refactor piece doctor
    
    * add random ports
    
    * ignore tests
    
    * add version to boostd-data
    
    * fix ctx in Start
    
    * fix: add reader mock to fix tests
    
    * fix: pass new piece directory to provider on test restart
    
    * fix synchronisation
    
    * note that panics are not propagated in tests
    
    * carv1 panics piece directory
    
    * print panics
    
    * fix: use reader that supports Seek in piece reader mock
    
    * fix: reset mock car reader on each invocation
    
    * fix: TestOfflineDealDataCleanup
    
    * add check for nil cancel func
    
    * bump min check period for LevelDB to 5 minutes
    
    * check if sector state mgr is initialised
    
    * debug line for unflagging
    
    * commenting out TestMultipleDealsConcurrent -- flaky test -- works locally
    
    * add SectorStateUpdates pubsub
    
    * add close for pubsub
    
    * add mock sectorstatemgr
    
    * add wrapper tests
    
    * fixup
    
    * cleanup
    
    * cleanup
    
    * better names
    
    * t.Skip for test
    
    * remove TODO above println for panic
    
    * add unit tests for refreshState
    
    * rename tests
    
    * more cases
    
    * more tests
    
    * update description
    
    * better comment
    
    * better names and comments
    
    ---------
    
    Co-authored-by: Dirk McCormick <[email protected]>
    nonsense and dirkmc authored Jun 1, 2023
    Configuration menu
    Copy the full SHA
    5fe0bfd View commit details
    Browse the repository at this point in the history
  2. Merge from main to lid branch (#1483)

    * fix statx output string (#1451)
    
    * fix: flaky TestMultipleDealsConcurrent (#1458)
    
    * Add option to serve index provider ads over http (#1452)
    
    * feat: option to serve index provider ads over http
    
    * fix: config naming, hostname parsing
    
    * fix: update docsgen
    
    * fix: log announce address
    
    * feat: add config for indexer direct announce urls
    
    * refactor: always announce over pubsub
    
    * fix: docsgen
    
    * test: add test case for empty announce address hostname
    
    * Add `boostd index announce-latest` command (#1456)
    
    * feat: boostd index announce-latest
    
    * feat: add announce-latest-http command
    
    * fix: default direct announce url
    
    * feat: update to index-provider v0.11.2
    
    * Signal to index provider to skip announcements (#1457)
    
    * fix: signal to index provider to skip announcements
    
    * fix: ensure multihash lister skip error is of type ipld.ErrNotExists
    
    ---------
    
    Co-authored-by: LexLuthr <[email protected]>
    
    * release v1.7.3-rc2 (#1460)
    
    * fix: improve stalled retrieval cancellation (#1449)
    
    * refactor stalled retrieval cancel
    
    * add ctx with timeout
    
    * implement suggestions
    
    * update err wrapping
    
    * fix: set short cancel timeout for unpaid retrievals only
    
    ---------
    
    Co-authored-by: Dirk McCormick <[email protected]>
    
    * feat: enable listen address for booster-http (#1461)
    
    * enable listen address
    
    * modify tests
    
    * fix nil ptr (#1470)
    
    * fix: incorrect check when import offline deal data using proposal CID (#1473)
    
    * fix incorrect early check
    
    * update error msg
    
    * fix(server): properly cancel graphsync requests (#1475)
    
    * set UI default listen address to localhost (#1476)
    
    * feat: display msg params in the mpool UI (#1471)
    
    * show msg params
    
    * fix: mpool nil pointer
    
    * fix width
    
    ---------
    
    Co-authored-by: Dirk McCormick <[email protected]>
    
    * Reset read deadline after reading deal proposal message (#1479)
    
    * fix: reset read deadline after reading deal proposal message
    
    * fix: increase client request deadline
    
    * feat: Show elapsed epoch and PSD wait epochs in UI (#1480)
    
    * show epochs
    
    * fix devnet UI, use BlockdDelaySecs
    
    * fix lint err
    
    * Update gql/resolver.go
    
    Co-authored-by: dirkmc <[email protected]>
    
    ---------
    
    Co-authored-by: dirkmc <[email protected]>
    
    * release v1.7.3-rc3 (#1481)
    
    ---------
    
    Co-authored-by: LexLuthr <[email protected]>
    Co-authored-by: LexLuthr <[email protected]>
    Co-authored-by: Hannah Howard <[email protected]>
    4 people authored Jun 1, 2023
    Configuration menu
    Copy the full SHA
    5e511a8 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2023

  1. update local index directory ui (#1477)

    * feat: update local index directory ui
    
    * comment out wrench as docker doesnt build
    
    * rearrange menu
    
    * refactor: remove sectors list
    
    ---------
    
    Co-authored-by: Anton Evangelatov <[email protected]>
    dirkmc and nonsense authored Jun 5, 2023
    Configuration menu
    Copy the full SHA
    a614b3d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    a071a03 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    a9953ff View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2023

  1. Configuration menu
    Copy the full SHA
    a5340e9 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2023

  1. Configuration menu
    Copy the full SHA
    815ddea View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    3f79cda View commit details
    Browse the repository at this point in the history
  3. GraphQL resolvers for LID (#1494)

    * wip
    
    * rename
    
    * sectorUnsealedCopies and SectorProvingState
    nonsense authored Jun 7, 2023
    Configuration menu
    Copy the full SHA
    4e14ce0 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    b8626da View commit details
    Browse the repository at this point in the history

Commits on Jun 8, 2023

  1. Configuration menu
    Copy the full SHA
    f71b0ff View commit details
    Browse the repository at this point in the history
  2. more logs

    nonsense committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    3d64fb6 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    5d2b6ff View commit details
    Browse the repository at this point in the history
  4. check that sector has deals for unsealed sectors (#1502)

    * check that sector has deals for unsealed sectors
    
    * simplify
    nonsense authored Jun 8, 2023
    Configuration menu
    Copy the full SHA
    c4e0b01 View commit details
    Browse the repository at this point in the history
  5. rename heading

    nonsense committed Jun 8, 2023
    Configuration menu
    Copy the full SHA
    54edf11 View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2023

  1. piece doctor to ignore expired/slashed deals (#1503)

    * ignore expired/slashed deals
    
    * fix mocks
    
    * add timer for checkPiece
    
    * move ChainHead away from checkPiece
    
    * add nil check for fullnodeApi
    
    * add debug line
    nonsense authored Jun 9, 2023
    Configuration menu
    Copy the full SHA
    e9e236d View commit details
    Browse the repository at this point in the history
  2. fix pagination

    nonsense committed Jun 9, 2023
    Configuration menu
    Copy the full SHA
    4000480 View commit details
    Browse the repository at this point in the history
  3. LID landing page: add stats around Flagged and non-Flagged pieces (#1508

    )
    
    * wip
    
    * fixup
    
    * add debug line
    
    * fixup
    nonsense authored Jun 9, 2023
    Configuration menu
    Copy the full SHA
    969f934 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    a5d29f0 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    4ee35f1 View commit details
    Browse the repository at this point in the history

Commits on Jun 12, 2023

  1. Configuration menu
    Copy the full SHA
    2ea1ed9 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    aaf67ec View commit details
    Browse the repository at this point in the history
  3. Merge branch 'main' into nonsense/piece-store

    LexLuthr committed Jun 12, 2023
    Configuration menu
    Copy the full SHA
    b2bf8ce View commit details
    Browse the repository at this point in the history
  4. update ffi

    LexLuthr committed Jun 12, 2023
    Configuration menu
    Copy the full SHA
    f73cf3d View commit details
    Browse the repository at this point in the history
  5. fix main merge issue

    LexLuthr committed Jun 12, 2023
    Configuration menu
    Copy the full SHA
    5caa93b View commit details
    Browse the repository at this point in the history
  6. fix go mod

    LexLuthr committed Jun 12, 2023
    Configuration menu
    Copy the full SHA
    cdc40ec View commit details
    Browse the repository at this point in the history
  7. Add info boxes on LID UI page (#1516)

    * feat: add info boxes on LID UI page
    
    * Update react/src/LID.js
    
    Co-authored-by: Anton Evangelatov <[email protected]>
    
    * Update react/src/LID.js
    
    Co-authored-by: Anton Evangelatov <[email protected]>
    
    ---------
    
    Co-authored-by: Anton Evangelatov <[email protected]>
    dirkmc and nonsense authored Jun 12, 2023
    Configuration menu
    Copy the full SHA
    1edb02e View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2023

  1. Configuration menu
    Copy the full SHA
    b256c2e View commit details
    Browse the repository at this point in the history
  2. remove redundant makefile (#1519)

    * remove redundant makefile
    
    * add migrate-lid to Makefile
    
    * update gitignore
    
    * move booster-bitswap and booster-http to make and make install
    nonsense authored Jun 13, 2023
    Configuration menu
    Copy the full SHA
    966a385 View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2023

  1. Configuration menu
    Copy the full SHA
    2a7ed2c View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0859578 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    7ef2aa8 View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2023

  1. feat: add send epoch, time, elapsed epoch and elapsed time for each m…

    …essage in mpool to UI (#1523)
    
    * add message epoch/time details
    
    * implement suggestion
    
    * use moment lib
    
    * fix alerting bug
    
    * update polling interval
    LexLuthr authored Jun 15, 2023
    Configuration menu
    Copy the full SHA
    33ba7de View commit details
    Browse the repository at this point in the history
  2. add logs

    nonsense committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    8a34ce9 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    55c086b View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2023

  1. feat: make legacy deals optional (#1524)

    * make legacy deals optional
    
    * fix gen
    
    * modify itests, create new
    
    * handle legacy stream explicitly
    
    * separate out the protocols
    
    * fix lint error
    
    * enable itest in CI
    
    * fix ci
    
    * apply suggestions
    
    * fix error after conflict resolution
    
    * refactor: simplify legacy deal response code
    
    ---------
    
    Co-authored-by: Dirk McCormick <[email protected]>
    LexLuthr and dirkmc authored Jun 20, 2023
    Configuration menu
    Copy the full SHA
    6b9ffed View commit details
    Browse the repository at this point in the history

Commits on Jun 23, 2023

  1. Configuration menu
    Copy the full SHA
    248dae4 View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2023

  1. Update lotus and boxo versions (#1466) (#1537)

    * Update to use packages in go-libipni
    
    * feat: update lotus version
    
    * update boxo (#1492)
    
    * feat: update boxo
    
    * refactor: depend on repo:Jorropo/lotus branch:boxo2
    
    * chore: temporarily update go-fil-markets with replace directive
    
    * feat: switch itests framework ExtractFileFromCAR to use non-global IPLD registry
    
    * feat: switch booster-bitswap client fetch to use the go-ipld-prime globals via go-ipld-legacy
    
    * go fmt
    
    * chore: update dependencies and migrate to boxo
    
    * fix: update boost-gfm
    
    * fix: stop itests framework from prematurely setting listenaddrs via go-libp2p defaults that conflict with lotus
    
    * fix: docs gen
    
    * chore(deps): update deps for boxo v0.10.0
    
    * chore(deps): update boost-gfm
    
    * fix(booster-http): update for boxo v0.10.0
    
    * chore(deps): update to remove kubo dependency
    
    * fix(gen): update docs gen
    
    * feat: update boost-gfm to v1.26.6
    
    * chore(deps): update lotus to master
    
    ---------
    
    
    
    
    ---------
    
    Co-authored-by: gammazero <[email protected]>
    Co-authored-by: Adin Schmahmann <[email protected]>
    Co-authored-by: hannahhoward <[email protected]>
    4 people authored Jun 26, 2023
    Configuration menu
    Copy the full SHA
    f1cec09 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    d2a7df9 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2023

  1. Configuration menu
    Copy the full SHA
    6d812ee View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2023

  1. Configuration menu
    Copy the full SHA
    ecbc081 View commit details
    Browse the repository at this point in the history
  2. feat: http index announcements (#1418)

    * feat(indexprovider): announce http transport
    
    refactor: isolate extended provider logic
    
    feat: announce http indexes
    
    refactor(indexprovider): use metadata.Default
    
    fix(wrapper): fix compile error
    
    * fix http ep signing bug
    
    * update comment
    
    ---------
    
    Co-authored-by: LexLuthr <[email protected]>
    jacobheun and LexLuthr authored Jun 28, 2023
    Configuration menu
    Copy the full SHA
    01e731c View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2023

  1. Configuration menu
    Copy the full SHA
    7263642 View commit details
    Browse the repository at this point in the history
  2. fix: metrics and Grafana (#1546)

    * fix grafna, metrics
    
    * remove dagstore from name
    LexLuthr authored Jun 30, 2023
    Configuration menu
    Copy the full SHA
    14a454d View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2023

  1. Configuration menu
    Copy the full SHA
    7409f90 View commit details
    Browse the repository at this point in the history
  2. fix: iterate all deals to index piece (#1549)

    * fix: iterate all deals to index piece
    
    * add test, use multierror
    
    * add and update comments
    LexLuthr authored Jul 3, 2023
    Configuration menu
    Copy the full SHA
    16c6310 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    497472d View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2023

  1. Parse indexed deals for data segment index

    this makes boost aware of the format in
    https://github.com/filecoin-project/go-data-segment/
    for new deals.
    
    this is the same logic as in filecoin-project/lotus#10674
    willscott committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    d3a1ed8 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    9c16ad7 View commit details
    Browse the repository at this point in the history
  3. fix compile issues in test

    willscott committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    4f1ba10 View commit details
    Browse the repository at this point in the history
  4. test passes

    willscott committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    71ef781 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    81a7402 View commit details
    Browse the repository at this point in the history
  6. code review

    willscott committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    a962a0c View commit details
    Browse the repository at this point in the history
  7. remaining test fix

    willscott committed Jul 5, 2023
    Configuration menu
    Copy the full SHA
    54ecf30 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    0ea3f5b View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    ca5f395 View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2023

  1. feat: refactor mpool page in UI (#1530)

    * modify GQL
    
    * fix count type
    
    * fix locks
    
    * fix js
    LexLuthr authored Jul 7, 2023
    Configuration menu
    Copy the full SHA
    5d903fa View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2023

  1. migrate config to v5 (#1560)

    * migrate config to v5
    
    * change default version
    LexLuthr authored Jul 11, 2023
    Configuration menu
    Copy the full SHA
    540b41b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f69945e View commit details
    Browse the repository at this point in the history
  3. Upgrade to index-provider v0.13.4 (#1559)

    Upgrade to the latest index-provider library.
    masih authored Jul 11, 2023
    Configuration menu
    Copy the full SHA
    01a5a35 View commit details
    Browse the repository at this point in the history

Commits on Jul 12, 2023

  1. itest for data segment

    LexLuthr committed Jul 12, 2023
    Configuration menu
    Copy the full SHA
    7a562af View commit details
    Browse the repository at this point in the history
  2. enable test in circleCI

    LexLuthr committed Jul 12, 2023
    Configuration menu
    Copy the full SHA
    b299944 View commit details
    Browse the repository at this point in the history
  3. feat: add IPNI itest (#1563)

    * ipni itest
    
    * refactor test
    
    * add to circleCI
    
    * add indexer topic
    
    * Print protocol IDs exposed by f.Boost
    
    * generate topic name dynamically
    
    ---------
    
    Co-authored-by: Masih H. Derkani <[email protected]>
    LexLuthr and masih authored Jul 12, 2023
    Configuration menu
    Copy the full SHA
    d715f70 View commit details
    Browse the repository at this point in the history
  4. fix file comparison

    LexLuthr committed Jul 12, 2023
    Configuration menu
    Copy the full SHA
    06db936 View commit details
    Browse the repository at this point in the history
  5. Add test for second segment

    willscott committed Jul 12, 2023
    Configuration menu
    Copy the full SHA
    033a625 View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2023

  1. IPNI UX (#1562)

    * feat: IPNI UX
    
    * Update react/src/Ipni.js
    
    Co-authored-by: LexLuthr <[email protected]>
    
    * feat: server side config
    
    ---------
    
    Co-authored-by: LexLuthr <[email protected]>
    dirkmc and LexLuthr authored Jul 13, 2023
    Configuration menu
    Copy the full SHA
    6e858b9 View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2023

  1. Configuration menu
    Copy the full SHA
    d250610 View commit details
    Browse the repository at this point in the history
  2. fix itest to use carv1

    LexLuthr committed Jul 18, 2023
    Configuration menu
    Copy the full SHA
    118c8da View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    fea635e View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2023

  1. change itest to use 1.5 mb file

    LexLuthr committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    b468a62 View commit details
    Browse the repository at this point in the history
  2. use fixtures

    LexLuthr committed Jul 19, 2023
    Configuration menu
    Copy the full SHA
    ec92dc4 View commit details
    Browse the repository at this point in the history

Commits on Jul 28, 2023

  1. Configuration menu
    Copy the full SHA
    b019c49 View commit details
    Browse the repository at this point in the history
  2. use fixture.dat generated by Will

    LexLuthr committed Jul 28, 2023
    Configuration menu
    Copy the full SHA
    3037b01 View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2023

  1. Remove carv1/carv2 specific semantics from commP calculations

    The commp should be directly over the bytes of the deal, it shouldn't care about car format.
    willscott committed Aug 28, 2023
    Configuration menu
    Copy the full SHA
    eee1602 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2023

  1. fail on empty files

    willscott committed Aug 29, 2023
    Configuration menu
    Copy the full SHA
    d6483cd View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    9b6f043 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    e571e73 View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2023

  1. Configuration menu
    Copy the full SHA
    0f0a69d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f8870c6 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    45140eb View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2023

  1. additional logging

    willscott committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    4544782 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    692c8c5 View commit details
    Browse the repository at this point in the history
  3. try other direction

    willscott committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    88590c0 View commit details
    Browse the repository at this point in the history
  4. remove debugging

    willscott committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    17a7e36 View commit details
    Browse the repository at this point in the history
  5. replay on get errors

    willscott committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    fa04473 View commit details
    Browse the repository at this point in the history
  6. lint

    willscott committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    109e198 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    c476231 View commit details
    Browse the repository at this point in the history
  8. offbyone

    willscott committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    ec82cf2 View commit details
    Browse the repository at this point in the history
  9. print buffer of object

    willscott committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    2f8eb7c View commit details
    Browse the repository at this point in the history
  10. Configuration menu
    Copy the full SHA
    51bc49f View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2023

  1. fix: use fixed car BlockReader#SkipNext SourceOffset (#1659)

    * fix: use fixed car BlockReader#SkipNext SourceOffset
    
    Ref: ipld/go-car#491
    
    * chore: regenerate cbor-gen types w/ cbor-gen update
    rvagg authored Sep 1, 2023
    Configuration menu
    Copy the full SHA
    362a7f6 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    ccb2738 View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2023

  1. Configuration menu
    Copy the full SHA
    9eaa397 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    17ac359 View commit details
    Browse the repository at this point in the history
  3. fix compilation errors

    willscott committed Sep 11, 2023
    Configuration menu
    Copy the full SHA
    41ee07f View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2023

  1. feat: add corshandler to IPFS gateway (#1589)

    * add corshandler to IPFS gateway
    
    * use cors lib
    
    * go mod tidy
    
    * refactor test, remove extra cors
    LexLuthr authored and willscott committed Sep 12, 2023
    Configuration menu
    Copy the full SHA
    64bd9c3 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    338913e View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2023

  1. Configuration menu
    Copy the full SHA
    e3b5841 View commit details
    Browse the repository at this point in the history
  2. fix: make test work

    rvagg committed Sep 13, 2023
    Configuration menu
    Copy the full SHA
    5932ce7 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2023

  1. Configuration menu
    Copy the full SHA
    1aa0497 View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2023

  1. Configuration menu
    Copy the full SHA
    019c735 View commit details
    Browse the repository at this point in the history
  2. Merge branch 'piecedirectory/segmentindex' of github.com:filecoin-pro…

    …ject/boost into piecedirectory/segmentindex
    willscott committed Oct 4, 2023
    Configuration menu
    Copy the full SHA
    036d41a View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2023

  1. Configuration menu
    Copy the full SHA
    0693db8 View commit details
    Browse the repository at this point in the history

Commits on Oct 9, 2023

  1. Configuration menu
    Copy the full SHA
    8ff8f15 View commit details
    Browse the repository at this point in the history
  2. use expected ffi

    willscott committed Oct 9, 2023
    Configuration menu
    Copy the full SHA
    a5c1ec2 View commit details
    Browse the repository at this point in the history