Hot on the heels of 0.5.0 is 0.5.1 with some important but small bug fixes. This release:
- Removes the 1 minute timeout for IPNS publishes (fixes #7244).
- Backport a DHT fix to reduce CPU usage for canceled requests.
- Fixes some timer leaks in the QUIC transport (ipfs/go-ipfs#2515).
- github.com/ipfs/go-ipfs:
- IPNS timeout patch from master (ipfs/go-ipfs#7276)
- github.com/libp2p/go-libp2p-core (v0.5.2 -> v0.5.3):
- feat: add a function to tell if a context subscribes to query events (libp2p/go-libp2p-core#147)
- github.com/libp2p/go-libp2p-kad-dht (v0.7.10 -> v0.7.11):
- fix: optimize for the case where we're not subscribing to query events (libp2p/go-libp2p-kad-dht#624)
- fix: don't spin when the event channel is closed (libp2p/go-libp2p-kad-dht#622)
- github.com/libp2p/go-libp2p-routing-helpers (v0.2.2 -> v0.2.3):
- fix: avoid subscribing to query events unless necessary (libp2p/go-libp2p-routing-helpers#43)
- github.com/lucas-clemente/quic-go (v0.15.5 -> v0.15.7):
- reset the PTO when dropping a packet number space
- move deadlineTimer declaration out of the Read loop
- stop the deadline timer in Stream.Read and Write
- fix buffer use after it was released when sending an INVALID_TOKEN error
- create the session timer at the beginning of the run loop
- stop the timer when the session's run loop returns
Contributor | Commits | Lines ± | Files Changed |
---|---|---|---|
Marten Seemann | 10 | +81/-62 | 19 |
Steven Allen | 5 | +42/-18 | 10 |
Adin Schmahmann | 1 | +2/-8 | 1 |
dependabot-preview[bot] | 2 | +6/-2 | 4 |
We're excited to announce go-ipfs 0.5.0! This is by far the largest go-ipfs release with ~2500 commits, 98 contributors, and over 650 PRs across ipfs, libp2p, and multiformats.
The primary focus of this release was on improving content routing. That is, advertising and finding content. To that end, this release heavily focuses on improving the DHT.
The distributed hash table (DHT) is how IPFS nodes keep track of who has what data. The DHT implementation has been almost completely rewritten in this release. Providing, finding content, and resolving IPNS records are now all much faster. However, there are risks involved with this update due to the significant amount of changes that have gone into this feature.
The current DHT suffers from three core issues addressed in this release:
- Most peers in the DHT cannot be dialed (e.g., due to firewalls and NATs). Much of a DHT query time is wasted trying to connect to peers that cannot be reached.
- The DHT query logic doesn't properly terminate when it hits the end of the query and, instead, aggressively keeps on searching.
- The routing tables are poorly maintained. This can cause search performance to slow down linearly with network size, instead of logarithmically as expected.
We have addressed the problem of undialable nodes by having nodes wait to join the DHT as server nodes until they've confirmed that they are reachable from the public internet.
To ensure that nodes which are not publicly reachable (ex behind VPNs, offline LANs, etc.) can still coordinate and share data, go-ipfs 0.5 will run two DHTs: one for private networks and one for the public internet. Every node will participate in a LAN DHT and a public WAN DHT. See Dual DHT for more details.
All IPFS nodes will now run two DHTs: one for the public internet WAN, and one for their local network LAN.
- When connected to the public internet, IPFS will use both DHTs for finding peers, content, and IPNS records. Nodes only publish provider and IPNS records to the WAN DHT to avoid flooding the local network.
- When not connected to the public internet, nodes publish provider and IPNS records to the LAN DHT.
The WAN DHT includes all peers with at least one public IP address. This release will only consider an IPv6 address public if it is in the public internet range 2000::/3
.
This feature should not have any noticeable impact on go-ipfs, performance, or otherwise. Everything should continue to work in all the currently supported network configurations: VPNs, disconnected LANs, public internet, etc.
We've improved the DHT query logic to more closely follow Kademlia. This should significantly speed up:
- Publishing IPNS & provider records.
- Resolving IPNS addresses.
Previously, nodes would continue searching until they timed out or ran out of peers before stopping (putting or returning data found). Now, nodes will now stop as soon as they find the closest peers.
Finally, we've addressed the poorly maintained routing tables by:
- Reducing the likelihood that the connection manager will kill connections to peers in the routing table.
- Keeping peers in the routing table, even if we get disconnected from them.
- Actively and frequently querying the DHT to keep our routing table full.
- Prioritizing useful peers that respond to queries quickly.
The DHT rewrite was made possible by Testground, our new testing framework. Testground allows us to spin up multi-thousand node tests with simulated real-world network conditions. By combining Testground and some custom analysis tools, we were able to gain confidence that the new DHT implementation behaves correctly.
When you add content to your IPFS node, you advertise this content to the network by announcing it in the DHT. We call this providing.
However, go-ipfs has multiple ways to address the same underlying bytes. Specifically, we address content by content ID (CID) and the same underlying bytes can be addressed using (a) two different versions of CIDs (CIDv0 and CIDv1) and (b) with different codecs depending on how we're interpreting the data.
Prior to go-ipfs 0.5.0, we used the content id (CID) in the DHT when sending out provider records for content. Unfortunately, this meant that users trying to find data announced using one CID wouldn't find nodes providing the content under a different CID.
In go-ipfs 0.5.0, we're announcing data by multihash, not CID. This way, regardless of the CID version used by the peer adding the content, the peer trying to download the content should still be able to find it.
Warning: as part of the network, this could impact finding content added with CIDv1. Because go-ipfs 0.5.0 will announce and search for content using the bare multihash (equivalent to the v0 CID), go-ipfs 0.5.0 will be unable to find CIDv1 content published by nodes prior to go-ipfs 0.5.0 and vice-versa. As CIDv1 is not enabled by default so we believe this will have minimal impact. However, users are strongly encouraged to upgrade as soon as possible.
A secondary focus in this release was improving content transfer, our data exchange protocols.
This release includes a major Bitswap refactor, running a new and backward compatible Bitswap protocol. We expect these changes to improve performance significantly.
With the refactored Bitswap, we expect:
- Few to no duplicate blocks when fetching data from other nodes speaking the new protocol.
- Better parallelism when fetching from multiple peers.
The new Bitswap won't magically make downloading content any faster until both seeds and leaches have updated. If you're one of the first to upgrade to 0.5.0
and try downloading from peers that haven't upgraded, you're unlikely to see much of a performance improvement.
Graphsync is a new exchange protocol that operates at the IPLD Graph layer instead of the Block layer like bitswap.
For example, to download "/ipfs/QmExample/index.html":
- Bitswap would download QmFoo, lookup "index.html" in the directory named by QmFoo, resolving it to a CID QmIndex. Finally, bitswap would download QmIndex.
- Graphsync would ask peers for "/ipfs/QmFoo/index.html". Specifically, it would ask for the child named "index.html" of the object named by "QmFoo".
This saves us round-trips in exchange for some extra protocol complexity. Moreover, this protocol allows specifying more powerful queries like "give me everything under QmFoo". This can be used to quickly download a large amount of data with few round-trips.
At the moment, go-ipfs cannot use this protocol to download content from other peers. However, if enabled, go-ipfs can serve content to other peers over this protocol. This may be useful for pinning services that wish to quickly replicate client data.
To enable, run:
> ipfs config --json Experimental.GraphsyncEnabled true
Continuing with the of improving our core data handling subsystems, both of the datastores used in go-ipfs, Badger and flatfs, have received important updates in this release:
Badger has been in go-ipfs for over a year as an experimental feature, and we're promoting it to stable (but not default). For this release, we've switched from writing to disk synchronously to explicitly syncing where appropriate, significantly increasing write throughput.
The current and default datastore used by go-ipfs is FlatFS. FlatFS essentially stores blocks of data as individual files on your file system. However, there are lots of optimizations a specialized database can do that a standard file system can not.
The benefit of Badger is that adding/fetching data to/from Badger is significantly faster than adding/fetching data to/from the default datastore, FlatFS. In some tests, adding data to Badger is 32x faster than FlatFS (in this release).
In this release, we're marking the badger datastore as stable. However, we're not yet enabling it by default. You can enable it at initialization by running: ipfs init --profile=badgerds
While Badger is a great solution, there are some issues you should consider before enabling it.
Badger is complicated. FlatFS pushes all the complexity down into the filesystem itself. That means that FlatFS is only likely to lose your data if your underlying filesystem gets corrupted while there are more opportunities for Badger itself to get corrupted.
Badger can use a lot of memory. In this release, we've tuned Badger to use ~20MB
of memory by default. However, it can still produce spikes as large as 1GiB
of data in memory usage when garbage collecting.
Finally, Badger isn't very aggressive when it comes to garbage collection, and we're still investigating ways to get it to more aggressively clean up after itself.
We suggest you use Badger if:
- Performance is your main requirement.
- You rarely delete anything.
- You have some memory to spare.
In the flatfs datastore, we've fixed an issue where temporary files could be left behind in some cases. While this release will avoid leaving behind temporary files, you may want to remove any left behind by previous releases:
> rm ~/.ipfs/blocks/*/put-*
> rm ~/.ipfs/blocks/du-*
We've also hardened several edge-cases in flatfs to reduce the impact of file descriptor limits, spurious crashes, etc.
Many improvements and bug fixes were made to libp2p over the course of this release. These release notes only include the most important and those most relevant to the content routing improvements.
When we fail to connect to a peer, we "backoff" and refuse to re-connect to that peer for a short period of time. This prevents us from wasting resources repeatedly failing to connect to the same unreachable peer.
Unfortunately, the old backoff logic was flawed: if we failed to connect to a peer and entered the "backoff" state, we wouldn't try to re-connect to that peer even if we had learned new and potentially working addresses for the peer. We've fixed this by applying backoff to each address instead of to the peer as a whole. This achieves the same result as we'll stop repeatedly trying to connect to the peer at known-bad addresses, but it allows us to reach the peer if we later learn about a good address.
This release uses Automatic NAT Detection (AutoNAT) - determining if the node is reachable from the public internet - to make decisions about how to participate in IPFS. This subsystem is used to determine if the node should store some of the public DHT, and if it needs to use relays to be reached by others. In short:
- An AutoNAT client asks a node running an AutoNAT service if it can be reached at one of a set of guessed addresses.
- The AutoNAT service attempts to dial back those addresses, with some restrictions. We won't dial back to a different IP address, for example.
- If the AutoNAT service succeeds, it reports back the address it successfully dialed, and the AutoNAT client knows that it is reachable from the public internet.
All nodes act as AutoNAT clients to determine if they should switch into DHT server mode. As of this release, nodes will by default run the service side of AutoNAT - verifying connectivity - for up to 30 peers every minute. This service should have minimal overhead and will be disabled for nodes in the lowpower
configuration profile, and those which believe they are not publicly reachable.
In addition to enabling the AutoNAT service by default, this release changes the AutoNAT config options:
- The
Swarm.EnableAutoNATService
option has been removed. - A new AutoNAT section has been added to the config. This section is empty by default.
If you've ever run a command like ipfs swarm peers
, you've likely seen paths that look like /ip4/193.45.1.24/tcp/4001/ipfs/QmSomePeerID
. These paths are not file paths, they're multiaddrs; addresses of peers on the network.
Unfortunately, /ipfs/Qm...
is also the same path format we use for files. This release, changes the multiaddr format from /ip4/193.45.1.24/tcp/4001/ipfs/QmSomePeerID
to /ip4/193.45.1.24/tcp/4001/p2p/QmSomePeerID
to make the distinction clear.
What this means for users:
- Old-style multiaddrs will still be accepted as inputs to IPFS.
- If you were using a multiaddr library (go, js, etc.) to name files because
/ipfs/QmSomePeerID
looks like/ipfs/QmSomeFile
, your tool may break if you upgrade this library. - If you're manually parsing multiaddrs and are searching for the string
/ipfs/
..., you'll need to search for/p2p/...
.
Previously, IPFS did not enforce a minimum RSA key size. In this release, we've introduced a minimum 2048 bit RSA key size. IPFS generates 2048 bit RSA keys by default so this shouldn't be an issue for anyone in practice. However, users who explicitly chose a smaller key size will not be able to communicate with new nodes.
Unfortunately, some of the bootstrap peers did intentionally generate 1024 bit RSA keys so they'd have vanity peer addresses (starting with QmSoL for "solar net"). All IPFS nodes should also have peers with >= 2048 bit RSA keys in their bootstrap list, but we've introduced a migration to ensure this.
We implemented this change to follow security best practices and to remove a potential foot-gun. However, in practice, the security impact of allowing insecure RSA keys should have been next to none because IPFS doesn't trust other peers on the network anyways.
In this release, we're switching TLS to be the default transport. This means we'll try to encrypt the connection with TLS before re-trying with SECIO.
Contrary to the announcement in the go-ipfs 0.4.23 release notes, this release does not remove SECIO support to maintain compatibility with js-ipfs.
Note: The Experimental.PreferTLS
configuration option is now ignored.
SECIO should be considered to be well on the way to deprecation and will be completely disabled in either the next release (0.6.0, ~mid May) or the one following that (0.7.0, ~end of June). Before SECIO is disabled, support will be added for the NOISE transport for compatibility with other IPFS implementations.
If you've been using the experimental QUIC support, this release upgrades to a new and incompatible version of the QUIC protocol (draft 27). Old and new go-ipfs nodes will still interoperate, but not over the QUIC transport.
We intend to standardize on this draft of the QUIC protocol and enable QUIC by default in the next release if all goes well.
NOTE: QUIC does not yet support private networks.
In addition to a bunch of bug fixes, we've made two improvements to the gateway.
You can play with both of these features by visiting:
http://bafybeia6po64b6tfqq73lckadrhpihg2oubaxgqaoushquhcek46y3zumm.ipfs.localhost:8080
First up, we've changed how URLs in the IPFS gateway work for better browser
security. The gateway will now redirect from
http://localhost:8080/ipfs/CID/...
to http://CID.ipfs.localhost:8080/...
by
default. This:
- Ensures that every dapp gets its own browser origin.
- Makes it easier to write websites that "just work" with IPFS because absolute paths will now work (though you should still use relative links because they're better).
Paths addressing the gateway by IP address (http://127.0.0.1:5001/ipfs/CID
) will not be altered as IP addresses can't have subdomains.
Note: cURL doesn't follow redirects by default. To avoid breaking cURL and other clients that don't support redirects, go-ipfs will return the requested file along with the redirect. Browsers will follow the redirect and abort the download while cURL will ignore the redirect and finish the download.
The second feature is a face-lift to the directory listing theme and color palette.
http://bafybeia6po64b6tfqq73lckadrhpihg2oubaxgqaoushquhcek46y3zumm.ipfs.localhost:8080
This release includes several new IPNS and IPNS-related features.
IPFS now resolves ENS names (e.g., /ipns/ipfs.eth
) via DNSLink provided by https://eth.link service.
IPFS has had experimental support for resolving IPNS over pubsub for a while. However, in the past, this feature was passive. When resolving an IPNS name, one would join a pubsub topic for the IPNS name and subscribe to future updates. Unfortunately, this wouldn't speed-up initial IPNS lookups.
In this release, we've introduced a new "record fetch" protocol to speedup the initial lookup. Now, after subscribing to the pubsub topic for the IPNS key, nodes will use this new protocol to "fetch" the last-seen IPNS record from all peers subscribed to the topic.
This feature will be enabled by default in 0.6.0.
IPNS names can now be expressed as special multibase CIDs. E.g.,
/ipns/bafzbeibxfjp4gaxc4cdn57257cyvc7jfa4rlp4e5min6geg44m57g6nx7e
Importantly, this allows IPNS names to appear in subdomains in the new subdomain gateway feature.
We have made two major changes to the pubsub subsystem in this release:
- Pubsub now more aggressively finds and connects to other peers subscribing to the same topic.
- Go-ipfs has switched its default pubsub router from "floodsub", an inefficient but simple "flooding" pubsub implementation, to "gossipsub".
PubSub will be stabilized in go-ipfs 0.6.0.
The IPFS CLI and API have a couple of new features and changes.
IPFS has two HTTP APIs:
- Port 5001: http://localhost:5001/api/v0/... - the API
- Port 8080: http://localhost:8080/api/v0/... - a read-only subset of the API, accessible via the gateway
As of this release, the main IPFS API (port 5001) will only accept POST requests. This change is necessary to tighten cross origin security in browsers.
If you're using the go-ipfs API in your application, you may need to change GET calls to POST calls or upgrade your libraries and tools.
- go - go-ipfs-api - v0.0.3
- js-ipfs-http-api - v0.41.1
- orbit-db - v0.24.0 (unreleased)
If you've ever seen the error:
Error: api not running
when trying to run a command without the daemon running, we have good news! You
should never see this error again. The ipfs
command now correctly detects that the daemon is not, in fact, running, and directly opens the IPFS repo.
The ipfs repo fsck
now does nothing but print an error message. Previously, it was used to cleanup some lock files: the "api" file that caused the aforementioned "api not running" error and the repo lock. However, this is no longer necessary.
It's now possible to initialize an IPFS node with an existing IPFS config by running:
> ipfs init /path/to/existing/config
This will re-use the existing configuration in it's entirety (including the private key) and can be useful when:
- Migrating a node's identity between machines without keeping the data.
- Resetting the datastore.
Files can now be ignored on add by passing the --ignore
and/or
--ignore-rules-path
flags.
--ignore=PATTERN
will ignore all files matching the gitignore rule PATTERN.--ignore-rules-path=FILENAME
will apply the gitignore rules from the specified file.
For example, to add a git repo while ignoring all files git would ignore, you could run:
> cd path/to/some/repo
> ipfs add -r --hidden=false --ignore=.git --ignore-rules-path=.gitignore .
It's now possible to add data directly from a named pipe:
> mkfifo foo
> echo -n "hello " > foo &
> echo -n "world" > bar &
> ipfs add foo bar
This can be useful when adding data from multiple streaming sources.
NOTE: To avoid surprising users, IPFS will only add data from FIFOs directly named on the command line, not FIFOs in a recursively added directory. Otherwise, ipfs add
would halt whenever it encountered a FIFO with no data to be read leading to difficult to debug stalls.
IPFS now allows rapid reading and writing of blocks in .car
format. The functionality is accessible via the experimental dag import
and dag export
commands:
~$ ipfs dag export QmQPeNsJPyVWPFDVHb77w8G42Fvo15z4bG2X8D2GhfbSXc \
| xz > welcome_to_ipfs.car.xz
0s 6.73 KiB / ? [-------=-------------------------------------] 5.16 MiB/s 0s
Then on another ipfs
instance, not even connected to the network:
~$ xz -dc welcome_to_ipfs.car.xz | ipfs dag import
Pinned root QmQPeNsJPyVWPFDVHb77w8G42Fvo15z4bG2X8D2GhfbSXc success
We've made two minor changes to the pinning subsystem:
ipfs pin ls --stream
allows streaming a pin listing.ipfs pin update
no longer holds the global pin lock while fetching files from the network. This should hopefully make it significantly more useful.
The go-ipfs daemon has switched to using Uber's Zap. Unlike our previous logging system, Zap supports structured logging which can make parsing, filtering, and analyzing go-ipfs logs much simpler.
To enable structured logging, set the IPFS_LOGGING_FMT
environment variable to "json".
Note: while we've switched to using Zap as the logging backend, most of go-ipfs still logs strings.
For Linux users, this release includes support for two systemd features: socket activation and startup/shutdown notifications. This makes it possible to:
- Start IPFS on demand on first use.
- Wait for IPFS to finish starting before starting services that depend on it.
You can find the new systemd units in the go-ipfs repo under misc/systemd.
This release supports exposing the IPFS API over a unix domain socket in the filesystem. You use this feature, run:
> ipfs config Addresses.API "/unix/path/to/socket/location"
We've made a few improvements to our docker image in this release:
- It can now be cross-built for multiple architectures.
- It now builds go-ipfs with OpenSSL support by default for faster libp2p handshakes.
- A private-network "swarm" key can now be passed in to a docker image via either the
IPFS_SWARM_KEY=<inline key>
orIPFS_SWARM_KEY_FILE=<path/to/key/file>
docker variables. Check out the Docker section of the README for more information.
go-ipfs plugins allow users to extend go-ipfs without modifying the original source-code. This release includes a few important changes.
See docs/plugins.md for details.
Plugins are now supported on MacOS, in addition to Linux. Unfortunately, Go still doesn't support plugins on Windows.
This release introduces a new InternalPlugin
plugin type. When started, this plugin will be passed a raw *IpfsNode
object, giving it access to all go-ipfs internals.
This plugin interface is permanently unstable as it has access to internals that can change frequently. However, it should allow power-users to develop deeply integrated extensions to go-ipfs, out-of-tree.
BREAKING
Plugins can now be configured and/or disabled via the ipfs config file.
To make this possible, the plugin interface has changed. The Init
function now takes an *Environment
object. Specifically, the plugin signature has changed from:
type Plugin interface {
Name() string
Version() string
Init() error
}
to
type Environment struct {
// Path to the IPFS repo.
Repo string
// The plugin's config, if specified.
Config interface{}
}
type Plugin interface {
Name() string
Version() string
Init(env *Environment) error
}
IPFS uses repo migrations to make structural changes to the "repo" (the config, data storage, etc.) on upgrade.
This release includes two very simple repo migrations: a config migration to ensure that the config contains working bootstrap nodes and a keystore migration to base32 encode all key filenames.
In general, migrations should not require significant manual intervention. However, you should be aware of migrations and plan for them.
- If you update go-ipfs with
ipfs update
,ipfs update
will run the migration for you. Note:ipfs update
will refuse to run the migrations while ipfs itself is running. - If you start the ipfs daemon with
ipfs daemon --migrate
, ipfs will migrate your repo for you on start.
Otherwise, if you want more control over the repo migration process, you can manually install and run the repo migration tool.
AUTOMATIC MIGRATION REQUIRED
The first migration will update the bootstrap peer list to:
- Replace the old bootstrap nodes (ones with peer IDs starting with QmSoL), with new bootstrap nodes (ones with addresses that start with
/dnsaddr/bootstrap.libp2p.io
). - Rewrite the address format from
/ipfs/QmPeerID
to/p2p/QmPeerID
.
We're migrating addresses for a few reasons:
- We're using DNS to address the new bootstrap nodes so we can change the underlying IP addresses as necessary.
- The new bootstrap nodes use 2048 bit keys while the old bootstrap nodes use 1024 bit keys.
- We're normalizing the address format to
/p2p/Qm...
.
Note: This migration won't add the new bootstrap peers to your config if you've explicitly removed the old bootstrap peers. It will also leave custom entries in the list alone. In other words, if you've customized your bootstrap list, this migration won't clobber your changes.
AUTOMATIC MIGRATION REQUIRED
go-ipfs stores additional keys (i.e., all keys other than the "identity" key) in the keystore. You can list these keys with ipfs key
.
Currently, the keystore stores keys as regular files, named after the key itself. Unfortunately, filename restrictions and case-insensitivity are platform specific. To avoid platform specific issues, we're base32 encoding all key names and renaming all keys on-disk.
As usual, this release contains several Windows specific fixes and improvements:
- Double-clicking
ipfs.exe
will now start the daemon inside a console window. ipfs add -r
now correctly recognizes and ignores hidden files on Windows.- The default datastore, flatfs, now takes extra precautions to avoid "file in use" errors caused by both go-ipfs and external programs like anti-viruses. If you've ever seen go-ipfs print out an "access denied" or "file in use" error on Windows, this issue was likely the cause.
- github.com/ipfs/go-ipfs:
- fix: non-blocking peerlog logging (ipfs/go-ipfs#7232)
- doc: update go-ipfs docs for 0.5.0 release (ipfs/go-ipfs#7229)
- Add additional documentation links to the new issue screen (ipfs/go-ipfs#7226)
- docs: note that ShardingEnabled is a global flag (ipfs/go-ipfs#7218)
- update log helptext to match actual levels (ipfs/go-ipfs#7199)
- Chore/harden car test a bit harder (ipfs/go-ipfs#7209)
- fix: fix duplicate block issue in bitswap (ipfs/go-ipfs#7202)
- feat: update docker image (ipfs/go-ipfs#7191)
- feat: update dir index (ipfs/go-ipfs#7192)
- fix: update the dht to fix yggdrasil (ipfs/go-ipfs#7186)
- Choose architecture when download tini into docker container (ipfs/go-ipfs#7187)
- Fix typos and cleanup (ipfs/go-ipfs#7181)
- Fixtypos (ipfs/go-ipfs#7180)
- feat: webui 2.7.5 (ipfs/go-ipfs#7176)
- integration test for the dual dht (ipfs/go-ipfs#7151)
- fix: subdomain redirect for dir CIDs (ipfs/go-ipfs#7165)
- add autonat config options (ipfs/go-ipfs#7162)
- docs: fix link to version.go (ipfs/go-ipfs#7157)
- feat: webui v2.7.4 (ipfs/go-ipfs#7159)
- fix the typo in the serveHTTPApi (ipfs/go-ipfs#7156)
- test(sharness): improve CAR tests to remove some potential races (ipfs/go-ipfs#7154)
- feat: introduce the dual WAN/LAN DHT (ipfs/go-ipfs#7127)
- fix: invalidate cache on failed publish (ipfs/go-ipfs#7152)
- Temporarily disable gc-race test (ipfs/go-ipfs#7148)
- Beef up and harden import/export tests (ipfs/go-ipfs#7140)
- Filter dials to blocked subnets, even when using DNS. (ipfs/go-ipfs#6996)
- Dag export command, complete (ipfs/go-ipfs#7036)
- Adding Fission to IPFS early testers page (ipfs/go-ipfs#7119)
- feat: bump version (ipfs/go-ipfs#7110)
- feat: initial update to the changelog for 0.5.0 (ipfs/go-ipfs#6977)
- feat(dht): update to cypress DHT in backwards compatibility mode (ipfs/go-ipfs#7103)
- update bash completion for
ipfs add
(ipfs/go-ipfs#7102) - HTTP API: Only allow POST requests (plus OPTIONS) (ipfs/go-ipfs#7097)
- Revert last change (the default is now printed twice) (ipfs/go-ipfs#7098)
- Fix #4996: Improve help text for "ipfs files cp" (ipfs/go-ipfs#7069)
- changed brew to brew cask (ipfs/go-ipfs#7072)
- fix: remove internal relay discovery (ipfs/go-ipfs#7064)
- docs/experimental-features.md: typo (ipfs/go-ipfs#7062)
- fix: get rid of shutdown errors (ipfs/go-ipfs#7058)
- feat: tls by default (ipfs/go-ipfs#7055)
- fix: downgrade to go 1.13 (ipfs/go-ipfs#7054)
- Keystore: minor maintenance (ipfs/go-ipfs#7043)
- fix(keystore): avoid racy filesystem access (ipfs/go-ipfs#6999)
- Forgotten go-fmt (ipfs/go-ipfs#7030)
- feat: update go-libp2p & go-bitswap (ipfs/go-ipfs#7028)
- Introducing EncodedFSKeystore with base32 encoding (#5947) (ipfs/go-ipfs#6955)
- feat: improve key lookup (ipfs/go-ipfs#7023)
- feat(file-ignore): add ignore opts to add cmd (ipfs/go-ipfs#7017)
- feat: gateway subdomains + http proxy mode (ipfs/go-ipfs#6096)
- Chore/sharness fixes 2019 03 16 (ipfs/go-ipfs#6997)
- Support pipes when named on the cli explicitly (ipfs/go-ipfs#6998)
- Fix a typo (ipfs/go-ipfs#7000)
- fix: revert changes to the user agent (ipfs/go-ipfs#6993)
- feat(peerlog): log protocols/versions (ipfs/go-ipfs#6972)
- feat: docker build and tag from ci (ipfs/go-ipfs#6949)
- cmd: ipfs handle GUI environment on Windows (ipfs/go-ipfs#6646)
- Chore/macos sharness fixes (ipfs/go-ipfs#6988)
- Update to go-libp2p 0.6.0 (ipfs/go-ipfs#6914)
- mount: switch over to the CoreAPI (ipfs/go-ipfs#6602)
- doc(commands): document that
dht put
takes a file (ipfs/go-ipfs#6960) - docs: update licence info in README (ipfs/go-ipfs#6942)
- docs: fix example for files.write (ipfs/go-ipfs#6943)
- feat(graphsync): mount the graphsync libp2p protocol (ipfs/go-ipfs#6892)
- feat: update go in docker container (ipfs/go-ipfs#6933)
- remove expired GPG key from README (ipfs/go-ipfs#6931)
- test(sharness): test our tests (ipfs/go-ipfs#6908)
- fix: broken interop tests (ipfs/go-ipfs#6899)
- feat: pass IPFS_PLUGINS to docker build (ipfs/go-ipfs#6898)
- doc(add): document hash stability (ipfs/go-ipfs#6891)
- feat: add peerlog plugin (ipfs/go-ipfs#6887)
- doc(plugin): document internal plugins (ipfs/go-ipfs#6888)
- Fix #6878: Improve MFS Cli documentation (ipfs/go-ipfs#6882)
- Update the license distributed with dist builds to the dual one (ipfs/go-ipfs#6879)
- doc: add license URLs so go's doc service can detect our license (ipfs/go-ipfs#6874)
- doc: rename COPYRIGHT to LICENSE (ipfs/go-ipfs#6873)
- fix: fix id addr format (ipfs/go-ipfs#6872)
- Help text update for 'ipfs key gen' (ipfs/go-ipfs#6867)
- fix: make rsa the default key type (ipfs/go-ipfs#6864)
- doc(config): cleanup (ipfs/go-ipfs#6855)
- Allow building non-amd64 Docker images (ipfs/go-ipfs#6854)
- doc(release): add Charity Engine to the early testers programme (ipfs/go-ipfs#6850)
- fix: fix a potential out of bounds issue in fuse (ipfs/go-ipfs#6847)
- fix(build): instruct users to use GOTAGS, not GOFLAGS (ipfs/go-ipfs#6843)
- doc(release): document how RCs should be communicated (ipfs/go-ipfs#6845)
- doc(release): move WebUI from manual tests to automated tests section (ipfs/go-ipfs#6838)
- test(sharness): fix typo (ipfs/go-ipfs#6835)
- test: E2E tests against ipfs-webui HEAD (ipfs/go-ipfs#6825)
- mkreleaslog: improve edge-cases (ipfs/go-ipfs#6833)
- fix: dont fail to collect profiles if no ipfs bin (ipfs/go-ipfs#6829)
- update dockerfile and use openssl (ipfs/go-ipfs#6828)
- docs: define Gateway.PathPrefixes (ipfs/go-ipfs#6826)
- fix(badgerds): turn off sync writes by default (ipfs/go-ipfs#6819)
- gateway cleanups (ipfs/go-ipfs#6820)
- make it possible to change the codec with the
ipfs cid
subcommand (ipfs/go-ipfs#6817) - improve gateway symlink handling (ipfs/go-ipfs#6680)
- Inclusion of the presence of the go-ipfs package in Solus (ipfs/go-ipfs#6809)
- Fix Typos (ipfs/go-ipfs#6807)
- Sharness macos no brainer fixes (ipfs/go-ipfs#6805)
- Support Asynchronous Datastores (ipfs/go-ipfs#6785)
- update documentation for /ipfs -> /p2p multiaddr switch (ipfs/go-ipfs#6538)
- IPNS over PubSub as an Independent Transport (ipfs/go-ipfs#6758)
- docs: add information on how to enable experiments (ipfs/go-ipfs#6792)
- Change Reporter to BandwidthCounter in IpfsNode (ipfs/go-ipfs#6793)
- update go-datastore (ipfs/go-ipfs#6791)
- go fmt: go-ipfs-as-a-library (ipfs/go-ipfs#6784)
- feat: web ui 2.7.2 (ipfs/go-ipfs#6778)
- extract the pinner to go-ipfs-pinner and dagutils into go-merkledag (ipfs/go-ipfs#6771)
- fix #2203: omit the charset attribute when Content-Type is text/html (ipfs/go-ipfs#6743)
- Pin ls traverses all indirect pins (ipfs/go-ipfs#6705)
- fix: ignore nonexistant when force rm (ipfs/go-ipfs#6773)
- introduce IpfsNode Plugin (ipfs/go-ipfs#6719)
- improve documentation and fix dht put bug (ipfs/go-ipfs#6750)
- Adding alias for
ipfs repo stat
. (ipfs/go-ipfs#6769) - doc(gateway): document dnslink (ipfs/go-ipfs#6767)
- pin: add context and error return to most of the Pinner functions (ipfs/go-ipfs#6715)
- feat: web ui 2.7.1 (ipfs/go-ipfs#6762)
- doc(README): document requirements for cross-compiling with OpenSSL support (ipfs/go-ipfs#6738)
- feat: web ui 2.6.0 (ipfs/go-ipfs#6740)
- Add high-level go-ipfs architecture diagram (ipfs/go-ipfs#6727)
- docs: remove extra ) on the example README (ipfs/go-ipfs#6733)
- update maintainer label (ipfs/go-ipfs#6735)
- ipfs namespace is now being provided to prometheus (ipfs/go-ipfs#6643)
- feat: web ui 2.5.8 (ipfs/go-ipfs#6718)
- docs: add connmgr to config.md toc (ipfs/go-ipfs#6712)
- feat: web ui 2.5.7 (ipfs/go-ipfs#6707)
- README: improve build documentation (ipfs/go-ipfs#6706)
- Introduce buzhash chunker (ipfs/go-ipfs#6701)
- Pinning interop: Pin ls returns appropriate zero value (ipfs/go-ipfs#6685)
- fix(resolve): correctly handle .eth domains (ipfs/go-ipfs#6700)
- Update README.md (ipfs/go-ipfs#6697)
- daemon: support unix domain sockets for the API/gateway (ipfs/go-ipfs#6678)
- docs: guide users to the right locations for questions (ipfs/go-ipfs#6691)
- docs: readme improvements (ipfs/go-ipfs#6693)
- docs: link remaining docs available, guide people to the right locations (ipfs/go-ipfs#6694)
- docs: fix broken url (ipfs/go-ipfs#6692)
- add systemd support (ipfs/go-ipfs#6675)
- feat: add ipfs version info to prometheus metrics (ipfs/go-ipfs#6688)
- Fix typo (ipfs/go-ipfs#6686)
- github: migrate actions (ipfs/go-ipfs#6681)
- Add bridged chats (ipfs/go-ipfs#6653)
- doc(config): improve DisableNatPortMap documentation (ipfs/go-ipfs#6655)
- plugins: support Close() for Tracer plugins as well (ipfs/go-ipfs#6672)
- fix: make collect-profiles.sh work on mac (ipfs/go-ipfs#6673)
- namesys(test): test TTL on publish (ipfs/go-ipfs#6671)
- discovery: improve mdns warnings (ipfs/go-ipfs#6665)
- feat: web ui 2.5.4 (ipfs/go-ipfs#6664)
- cmds(help): fix swarm filter add/rm help text (ipfs/go-ipfs#6654)
- feat: webui 2.5.3 (ipfs/go-ipfs#6638)
- feat: web ui 2.5.1 (ipfs/go-ipfs#6630)
- docs: add multiple gateway and api addrs (ipfs/go-ipfs#6631)
- doc: add post-release checklist (ipfs/go-ipfs#6625)
- docs: add ship date and next release issue opening time (ipfs/go-ipfs#6620)
- docker: libdl dependency (ipfs/go-ipfs#6624)
- docs: improvements to the release doc (ipfs/go-ipfs#6616)
- plugins: add support for plugin configs (ipfs/go-ipfs#6613)
- Update README.md (ipfs/go-ipfs#6615)
- doc: remove gmake instructions (ipfs/go-ipfs#6614)
- feat: add ability to use existing config during init (ipfs/go-ipfs#6489)
- doc: expand and cleanup badger documentation (ipfs/go-ipfs#6611)
- feat: improve plugin preload logic (ipfs/go-ipfs#6576)
- version: don't print 'VERSION-' if no commit is specified (ipfs/go-ipfs#6609)
- Update go-libp2p, fix tests with weak RSA keys (ipfs/go-ipfs#6555)
- cmds/refs: fix ipfs refs for sharded directories (ipfs/go-ipfs#6601)
- fix: spammy mock when testing (ipfs/go-ipfs#6583)
- docker: update the docker image (ipfs/go-ipfs#6582)
- add release process graphic (ipfs/go-ipfs#6568)
- feat: web ui 2.5.0 (ipfs/go-ipfs#6566)
- Add swarm key variables to container daemon (ipfs/go-ipfs#6554)
- doc: update the release template (ipfs/go-ipfs#6561)
- merge changelog and bump version (ipfs/go-ipfs#6559)
- require GNU make (ipfs/go-ipfs#6551)
- tweak the release process (ipfs/go-ipfs#6553)
- Allow resolution of .eth names via .eth.link (ipfs/go-ipfs#6448)
- README: update minimum system requirements and recommend OpenSSL (ipfs/go-ipfs#6543)
- fix and improve the writable gateway (ipfs/go-ipfs#6539)
- feat: add install instructions for external commands (ipfs/go-ipfs#6541)
- fix: slightly faster gc (ipfs/go-ipfs#6505)
- fix {net,open}bsd build by disabling fuse on openbsd (ipfs/go-ipfs#6535)
- mk: handle stripping paths when GOPATH contains whitespace (ipfs/go-ipfs#6536)
- make gossipsub the default routing protocol for pubsub (ipfs/go-ipfs#6512)
- doc: align the early testers program description with its goal (ipfs/go-ipfs#6529)
- feat: add --long as alias for -l in files.ls (ipfs/go-ipfs#6528)
- switch to new merkledag walk functions (ipfs/go-ipfs#6499)
- readme: fix CI badge (ipfs/go-ipfs#6521)
- Adds Siderus in early testers (ipfs/go-ipfs#6517)
- Extract Filestore (ipfs/go-ipfs#6511)
- readme: fix scoop bucket command error (ipfs/go-ipfs#6510)
- sharness: test pin ls stream (ipfs/go-ipfs#6504)
- Improve pin/update description (ipfs/go-ipfs#6501)
- pin cmd: stream recursive pins (ipfs/go-ipfs#6493)
- Document the AddrFilters option (ipfs/go-ipfs#6459)
- feat: make it easier to load custom plugins (ipfs/go-ipfs#6474)
- document the debug script (ipfs/go-ipfs#6486)
- Extract provider module to
go-ipfs-provider
(ipfs/go-ipfs#6421) - ignore stale API files and deprecate ipfs repo fsck (ipfs/go-ipfs#6478)
- Fix node construction queue error (ipfs/go-ipfs#6480)
- Update the required go version in the README (ipfs/go-ipfs#6462)
- gitmodules: use https so we don't need an ssh key (ipfs/go-ipfs#6450)
- doc: add another Windows package to README (ipfs/go-ipfs#6440)
- Close started plugins when one of them fails to start. (ipfs/go-ipfs#6438)
- Load plugins on darwin/macOS (ipfs/go-ipfs#6439)
- assets: move away from gx (ipfs/go-ipfs#6414)
- Fix a typo (ipfs/go-ipfs#6432)
- docs: fix install guide link (ipfs/go-ipfs#6423)
- Deps: update go-libp2p-http to its new libp2p location (ipfs/go-ipfs#6422)
- install.sh: Fix wrong destination path for ipfs binary (ipfs/go-ipfs#6424)
- build: strip GOPATH from build paths (ipfs/go-ipfs#6412)
- libp2p: moves discovery after host listen (ipfs/go-ipfs#6415)
- remove mentions of gx from windows build docs (ipfs/go-ipfs#6413)
- build: use protoc-gen-* from gomod (ipfs/go-ipfs#6411)
- add unixfs get metric (ipfs/go-ipfs#6406)
- Run JS interop in CircleCI (ipfs/go-ipfs#6409)
- Usage of context helper in Blockstore provider (ipfs/go-ipfs#6399)
- docs: default value for HashOnRead is false (ipfs/go-ipfs#6401)
- block cmd: allow adding multiple blocks at once (ipfs/go-ipfs#6331)
- Remove Repo from routing fx provider parameter (ipfs/go-ipfs#6395)
- migrate to go-libp2p-core. (ipfs/go-ipfs#6384)
- feat: update Web UI to v2.4.6 (ipfs/go-ipfs#6392)
- Introduce first strategic provider: do nothing (ipfs/go-ipfs#6292)
- github.com/ipfs/go-bitswap (v0.0.8-e37498cf10d6 -> v0.2.13):
- refactor: remove WantManager (ipfs/go-bitswap#374)
- Send CANCELs when session context is cancelled (ipfs/go-bitswap#375)
- refactor: remove unused code (ipfs/go-bitswap#373)
- Change timing for DONT_HAVE timeouts to be more conservative (ipfs/go-bitswap#371)
- fix: avoid calling ctx.SetDeadline() every time we send a message (ipfs/go-bitswap#369)
- feat: optimize entry sorting in MessageQueue (ipfs/go-bitswap#356)
- Move connection management into networking layer (ipfs/go-bitswap#351)
- refactor: simplify messageQueue onSent (ipfs/go-bitswap#349)
- feat: prioritize more important wants (ipfs/go-bitswap#346)
- fix: in message queue only send cancel if want was sent (ipfs/go-bitswap#345)
- fix: ensure wantlist gauge gets decremented on disconnect (ipfs/go-bitswap#332)
- avoid copying messages and improve logging (ipfs/go-bitswap#326)
- fix: log unexpected condition in peerWantManager.prepareSendWants() (ipfs/go-bitswap#325)
- wait for sessionWantSender to shutdown before completing session shutdown (ipfs/go-bitswap#317)
- Perf/message queue (ipfs/go-bitswap#307)
- feat: add a custom CID type (ipfs/go-bitswap#308)
- feat: expose the full wantlist through GetWantlist (ipfs/go-bitswap#300)
- Clean up logs (ipfs/go-bitswap#299)
- Fix order of session broadcast wants (ipfs/go-bitswap#291)
- fix flaky TestRateLimitingRequests (ipfs/go-bitswap#296)
- fix flaky TestDontHaveTimeoutMgrTimeout (ipfs/go-bitswap#293)
- fix: re-export testinstance/testnet (ipfs/go-bitswap#289)
- Simulate DONT_HAVE when peer doesn't respond to want-block (new peers) (ipfs/go-bitswap#284)
- Be less aggressive when pruning peers from session (ipfs/go-bitswap#276)
- fix: races in tests (ipfs/go-bitswap#279)
- Refactor: simplify session peer management (ipfs/go-bitswap#275)
- Prune peers that send too many consecutive DONT_HAVEs (ipfs/go-bitswap#261)
- feat: debounce wants manually (ipfs/go-bitswap#255)
- Fix bug with signaling peer availability to sessions (ipfs/go-bitswap#247)
- feat: move internals to an internal package (ipfs/go-bitswap#242)
- PoC of Bitswap protocol extensions implementation (ipfs/go-bitswap#189)
- fix: abort when the context is canceled while getting blocks (ipfs/go-bitswap#240)
- Add bridged chats (ipfs/go-bitswap#198)
- reduce session contention (ipfs/go-bitswap#188)
- Fix: don't ignore received blocks for pending wants (ipfs/go-bitswap#174)
- Test: fix flakey session peer manager tests (ipfs/go-bitswap#185)
- Refactor: use global pubsub notifier (ipfs/go-bitswap#177)
- network: Allow specifying protocol prefix (ipfs/go-bitswap#171)
- fix: memory leak in latency tracker on timeout after cancel (ipfs/go-bitswap#164)
- Fix typo (ipfs/go-bitswap#158)
- Feat: Track Session Peer Latency More Accurately (ipfs/go-bitswap#149)
- ci(circleci): add benchmark comparisons (ipfs/go-bitswap#147)
- aggressively free memory (ipfs/go-bitswap#143)
- Enchanced logging for bitswap (ipfs/go-bitswap#137)
- fix: rand.Intn(0) panics (ipfs/go-bitswap#144)
- fix some naming nits and broadcast on search (ipfs/go-bitswap#139)
- feat(sessions): add rebroadcasting, search backoff (ipfs/go-bitswap#133)
- testutil: fix block generator (ipfs/go-bitswap#135)
- migrate to go-libp2p-core. (ipfs/go-bitswap#132)
- github.com/ipfs/go-blockservice (v0.0.3 -> v0.1.3):
- fix ci badge and lints (ipfs/go-blockservice#52)
- demote warning to debug log (ipfs/go-blockservice#30)
- nil exchange is okay (ipfs/go-blockservice#29)
- set the session context (ipfs/go-blockservice#28)
- make blockservice AddBlocks return more quickly (ipfs/go-blockservice#10)
- feat(session): instantiated sessions lazily (ipfs/go-blockservice#27)
- github.com/ipfs/go-cid (v0.0.4 -> v0.0.5):
- fix: enforce minimal encoding (ipfs/go-cid#99)
- github.com/ipfs/go-datastore (v0.0.5 -> v0.4.4):
- Fix test log message about number of values put (ipfs/go-datastore#150)
- test suite: Add ElemCount to control how many elements are added. (ipfs/go-datastore#151)
- fix: avoid filtering by prefix unless necessary (ipfs/go-datastore#147)
- feat: add upper-case keys at a known prefix (ipfs/go-datastore#148)
- test(suite): add a bunch of prefix tests for the new behavior (ipfs/go-datastore#145)
- Only count a key as an ancestor if there is a separator (ipfs/go-datastore#141)
- fix go-check path to use "gopkg.in/check.v1" (ipfs/go-datastore#144)
- LogDatastore fulfills the Datastore interface again (ipfs/go-datastore#142)
- Support Asynchronous Writing Datastores (ipfs/go-datastore#140)
- add a Size field to Query's Result (ipfs/go-datastore#134)
- Add clarifying comments on Query#String() (ipfs/go-datastore#138)
- Add a large test suite (ipfs/go-datastore#136)
- doc: add a lead maintainer (ipfs/go-datastore#135)
- feat: make not-found errors discoverable (ipfs/go-datastore#133)
- feat: make delete idempotent (ipfs/go-datastore#132)
- Misc Typo Fixes (ipfs/go-datastore#131)
- github.com/ipfs/go-ds-badger (v0.0.5 -> v0.2.4):
- fix: verify that the datastore is still open when querying (ipfs/go-ds-badger#87)
- feat: switch to file io and shrink tables (ipfs/go-ds-badger#83)
- fix: update go-datastore (ipfs/go-ds-badger#80)
- update datastore Interface (ipfs/go-ds-badger#77)
- query: always return the size (ipfs/go-ds-badger#78)
- feat(gc): make it possible to disable GC (ipfs/go-ds-badger#74)
- feat(gc): improve periodic GC logic (ipfs/go-ds-badger#73)
- periodic GC for badger datastore (ipfs/go-ds-badger#72)
- Fix combining query filters, offsets, and limits (ipfs/go-ds-badger#71)
- doc: add lead maintainer (ipfs/go-ds-badger#67)
- github.com/ipfs/go-ds-flatfs (v0.0.2 -> v0.4.4):
- move retries lower and retry rename ops (ipfs/go-ds-flatfs#82)
- cleanup putMany implementation (ipfs/go-ds-flatfs#80)
- feat: read harder (ipfs/go-ds-flatfs#78)
- fix: remove temporary files when multiple write operations conflict (ipfs/go-ds-flatfs#76)
- Windows CI + Fixes (ipfs/go-ds-flatfs#73)
- fix: close query when finished moving (ipfs/go-ds-flatfs#74)
- fix: ensure that we close the diskusage file, even if we fail to rename it (ipfs/go-ds-flatfs#72)
- feat: put all temporary files in the same directory and clean them up (ipfs/go-ds-flatfs#69)
- fix: only log when we find a file we don't expect (ipfs/go-ds-flatfs#68)
- Make flatfs robust (ipfs/go-ds-flatfs#64)
- Update Datastore Interface (ipfs/go-ds-flatfs#60)
- query: deny ReturnsSizes and ReturnExpirations instead of returning wrong result (ipfs/go-ds-flatfs#59)
- doc: add a lead maintainer (ipfs/go-ds-flatfs#55)
- make delete idempotent (ipfs/go-ds-flatfs#54)
- github.com/ipfs/go-ds-leveldb (v0.0.2 -> v0.4.2):
- prevent closing concurrently with other operations. (ipfs/go-ds-leveldb#42)
- feat: update go-datastore (ipfs/go-ds-leveldb#40)
- update datastore Interface (ipfs/go-ds-leveldb#36)
- query: always return the size (ipfs/go-ds-leveldb#35)
- doc: add a lead maintainer (ipfs/go-ds-leveldb#31)
- make delete idempotent (ipfs/go-ds-leveldb#30)
- github.com/ipfs/go-ds-measure (v0.0.1 -> v0.1.0):
- update datastore Interface (ipfs/go-ds-measure#23)
- Add Datastore Tests (ipfs/go-ds-measure#24)
- fix GetSize calls reported as Has (ipfs/go-ds-measure#20)
- github.com/ipfs/go-fs-lock (v0.0.1 -> v0.0.4):
- fix: revert small breaking change (ipfs/go-fs-lock#10)
- Enh/improve error handling (ipfs/go-fs-lock#9)
- Use path/filepath instead of path (ipfs/go-fs-lock#8)
- github.com/ipfs/go-ipfs-blockstore (v0.0.1 -> v0.1.4):
- return the correct size when only "has" is cached (ipfs/go-ipfs-blockstore#36)
- cache: switch to 2q (ipfs/go-ipfs-blockstore#20)
- github.com/ipfs/go-ipfs-chunker (v0.0.1 -> v0.0.5):
- fix: don't return an empty block at the end (ipfs/go-ipfs-chunker#22)
- Rigorous sizing checks (ipfs/go-ipfs-chunker#21)
- Improve performance of buzhash (ipfs/go-ipfs-chunker#17)
- Implement buzhash (ipfs/go-ipfs-chunker#16)
- Add benchmarks (ipfs/go-ipfs-chunker#15)
- github.com/ipfs/go-ipfs-cmds (v0.0.8 -> v0.2.2):
- Fix: disallow POST without Origin nor Referer from specific user agents (ipfs/go-ipfs-cmds#193)
- doc: document command fields (ipfs/go-ipfs-cmds#192)
- change HandledMethods to AllowGet and cleanup method handling (ipfs/go-ipfs-cmds#191)
- remove deprecated log.Warning(f) (ipfs/go-ipfs-cmds#180)
- http: configurable allowed request methods for the API. (ipfs/go-ipfs-cmds#190)
- #183 refactored the request options conversion code per the ticket requirements (ipfs/go-ipfs-cmds#187)
- fix typo (ipfs/go-ipfs-cmds#188)
- (ipfs/go-ipfs-cmds#183)
- fix: normalize options when parsing them (ipfs/go-ipfs-cmds#186)
- feat:add strings option; re-implement file ignore (ipfs/go-ipfs-cmds#181)
- Special-case accepting explicitly supplied named pipes (ipfs/go-ipfs-cmds#184)
- Chore/remove gx (ipfs/go-ipfs-cmds#182)
- http: allow specifying a custom http client (ipfs/go-ipfs-cmds#175)
- http: cleanup http related errors (ipfs/go-ipfs-cmds#173)
- fix: too many arguments error text (ipfs/go-ipfs-cmds#172)
- fallback executor support (ipfs/go-ipfs-cmds#171)
- make ErrorType a valid error and implement Unwrap on Error (ipfs/go-ipfs-cmds#170)
- feat: improve error codes (ipfs/go-ipfs-cmds#168)
- Fix a typo (ipfs/go-ipfs-cmds#169)
- github.com/ipfs/go-ipfs-config (v0.0.3 -> v0.5.3):
- fix: correct the default-datastore config profile (ipfs/go-ipfs-config#80)
- feat: disable autonat service when in lowpower mode (ipfs/go-ipfs-config#77)
- feat: add and use a duration helper type (ipfs/go-ipfs-config#76)
- feat: add an autonat config section (ipfs/go-ipfs-config#75)
- feat: remove Routing.PrivateType (ipfs/go-ipfs-config#74)
- feat: add private routing config field (ipfs/go-ipfs-config#73)
- feat: mark badger as stable (ipfs/go-ipfs-config#70)
- feat: remove PreferTLS experiment (ipfs/go-ipfs-config#71)
- feat: remove old bootstrap peers (ipfs/go-ipfs-config#67)
- add config options for proxy/subdomain (ipfs/go-ipfs-config#30)
- feat: add graphsync option (ipfs/go-ipfs-config#62)
- profile: badger profile now defaults to asynchronous writes (ipfs/go-ipfs-config#60)
- migrate multiaddrs from /ipfs -> /p2p (ipfs/go-ipfs-config#39)
- use key size constraints defined in libp2p (ipfs/go-ipfs-config#57)
- plugins: don't omit empty config values (ipfs/go-ipfs-config#46)
- make it easier to detect an uninitialized repo (ipfs/go-ipfs-config#45)
- nit: omit empty plugin values (ipfs/go-ipfs-config#44)
- add plugins config section (ipfs/go-ipfs-config#43)
- Add very basic (possibly temporary) Provider configs (ipfs/go-ipfs-config#38)
- fix string formatting of bootstrap peers (ipfs/go-ipfs-config#37)
- migrate to the consolidated libp2p (ipfs/go-ipfs-config#36)
- Add strategic provider system experiment flag (ipfs/go-ipfs-config#33)
- github.com/ipfs/go-ipfs-files (v0.0.3 -> v0.0.8):
- skip ignored files when calculating size (ipfs/go-ipfs-files#30)
- Feat/add ignore rules (ipfs/go-ipfs-files#26)
- revert(symlink): keep stat argument (ipfs/go-ipfs-files#23)
- feat: correctly report the size of symlinks (ipfs/go-ipfs-files#22)
- serialfile: fix handling of hidden paths on windows (ipfs/go-ipfs-files#21)
- feat: add WriteTo function (ipfs/go-ipfs-files#20)
- doc: fix formdata documentation (ipfs/go-ipfs-files#19)
- github.com/ipfs/go-ipfs-pinner (v0.0.1 -> v0.0.4):
- fix: don't hold the pin lock while updating pins (ipfs/go-ipfs-pinner#2)
- github.com/ipfs/go-ipfs-pq (v0.0.1 -> v0.0.2):
- Remove() (ipfs/go-ipfs-pq#5)
- Fix Peek() test (ipfs/go-ipfs-pq#4)
- add Peek() method (ipfs/go-ipfs-pq#3)
- add gomod support // tag v0.0.1. (ipfs/go-ipfs-pq#1)
- github.com/ipfs/go-ipfs-routing (v0.0.1 -> v0.1.0):
- migrate to go-libp2p-core (ipfs/go-ipfs-routing#22)
- github.com/ipfs/go-ipld-cbor (v0.0.2 -> v0.0.4):
- doc: add a lead maintainer (ipfs/go-ipld-cbor#65)
- fastpath CBOR (ipfs/go-ipld-cbor#64)
- github.com/ipfs/go-ipld-format (v0.0.2 -> v0.2.0):
- fix: change the batch size to avoid buffering too much (ipfs/go-ipld-format#56)
- doc: add a lead maintainer (ipfs/go-ipld-format#54)
- github.com/ipfs/go-ipld-git (v0.0.2 -> v0.0.3):
- Use RFC3339 to format dates, fixes #16 (ipfs/go-ipld-git#32)
- doc: add a lead maintainer (ipfs/go-ipld-git#41)
- github.com/ipfs/go-ipns (v0.0.1 -> v0.0.2):
- readme: add a lead maintainer (ipfs/go-ipns#25)
- github.com/ipfs/go-log (v0.0.1 -> v1.0.4):
- add IPFS_* env vars back for transitionary release of go-log (ipfs/go-log#67)
- Experimental: zap backend for go-log (ipfs/go-log#61)
- Spelling fix (ipfs/go-log#63)
- Deprecate EventLogging and Warning* functions (ipfs/go-log#62)
- github.com/ipfs/go-merkledag (v0.0.3 -> v0.3.2):
- fix: correctly construct sessions (ipfs/go-merkledag#56)
- Migrate dagutils from go-ipfs (ipfs/go-merkledag#50)
- Make getPBNode Public (ipfs/go-merkledag#49)
- Pull In Upstream Changes (ipfs/go-merkledag#1)
- fix: slightly reduce memory usage when walking large directory trees (ipfs/go-merkledag#45)
- fix: return ErrLinkNotFound when the link isn't found (ipfs/go-merkledag#44)
- fix: include root in searches by default (ipfs/go-merkledag#43)
- rework the graph walking functions with functional options (ipfs/go-merkledag#42)
- fix inconsistent EnumerateChildrenAsync behavior (ipfs/go-merkledag#41)
- github.com/ipfs/go-mfs (v0.0.7 -> v0.1.1):
- migrate to go-libp2p-core (ipfs/go-mfs#77)
- github.com/ipfs/go-peertaskqueue (v0.0.5-f09820a0a5b6 -> v0.2.0):
- Extend peer task queue to work with want-have / want-block (ipfs/go-peertaskqueue#8)
- migrate to go-libp2p-core (ipfs/go-peertaskqueue#4)
- github.com/ipfs/go-unixfs (v0.0.6 -> v0.2.4):
- fix: fix a panic when deleting (ipfs/go-unixfs#81)
- fix(dagreader): remove a buggy workaround for a gateway issue (ipfs/go-unixfs#80)
- fix: correctly handle symlink file sizes (ipfs/go-unixfs#78)
- fix: return the correct error from RemoveChild (ipfs/go-unixfs#76)
- update the the last go-merkledag (ipfs/go-unixfs#75)
- fix: enumerate children (ipfs/go-unixfs#74)
- github.com/ipfs/interface-go-ipfs-core (v0.0.8 -> v0.2.7):
- Add pin ls tests for indirect pin traversal and pin type precedence (ipfs/interface-go-ipfs-core#47)
- fix(test): fix a flaky pubsub test (ipfs/interface-go-ipfs-core#45)
- README: stub (ipfs/interface-go-ipfs-core#44)
- test: test ReadAt if implemented (ipfs/interface-go-ipfs-core#43)
- test: fix put with hash test (ipfs/interface-go-ipfs-core#41)
- Bump go-libp2p-core, up test key size to 2048 (ipfs/interface-go-ipfs-core#39)
- migrate to go-libp2p-core. (ipfs/interface-go-ipfs-core#35)
- tests: expose TestSuite (ipfs/interface-go-ipfs-core#34)
- github.com/libp2p/go-libp2p (v0.0.32 -> v0.8.2):
- fix: keep observed addrs alive as long as their associated connections are alive (libp2p/go-libp2p#899)
- fix: refactor logic for identifying connections (libp2p/go-libp2p#898)
- fix: reduce log level of a noisy log line (libp2p/go-libp2p#889)
- [discovery] missing defer .Stop on ticker (libp2p/go-libp2p#888)
- deprioritize unspecified addresses in mock connections (libp2p/go-libp2p#887)
- feat: support TLS by default (libp2p/go-libp2p#884)
- Expose option for setting autonat throttling (libp2p/go-libp2p#882)
- Clearer naming of nat override options (libp2p/go-libp2p#878)
- fix: set the private key when constructing the autonat service (libp2p/go-libp2p#853)
- Signal address change (libp2p/go-libp2p#851)
- fix multiple issues in the mock tests (libp2p/go-libp2p#850)
- fix: minimal autonat dialer (libp2p/go-libp2p#849)
- Trigger Autorelay on NAT events (libp2p/go-libp2p#807)
- Local addr updated event (libp2p/go-libp2p#847)
- feat(mock): reliable notifications (libp2p/go-libp2p#836)
- doc(options): fix autorelay documentation (libp2p/go-libp2p#835)
- change PrivateNetwork to accept a PSK, update constructor magic (libp2p/go-libp2p#796)
- docs: Update the README (libp2p/go-libp2p#827)
- fix: remove an unnecessary goroutine (libp2p/go-libp2p#820)
- EnableAutoRelay should work without ContentRouting if there are StaticRelays defined (libp2p/go-libp2p#810)
- Use of mux.ErrReset in mocknet (libp2p/go-libp2p#815)
- docs: uniform comment sentences (libp2p/go-libp2p#826)
- enable non-public address port mapping announcement (libp2p/go-libp2p#771)
- fix: demote stream deadline errors to debug logs (libp2p/go-libp2p#768)
- small grammar fixes and updates to readme (libp2p/go-libp2p#743)
- Identify: Make activation threshold configurable (libp2p/go-libp2p#740)
- better user-agent handling (libp2p/go-libp2p#702)
- Update deps, mocknet tests (libp2p/go-libp2p#697)
- autorelay: ensure candidate relays can hop (libp2p/go-libp2p#696)
- We don't use
cs
here, drop it. (libp2p/go-libp2p#682) - Fix racy and failing test cases. (libp2p/go-libp2p#674)
- fix: use the goprocess for closing (libp2p/go-libp2p#669)
- update package table after -core refactor (libp2p/go-libp2p#661)
- basic_host: ensure we close correctly when the context is canceled (libp2p/go-libp2p#656)
- Add go-libp2p-gostream and go-libp2p-http to readme (libp2p/go-libp2p#655)
- github.com/libp2p/go-libp2p-autonat (v0.0.6 -> v0.2.2):
- Run Autonat Service while in unknown connectivity mode (libp2p/go-libp2p-autonat#75)
- Add option to force nat into a specified reachability state (libp2p/go-libp2p-autonat#55)
- Merge Autonat-svc (libp2p/go-libp2p-autonat#54)
- change autonat interface to use functional options (libp2p/go-libp2p-autonat#53)
- Limiting autonat service responses/startup (libp2p/go-libp2p-autonat#45)
- Emit events when NAT status changes (libp2p/go-libp2p-autonat#37)
- Take eventbus events to completion (libp2p/go-libp2p-autonat#38)
- Add missing syntax to autonat.proto (libp2p/go-libp2p-autonat#26)
- full close the autonat stream (libp2p/go-libp2p-autonat#20)
- reduce dialback timeout to 15s (libp2p/go-libp2p-autonat#17)
- Extract service implementation from go-libp2p-autonat (libp2p/go-libp2p-autonat#1)
- github.com/libp2p/go-libp2p-circuit (v0.0.9 -> v0.2.2):
- fix: don't abort accept when accepting a single connection fails (libp2p/go-libp2p-circuit#107)
- Revert "feat: functional options" (libp2p/go-libp2p-circuit#103)
- feat: remove relay discovery and unspecified relay dialing (libp2p/go-libp2p-circuit#101)
- move protocol definitions to go-multiaddr (libp2p/go-libp2p-circuit#81)
- return the full address from conn.RemoteMultiaddr (libp2p/go-libp2p-circuit#80)
- expose CanHop as a module function (libp2p/go-libp2p-circuit#79)
- github.com/libp2p/go-libp2p-discovery (v0.0.5 -> v0.4.0):
- Fix race with reuse of randomness (libp2p/go-libp2p-discovery#54)
- Add Backoff Cache Discovery (libp2p/go-libp2p-discovery#26)
- Discovery based Content Routing (libp2p/go-libp2p-discovery#27)
- github.com/libp2p/go-libp2p-kad-dht (v0.0.15 -> v0.7.10):
- fix: avoid blocking when bootstrapping (libp2p/go-libp2p-kad-dht#610)
- fix: re-validate peers whenever their state changes (libp2p/go-libp2p-kad-dht#607)
- intercept failing query events when finding providers (libp2p/go-libp2p-kad-dht#603)
- feat: set provider manager options (libp2p/go-libp2p-kad-dht#593)
- fix: optimize debug logging a bit (libp2p/go-libp2p-kad-dht#598)
- stricter definition of public for DHT (libp2p/go-libp2p-kad-dht#596)
- feat: reduce allocations (libp2p/go-libp2p-kad-dht#588)
- query.go: Remove shuffle comment (libp2p/go-libp2p-kad-dht#586)
- fix: optimize isRelay (libp2p/go-libp2p-kad-dht#585)
- feat: expose WANActive (libp2p/go-libp2p-kad-dht#580)
- fix: improve error handling in dual dht (libp2p/go-libp2p-kad-dht#582)
- fix: dedup addresses (libp2p/go-libp2p-kad-dht#581)
- Fix bug in periodic peer pinging (libp2p/go-libp2p-kad-dht#579)
- Dual DHT scaffold (libp2p/go-libp2p-kad-dht#570)
- fix: linting fixes (libp2p/go-libp2p-kad-dht#578)
- fix: remove local provider check (libp2p/go-libp2p-kad-dht#577)
- fix: use the routing table filter (libp2p/go-libp2p-kad-dht#576)
- fix: handle empty keys (libp2p/go-libp2p-kad-dht#562)
- Set record handlers for the default protocol prefix (libp2p/go-libp2p-kad-dht#560)
- fix incorrect error handling during provider record lookups (libp2p/go-libp2p-kad-dht#554)
- Proposed DHTv2 Changes (libp2p/go-libp2p-kad-dht#473)
- fix: obey the context when sending messages to peers (libp2p/go-libp2p-kad-dht#462)
- Close context correctly (libp2p/go-libp2p-kad-dht#477)
- add benchmark for handleFindPeer (libp2p/go-libp2p-kad-dht#475)
- give views names again (libp2p/go-libp2p-kad-dht#474)
- metrics: record message/request event even in case of error (libp2p/go-libp2p-kad-dht#464)
- fix(dialqueue): fix a timer leak (libp2p/go-libp2p-kad-dht#466)
- fix(query): cancel the context when the query finishes (libp2p/go-libp2p-kad-dht#467)
- fix(providers): upgrade warnings to errors (libp2p/go-libp2p-kad-dht#455)
- Make the Routing Table's latency tolerance configurable. (libp2p/go-libp2p-kad-dht#454)
- Adjust cluster level while encoding as well (libp2p/go-libp2p-kad-dht#445)
- Remove incorrect doc (libp2p/go-libp2p-kad-dht#443)
- feat: reduce stream idle timeout to 1m (libp2p/go-libp2p-kad-dht#441)
- Provider records use multihashes instead of CIDs (libp2p/go-libp2p-kad-dht#422)
- Fix flaky TestEmptyTableTest (libp2p/go-libp2p-kad-dht#433)
- Refresh cpl's in dht (libp2p/go-libp2p-kad-dht#428)
- fix: always send the result channel when triggering a refresh (libp2p/go-libp2p-kad-dht#425)
- feat: allow disabling value and provider storage/messages (libp2p/go-libp2p-kad-dht#400)
- fix: prioritize closer peers (libp2p/go-libp2p-kad-dht#424)
- fix: try to re-add existing peers when the routing table is empty (libp2p/go-libp2p-kad-dht#420)
- feat: refresh and wait (libp2p/go-libp2p-kad-dht#418)
- Make max record age configurable (libp2p/go-libp2p-kad-dht#410)
- fix and simplify some bootstrapping logic (libp2p/go-libp2p-kad-dht#405)
- feat(bootstrap): take autobootstrap to completion (libp2p/go-libp2p-kad-dht#403)
- Feature/correct bootstrapping (libp2p/go-libp2p-kad-dht#384)
- Update tests to use Ed25519 when acceptable. (libp2p/go-libp2p-kad-dht#380)
- Add timeout (libp2p/go-libp2p-kad-dht#351)
- Feat/message size (libp2p/go-libp2p-kad-dht#353)
- reduce background goroutines (libp2p/go-libp2p-kad-dht#340)
- github.com/libp2p/go-libp2p-kbucket (v0.1.1 -> v0.4.1):
- fix: use time.Duration for time, not floats (libp2p/go-libp2p-kbucket#76)
- Add LastUsefulAt and LastSuccessfulQueryAt for each peer (libp2p/go-libp2p-kbucket#75)
- fix: correctly track CPLs of never refreshed buckets (libp2p/go-libp2p-kbucket#71)
- Get Peer Infos (libp2p/go-libp2p-kbucket#69)
- fix: use accurate bucket logic (libp2p/go-libp2p-kbucket#64)
- Replace dead peers & increase replacement cache size (libp2p/go-libp2p-kbucket#59)
- Kbucket refactoring for Content Routing (libp2p/go-libp2p-kbucket#54)
- Disassociate RT membership from connectivity (libp2p/go-libp2p-kbucket#50)
- Unit Test for the util.Closer function (libp2p/go-libp2p-kbucket#48)
- Refresh Cpl's, not buckets (libp2p/go-libp2p-kbucket#46)
- Fix NearestPeers Doc (libp2p/go-libp2p-kbucket#45)
- fix: when the target bucket is empty or low, pull from all other buckets (libp2p/go-libp2p-kbucket#43)
- readme: replace IPFS contrib links with libp2p (libp2p/go-libp2p-kbucket#34)
- k-bucket support for peoper kad bootstrapping (libp2p/go-libp2p-kbucket#38)
- Fix bootstrapping id generation logic (libp2p/go-libp2p-kbucket#1)
- fix: avoid hashing under a lock (libp2p/go-libp2p-kbucket#31)
- dep: use a faster sha256 library (libp2p/go-libp2p-kbucket#32)
- Remove a lot of allocations, and fix some ambiguous naming (libp2p/go-libp2p-kbucket#30)
- github.com/libp2p/go-libp2p-mplex (v0.1.1 -> v0.2.3):
- Respect mux.ErrReset (libp2p/go-libp2p-mplex#9)
- github.com/libp2p/go-libp2p-nat (v0.0.4 -> v0.0.6):
- typo and changed deprecated method (libp2p/go-libp2p-nat#26)
- nit: fix log format (libp2p/go-libp2p-nat#19)
- fix: remove notifier (libp2p/go-libp2p-nat#18)
- github.com/libp2p/go-libp2p-peerstore (v0.0.6 -> v0.2.3):
- fix: handle nil peer IDs (libp2p/go-libp2p-peerstore#88)
- Fix memory store signed peer record bug (libp2p/go-libp2p-peerstore#133)
- fix: make closing the in-memory peerstore actually close it (libp2p/go-libp2p-peerstore#131)
- Correct path to peer.AddrInfo in deprecation (libp2p/go-libp2p-peerstore#124)
- fix multiple TTL bugs (libp2p/go-libp2p-peerstore#92)
- reduce allocations when adding addrs (libp2p/go-libp2p-peerstore#86)
- test: add metadata test (libp2p/go-libp2p-peerstore#82)
- set map in constructor (libp2p/go-libp2p-peerstore#81)
- improve interning (libp2p/go-libp2p-peerstore#79)
- github.com/libp2p/go-libp2p-pnet (v0.0.1 -> v0.2.0):
- remove key serialization, construct conn from ipnet.PSK (libp2p/go-libp2p-pnet#32)
- remove dependency on go-multicodec (libp2p/go-libp2p-pnet#26)
- github.com/libp2p/go-libp2p-pubsub (v0.0.3 -> v0.2.7):
- Replace LRU cache blacklist implementation with a time cache (libp2p/go-libp2p-pubsub#258)
- Configurable size of validate queue (libp2p/go-libp2p-pubsub#255)
- Rename VaidatorData to ValidatorData (libp2p/go-libp2p-pubsub#251)
- Configurable message id function (libp2p/go-libp2p-pubsub#248)
- tracing support (libp2p/go-libp2p-pubsub#227)
- add ValidatorData field to Message (libp2p/go-libp2p-pubsub#231)
- Configurable outbound peer queue sizes (libp2p/go-libp2p-pubsub#230)
- Topic handler bug fixes (libp2p/go-libp2p-pubsub#225)
- Add Discovery (libp2p/go-libp2p-pubsub#184)
- Expose the peer that propagates a message to the recipient (libp2p/go-libp2p-pubsub#218)
- gossip methods: renames and predicate adjustment (libp2p/go-libp2p-pubsub#204)
- godocs: clarify config params of MessageCache. (libp2p/go-libp2p-pubsub#205)
- minor bug fix: on join, source peers from gossip[topic] if insufficient peers in fanout[topic] (libp2p/go-libp2p-pubsub#196)
- add PubSub's context to Subscription (libp2p/go-libp2p-pubsub#201)
- Add the ability to handle newly subscribed peers (libp2p/go-libp2p-pubsub#190)
- Fix gossipsub race condition for heartbeat (libp2p/go-libp2p-pubsub#188)
- github.com/libp2p/go-libp2p-pubsub-router (v0.0.3 -> v0.2.1):
- fix: ignore bad peers when fetching the latest value (libp2p/go-libp2p-pubsub-router#54)
- fix: rename MinimalPubsub -> Pubsub interface and improve docs (libp2p/go-libp2p-pubsub-router#52)
- Use Minimal PubSub Interface Instead Of Full PubSub Router (libp2p/go-libp2p-pubsub-router#51)
- Remove bootstrapping code (libp2p/go-libp2p-pubsub-router#37)
- readme: replace IPFS contrib links with libp2p (libp2p/go-libp2p-pubsub-router#34)
- Add Persistence Layer on top of PubSub (libp2p/go-libp2p-pubsub-router#33)
- Subscribe to PubSub topic before Publishing (libp2p/go-libp2p-pubsub-router#30)
- PutValue not blocked by Provide during bootstrapping (libp2p/go-libp2p-pubsub-router#29)
- github.com/libp2p/go-libp2p-quic-transport (v0.0.3 -> v0.3.5):
- add command line client and server (libp2p/go-libp2p-quic-transport#139)
- write qlogs to a temporary file first, then rename them when done (libp2p/go-libp2p-quic-transport#136)
- export qlogs when the QLOGDIR env variable is set (libp2p/go-libp2p-quic-transport#129)
- fix: avoid dialing/listening on dns addresses (libp2p/go-libp2p-quic-transport#131)
- use a stateless reset key derived from the private key (libp2p/go-libp2p-quic-transport#122)
- add support for multiaddr filtering (libp2p/go-libp2p-quic-transport#125)
- use the resolved address for RemoteMultiaddr() (libp2p/go-libp2p-quic-transport#127)
- accept a PSK in the transport constructor (and reject it) (libp2p/go-libp2p-quic-transport#111)
- update quic-go to v0.15.0 (libp2p/go-libp2p-quic-transport#114)
- increase the stream and connection receive windows (libp2p/go-libp2p-quic-transport#108)
- fix key comparisons in tests (libp2p/go-libp2p-quic-transport#110)
- make reuse work on Windows (libp2p/go-libp2p-quic-transport#83)
- add a LICENSE (libp2p/go-libp2p-quic-transport#78)
- Use specific netlink families for android (libp2p/go-libp2p-quic-transport#75)
- implement a garbage-collector for unused reuse connections (libp2p/go-libp2p-quic-transport#73)
- implement connection reuse (libp2p/go-libp2p-quic-transport#63)
- update the README (libp2p/go-libp2p-quic-transport#69)
- use the handshake logic from go-libp2p-tls (libp2p/go-libp2p-quic-transport#67)
- update quic-go to v0.12.0 (supporting QUIC draft-22) (libp2p/go-libp2p-quic-transport#68)
- when ListenUDP fails once, try again next time (libp2p/go-libp2p-quic-transport#59)
- github.com/libp2p/go-libp2p-record (v0.0.1 -> v0.1.2):
- readme: replace IPFS contrib links with libp2p (libp2p/go-libp2p-record#25)
- Use peer ID utilities to go from pubkey to peer ID (libp2p/go-libp2p-record#26)
- github.com/libp2p/go-libp2p-routing-helpers (v0.0.2 -> v0.2.2):
- doc: document all types (libp2p/go-libp2p-routing-helpers#40)
- fix: fetch all providers when count is 0 (libp2p/go-libp2p-routing-helpers#39)
- feat: implement io.Closer (libp2p/go-libp2p-routing-helpers#37)
- readme: replace IPFS contrib links with libp2p (libp2p/go-libp2p-routing-helpers#21)
- github.com/libp2p/go-libp2p-secio (v0.0.3 -> v0.2.2):
- feat: remove sha1 hmac (libp2p/go-libp2p-secio#64)
- readme: add context and links (libp2p/go-libp2p-secio#55)
- Update to latest go-libp2p-core, update tests (libp2p/go-libp2p-secio#54)
- Remove support for blowfish (libp2p/go-libp2p-secio#52)
- fix: wait for handshake to complete before returning (libp2p/go-libp2p-secio#50)
- avoid holding the message writer longer than necessary (libp2p/go-libp2p-secio#49)
- github.com/libp2p/go-libp2p-swarm (v0.0.7 -> v0.2.3):
- don't expire backoffs until 2x backoff period (libp2p/go-libp2p-swarm#193)
- fix: slightly simplify backoff logic (libp2p/go-libp2p-swarm#192)
- change backoffs to per-address (libp2p/go-libp2p-swarm#191)
- fix: set teardown after storing the context (libp2p/go-libp2p-swarm#190)
- feat: handle no addresses (libp2p/go-libp2p-swarm#185)
- fix: make sure to include peer in dial error (libp2p/go-libp2p-swarm#180)
- Don't drop connections when simultaneous dialing occurs (libp2p/go-libp2p-swarm#174)
- fix: fire a listen close event when closing the listener (libp2p/go-libp2p-swarm#164)
- Link to godocs for Host instead of deprecated repo (libp2p/go-libp2p-swarm#137)
- improve dial errors (libp2p/go-libp2p-swarm#145)
- Minor Docstring correction (libp2p/go-libp2p-swarm#143)
- test: close peerstore when closing the test swarm (libp2p/go-libp2p-swarm#139)
- fix listen addrs race (libp2p/go-libp2p-swarm#136)
- logging: make the swarm less noisy (libp2p/go-libp2p-swarm#131)
- feat: cache interface addresses for 1 minute (libp2p/go-libp2p-swarm#129)
- github.com/libp2p/go-libp2p-tls (v0.0.2 -> v0.1.3):
- Readme: link to the libp2p-core docs (libp2p/go-libp2p-tls#36)
- expose the function to derive the peer's public key from the cert chain (libp2p/go-libp2p-tls#33)
- set an ALPN value in the tls.Config (libp2p/go-libp2p-tls#32)
- github.com/libp2p/go-libp2p-transport-upgrader (v0.0.4 -> v0.2.0):
- use the ipnet.PSK instead of the ipnet.Protector for private networks (libp2p/go-libp2p-transport-upgrader#45)
- readme: add context & fix example code (libp2p/go-libp2p-transport-upgrader#26)
- fix an incorrect error message (libp2p/go-libp2p-transport-upgrader#27)
- Consolidate abstractions and core types into go-libp2p-core (#28) (libp2p/go-libp2p-transport-upgrader#22)
- github.com/libp2p/go-libp2p-yamux (v0.1.3 -> v0.2.7):
- Respect mux.ErrReset (libp2p/go-libp2p-yamux#10)
- github.com/libp2p/go-maddr-filter (v0.0.4 -> v0.0.5):
- fix: check for blocked addrs without allocating (libp2p/go-maddr-filter#14)
- github.com/libp2p/go-mplex (v0.0.4 -> v0.1.2):
- remove deprecated log.Warning(f) (libp2p/go-mplex#65)
- Remove dependency on go-libp2p-core and introduce new errors. (libp2p/go-mplex#72)
- Bump lodash from 4.17.5 to 4.17.15 in /interop/js (libp2p/go-mplex#66)
- add test for deadlines (libp2p/go-mplex#60)
- github.com/libp2p/go-msgio (v0.0.2 -> v0.0.4):
- make the maximum message size configurable (libp2p/go-msgio#15)
- combine writes and avoid a few more allocations (libp2p/go-msgio#14)
- avoid allocating unless we need to (libp2p/go-msgio#13)
- github.com/libp2p/go-nat (v0.0.3 -> v0.0.5):
- feat: switch to go-netroute (libp2p/go-nat#19)
- fix: really obey the context (libp2p/go-nat#13)
- don't mask context (libp2p/go-nat#10)
- github.com/libp2p/go-reuseport-transport (v0.0.2 -> v0.0.3):
- fix: less confusing log message (libp2p/go-reuseport-transport#22)
- readme: replace IPFS contrib links with libp2p (libp2p/go-reuseport-transport#16)
- replace gx instructions with note about gomod (libp2p/go-reuseport-transport#15)
- github.com/libp2p/go-tcp-transport (v0.0.4 -> v0.2.0):
- fix: don't allow dialing DNS addresses (libp2p/go-tcp-transport#61)
- Use new constructor for insecure transport in tests (libp2p/go-tcp-transport#42)
- readme: add install, usage & addressing info (libp2p/go-tcp-transport#41)
- github.com/libp2p/go-ws-transport (v0.0.6 -> v0.3.1):
- fix: add read/write locks (libp2p/go-ws-transport#85)
- fix: restrict dials to IP + TCP (libp2p/go-ws-transport#84)
- Revert "add mutex for write/close" (libp2p/go-ws-transport#73)
- feat: faster copy in wasm (libp2p/go-ws-transport#68)
- Add WebAssembly support and the ability to Dial from browsers (libp2p/go-ws-transport#55)
- fix: close gracefully (libp2p/go-ws-transport#54)
- move multiaddr protocol definitions to go-multiaddr (libp2p/go-ws-transport#52)
- Add install, usage & addressing info to README (libp2p/go-ws-transport#49)
- github.com/libp2p/go-yamux (v1.2.3 -> v1.3.5):
- fix: synchronize when resetting the keepalive timer (libp2p/go-yamux#21)
- fix: don't keepalive when the connection is busy (libp2p/go-yamux#16)
- Rename errors (libp2p/go-yamux#14)
- fix(stream): set writeDeadline when cleanup and forceClose (libp2p/go-yamux#12)
- fixes a stream deadlock multiple ways (libp2p/go-yamux#8)
Contributor | Commits | Lines ± | Files Changed |
---|---|---|---|
Steven Allen | 858 | +27833/-15919 | 1906 |
Dirk McCormick | 134 | +18058/-8347 | 282 |
Aarsh Shah | 83 | +13458/-11883 | 241 |
Adin Schmahmann | 144 | +11878/-6236 | 397 |
Raúl Kripalani | 94 | +6894/-10214 | 598 |
vyzo | 60 | +8923/-1160 | 102 |
Will Scott | 79 | +3776/-1467 | 175 |
Michael Muré | 29 | +1734/-3290 | 104 |
dependabot[bot] | 365 | +3419/-361 | 728 |
Hector Sanjuan | 64 | +2053/-1321 | 132 |
Marten Seemann | 52 | +1922/-1268 | 147 |
Michael Avila | 29 | +828/-1733 | 70 |
Peter Rabbitson | 53 | +1073/-1197 | 100 |
Yusef Napora | 36 | +1610/-378 | 57 |
hannahhoward | 16 | +1342/-559 | 61 |
Łukasz Magiera | 9 | +277/-1623 | 41 |
Marcin Rataj | 9 | +1686/-99 | 32 |
Will | 7 | +936/-709 | 34 |
Alex Browne | 27 | +1019/-503 | 46 |
David Dias | 30 | +987/-431 | 43 |
Jakub Sztandera | 43 | +912/-436 | 77 |
Cole Brown | 21 | +646/-398 | 57 |
Oli Evans | 29 | +488/-466 | 43 |
Cornelius Toole | 3 | +827/-60 | 20 |
Hlib | 15 | +331/-185 | 28 |
Adrian Lanzafame | 9 | +123/-334 | 18 |
Petar Maymounkov | 1 | +385/-48 | 5 |
Alan Shaw | 18 | +262/-146 | 35 |
lnykww | 1 | +303/-52 | 6 |
Hannah Howard | 1 | +198/-27 | 3 |
Dominic Della Valle | 9 | +163/-52 | 14 |
Adam Uhlir | 1 | +211/-2 | 3 |
Dimitris Apostolou | 1 | +105/-105 | 64 |
Frrist | 1 | +186/-18 | 5 |
Henrique Dias | 22 | +119/-28 | 22 |
Gergely Tabiczky | 5 | +74/-60 | 7 |
Matt Joiner | 2 | +63/-62 | 4 |
@RubenKelevra | 12 | +46/-55 | 12 |
whyrusleeping | 6 | +87/-11 | 7 |
deepakgarg | 4 | +42/-43 | 4 |
protolambda | 2 | +49/-17 | 9 |
hucg | 2 | +47/-11 | 3 |
Arber Avdullahu | 3 | +31/-27 | 3 |
Sameer Puri | 1 | +46/-4 | 2 |
Hucg | 3 | +17/-33 | 3 |
Guilhem Fanton | 2 | +29/-10 | 7 |
Christian Muehlhaeuser | 6 | +20/-19 | 14 |
Djalil Dreamski | 3 | +27/-9 | 3 |
Caian | 2 | +36/-0 | 2 |
Topper Bowers | 2 | +31/-4 | 4 |
flowed | 1 | +16/-16 | 11 |
Vibhav Pant | 4 | +21/-10 | 5 |
frrist | 1 | +26/-4 | 1 |
Hlib Kanunnikov | 1 | +25/-3 | 1 |
george xie | 3 | +12/-15 | 11 |
optman | 1 | +13/-9 | 1 |
Roman Proskuryakov | 1 | +11/-11 | 2 |
Vasco Santos | 1 | +10/-10 | 5 |
Pretty Please Mark Darkly | 2 | +16/-2 | 2 |
Piotr Dyraga | 2 | +15/-2 | 2 |
Andrew Nesbitt | 1 | +5/-11 | 5 |
postables | 4 | +19/-8 | 4 |
Jim McDonald | 2 | +13/-1 | 2 |
PoorPockets McNewHold | 1 | +12/-0 | 1 |
Henri S | 1 | +6/-6 | 1 |
Igor Velkov | 1 | +8/-3 | 1 |
swedneck | 4 | +7/-3 | 4 |
Devin | 2 | +5/-5 | 4 |
iulianpascalau | 1 | +5/-3 | 2 |
MollyM | 3 | +7/-1 | 3 |
Jorropo | 2 | +5/-3 | 3 |
lukesolo | 1 | +6/-1 | 2 |
Wes Morgan | 1 | +3/-3 | 1 |
Kishan Mohanbhai Sagathiya | 1 | +3/-3 | 2 |
songjiayang | 1 | +4/-0 | 1 |
Terry Ding | 1 | +2/-2 | 1 |
Preston Van Loon | 2 | +3/-1 | 2 |
Jim Pick | 2 | +2/-2 | 2 |
Jakub Kaczmarzyk | 1 | +2/-2 | 1 |
Simon Menke | 2 | +2/-1 | 2 |
Jessica Schilling | 2 | +1/-2 | 2 |
Edgar Aroutiounian | 1 | +2/-1 | 1 |
hikerpig | 1 | +1/-1 | 1 |
ZenGround0 | 1 | +1/-1 | 1 |
Thomas Preindl | 1 | +1/-1 | 1 |
Sander Pick | 1 | +1/-1 | 1 |
Ronsor | 1 | +1/-1 | 1 |
Roman Khafizianov | 1 | +1/-1 | 1 |
Rod Vagg | 1 | +1/-1 | 1 |
Max Inden | 1 | +1/-1 | 1 |
Leo Arias | 1 | +1/-1 | 1 |
Kuro1 | 1 | +1/-1 | 1 |
Kirill Goncharov | 1 | +1/-1 | 1 |
John B Nelson | 1 | +1/-1 | 1 |
George Masgras | 1 | +1/-1 | 1 |
Aliabbas Merchant | 1 | +1/-1 | 1 |
Lorenzo Setale | 1 | +1/-0 | 1 |
Boris Mann | 1 | +1/-0 | 1 |
Given the large number of fixes merged since 0.4.22, we've decided to cut another patch release.
This release contains critical fixes. Please upgrade ASAP. Importantly, we're strongly considering switching to TLS by default in go-ipfs 0.5.0 and dropping SECIO support. However, the current TLS transport in go-ipfs 0.4.22 has a bug that can cause connections to spontaneously disconnect during the handshake.
This release fixes that bug, among many other issues. Users that don't upgrade may experience connectivity issues when the network upgrades to go-ipfs 0.5.0.
- Fixes build on go 1.13
- Fixes an issue where we may not connect to providers in bitswap.
- Fixes an issue on the TLS transport where we may abort a handshake unintentionally.
- Fixes a common panic in the websocket transport.
- Adds support for recursively resolving dnsaddrs (makes go-ipfs compatible with the new bootstrappers).
- Fixes several potential panics/crashes.
- Switches to using pre-defined autorelays instead of trying to find them in the DHT:
- Avoids selecting random, potentially poor, relays.
- Avoids spamming the DHT with requests trying to find relays.
- Reduces the impact of accidentally enabling AutoRelay + RelayHop. I.e., the network won't try to DoS you.
- Modifies the connection manager to not count connections in the grace period towards the connection limit.
- Pro: New connections don't cause us to close useful, existing connections.
- Con: Libp2p will keep more connections. Consider reducing your HighWater after applying this patch.
- Improved peer usefulness tracking in bitswap. Frequently used peers will be marked as "important" and the connection manager will avoid closing connections to these peers.
- Includes a new version of the WebUI to fix some issues with the peers map.
- github.com/ipfs/go-ipfs:
- feat: update the webui to fix some performance issues (ipfs/go-ipfs#6844)
- fix: limit SW registration to content root (ipfs/go-ipfs#6801)
- fix issue 6760, adding with hash-only, high CPU usage. (ipfs/go-ipfs#6764)
- fix(coreapi/add): close the fake repo used when adding with hash-only (ipfs/go-ipfs#6747)
- fix bug 6748 (ipfs/go-ipfs#6754)
- fix(pin): wait till after fetching to remove direct pin (ipfs/go-ipfs#6708)
- pin: fix pin update X Y where X==Y (ipfs/go-ipfs#6669)
- namesys: set the correct cache TTL on publish (ipfs/go-ipfs#6667)
- build: fix golangci again (ipfs/go-ipfs#6641)
- make: move all test deps to a separate module (ipfs/go-ipfs#6637)
- fix: close peerstore on stop (ipfs/go-ipfs#6629)
- build: fix build when we don't have a full git tree (ipfs/go-ipfs#6626)
- github.com/ipfs/go-bitswap (v0.0.8-cbb485998356 -> v0.0.8-e37498cf10d6):
- fix: wait until we finish connecting before we cancel the context (ipfs/go-bitswap#226)
- engine: tag peers based on usefulness (ipfs/go-bitswap#191)
- github.com/ipfs/go-cid (v0.0.2 -> v0.0.4):
- fix parsing issues and nits (ipfs/go-cid#97)
- Verify that prefix is correct v0 prefix (ipfs/go-cid#96)
- github.com/multiformats/go-multihash (v0.0.5 -> v0.0.10):
- Ensure that length of multihash is properly handled (multiformats/go-multihash#119)
- fix murmur3 name (multiformats/go-multihash#115)
- rename ID to IDENTITY (multiformats/go-multihash#113) (multiformats/go-multihash#119)
- github.com/libp2p/go-flow-metrics (v0.0.1 -> v0.0.3):
- fix bug in meter traversal logic (libp2p/go-flow-metrics#11)
- github.com/libp2p/go-libp2p (v0.0.28 -> v0.0.32):
- options to configure known relays for autorelay (libp2p/go-libp2p#705)
- feat(host): recursively resolve addresses (libp2p/go-libp2p#764)
- mdns: always use interface addresses (libp2p/go-libp2p#667)
- github.com/libp2p/go-libp2p-connmgr (v0.0.6 -> v0.2.1):
- don't count connections in the grace period against the limit (libp2p/go-libp2p-connmgr#50)
- github.com/libp2p/go-libp2p-kad-dht (v0.0.13 -> v0.0.15):
- metrics: fix memory leak (libp2p/go-libp2p-kad-dht#390)
- github.com/libp2p/go-libp2p-tls (v0.0.1 -> v0.0.2):
- close the underlying connection when the handshake fails (libp2p/go-libp2p-tls#39)
- make the error check for not receiving a public key more explicit (libp2p/go-libp2p-tls#34)
- Fix: Connection Closed after handshake (libp2p/go-libp2p-tls#37)
- github.com/libp2p/go-libp2p-swarm (v0.0.6 -> v0.0.7):
- fix: don't assume that transports implement stringer (libp2p/go-libp2p-swarm#134)
- github.com/libp2p/go-ws-transport (v0.0.4 -> v0.0.6):
- Add mutex for write/close (libp2p/go-ws-transport#65)
Other:
Update bloom filter libraries to remove unsound usage of the unsafe
package.
Contributor | Commits | Lines ± | Files Changed |
---|---|---|---|
Steven Allen | 52 | +1866/-578 | 102 |
vyzo | 12 | +167/-90 | 22 |
whyrusleeping | 5 | +136/-52 | 7 |
Roman Proskuryakov | 7 | +94/-7 | 10 |
Jakub Sztandera | 3 | +58/-13 | 7 |
hcg1314 | 2 | +31/-11 | 2 |
Raúl Kripalani | 2 | +7/-33 | 6 |
Marten Seemann | 3 | +27/-10 | 5 |
Marcin Rataj | 2 | +26/-0 | 5 |
b5 | 1 | +2/-22 | 1 |
Hector Sanjuan | 1 | +11/-0 | 1 |
Yusef Napora | 1 | +4/-0 | 1 |
We're releasing a PATCH release of go-ipfs based on 0.4.21 containing some critical fixes.
The IPFS network has scaled to the point where small changes can have a wide-reaching impact on the entire network. To keep this situation from escalating, we've put a hold on releasing new features until we can improve our release process (which we've trialed in this release) and testing procedures.
This release includes fixes for the following regressions:
- A major bitswap throughput regression introduced in 0.4.21 (ipfs/go-ipfs#6442).
- High bitswap CPU usage when connected to many (e.g. 10,000) peers. See ipfs/go-bitswap#154.
- The local network discovery service sometimes initializes before the networking module, causing it to announce the wrong addresses and sometimes complain about not being able to determine the IP address (ipfs/go-ipfs#6415).
It also includes fixes for:
- Pins not being persisted after
ipfs block add --pin
(ipfs/go-ipfs#6441). - Panic due to concurrent map access when adding and listing pins at the same time (ipfs/go-ipfs#6419).
- Potential pin-set corruption given a concurrent
ipfs repo gc
andipfs pin rm
(ipfs/go-ipfs#6444). - Build failure due to a deleted git tag in one of our dependencies (ipfs/go-ds-badger#64).
Thanks to:
- @hannahhoward for fixing both bitswap issues.
- @sanderpick for catching and fixing the local discovery bug.
- @campoy for fixing the build issue.
We're happy to announce go-ipfs 0.4.21. This release has some critical bug fixes and a handful of new features so every user should upgrade.
Key bug fixes:
- Too many open file descriptors/too many peers (#6237).
- Adding multiple files at the same time doesn't work (#6254).
- CPU utilization spikes and then holds at 100% (#5613).
Key features:
- Experimental TLS1.3 support (to eventually replace secio).
- OpenSSL support for SECIO handshakes (performance improvement).
IMPORTANT: This release fixes a bug in our security transport that could potentially drop data from the channel. Note: This issue affects neither the privacy nor the integrity of the data with respect to a third-party attacker. Only the peer sending us data could trigger this bug.
ALL USERS MUST UPGRADE. We intended to introduce a feature this release that, unfortunately, reliably triggered this bug. To avoid partitioning the network, we've decided to postpone this feature for a release or two.
Specifically, we're going to provide a minimum one month upgrade period. After that, we'll start testing the impact of deploying the proposed changes.
If you're running the mainline go-ipfs, please upgrade ASAP. If you're building a separate app or working on a forked go-ipfs, make sure to upgrade github.com/libp2p/go-libp2p-secio to at least v0.0.3.
First off, we'd like to give a shout-out to all contributors that participated in this release (including contributions to ipld, libp2p, and multiformats):
Contributor | Commits | Lines ± | Files Changed |
---|---|---|---|
Steven Allen | 220 | +6078/-4211 | 520 |
Łukasz Magiera | 53 | +5039/-4557 | 274 |
vyzo | 179 | +2929/-1704 | 238 |
Raúl Kripalani | 44 | +757/-1895 | 134 |
hannahhoward | 11 | +755/-1005 | 49 |
Marten Seemann | 16 | +862/-203 | 44 |
keks | 10 | +359/-110 | 12 |
Jan Winkelmann | 8 | +368/-26 | 16 |
Jakub Sztandera | 4 | +361/-8 | 7 |
Adrian Lanzafame | 1 | +287/-18 | 5 |
Erik Ingenito | 4 | +247/-28 | 8 |
Reid 'arrdem' McKenzie | 1 | +220/-20 | 3 |
Yusef Napora | 26 | +98/-130 | 26 |
Michael Avila | 3 | +116/-59 | 8 |
Raghav Gulati | 13 | +145/-26 | 13 |
tg | 1 | +41/-33 | 1 |
Matt Joiner | 6 | +41/-30 | 7 |
Cole Brown | 1 | +37/-25 | 1 |
Dominic Della Valle | 2 | +12/-40 | 4 |
Overbool | 1 | +50/-0 | 2 |
Christopher Buesser | 3 | +29/-16 | 10 |
myself659 | 1 | +38/-5 | 2 |
Alex Browne | 3 | +30/-8 | 3 |
jmank88 | 1 | +27/-4 | 2 |
Vikram | 1 | +25/-1 | 2 |
MollyM | 7 | +17/-9 | 7 |
Marcin Rataj | 1 | +17/-1 | 1 |
requilence | 1 | +11/-4 | 1 |
Teran McKinney | 1 | +8/-2 | 1 |
Oli Evans | 1 | +5/-5 | 1 |
Masashi Salvador Mitsuzawa | 1 | +5/-1 | 1 |
chenminjian | 1 | +4/-0 | 1 |
Edgar Lee | 1 | +3/-1 | 1 |
Dirk McCormick | 1 | +2/-2 | 2 |
ia | 1 | +1/-1 | 1 |
Alan Shaw | 1 | +1/-1 | 1 |
This release includes quite a number of critical bug fixes and performance/reliability enhancements.
The last release broke the simple command ipfs add file1 file2
. It turns out
we simply lacked a test case for this. Both of these issues (the bug and the
lack of a test case) have now been fixed.
As noted above, we've fixed a bug that could cause data to be dropped from a SECIO connection on read. Specifically, this happens when:
- The capacity of the read buffer is greater than the length.
- The remote peer sent more than the length but less than the capacity in a single secio "frame".
In this case, we'd fill the read buffer to it's capacity instead of its length.
Go-ipfs automatically closes the least useful connections when it accumulates
too many connections. Unfortunately, some relayed connections were blocking in
Close()
, halting the entire process.
Many users noted out of control CPU usage this release. This turned out to be a long-standing issue with how the DHT handled provider records (records recording which peers have what content):
- It wasn't removing provider records for content until the set of providers completely emptied.
- It was loading every provider record into memory whenever we updated the set of providers.
Combined, these two issues were trashing the provider record cache, forcing the DHT to repeatedly load and discard provider records.
Go-ipfs has a subsystem called the "connection manager" to close the least-useful connections when go-ipfs runs low on resources.
Unfortunately, other IPFS subsystems may learn about connections before the connection manager. Previously, if some IPFS subsystem tried to mark a connection as useful before the connection manager learned about it, the connection manager would discard this information. We believe this was causing #6271. It no longer does that.
Bitswap now uses the connection manager to mark all peers downloading blocks as important (while downloading). Previously, it only marked peers from which it was downloading blocks.
The most noticeable memory reduction in this release comes from fixing connection closing. However, we've made a few additional improvements:
- Bitswap's "work queue" no longer remembers every peer it has seen indefinitely.
- The peerstore now interns protocol names.
- The per-peer goroutine count has been reduced.
- The DHT now wastes less memory on idle peers by pooling buffered writers and returning them to the pool when not actively using them.
The default file descriptor limit has been raised to 8192 (from 2048). Unfortunately, go-ipfs behaves poorly when it runs out of file descriptors and it uses a lot of file descriptors.
Luckily, most modern kernels can handle thousands of file descriptors without any difficulty.
Libp2p now shaves off a couple of round trips when initiating connections by beginning the protocol negotiation before the remote peer responds to the initial handshake message.
In the optimal case (when the target peer speaks our preferred protocol), this reduces the number of handshake round-trips from 6 to 4 (including the TCP handshake).
This release brings no new commands but does introduce a few changes, bugfixes, and enhancements. This section is hardly complete but it lists the most noticeable changes.
Take note: this release also introduces a few breaking changes.
The experimental ipfs urlstore
command is now deprecated. Please use ipfs add --nocopy URL
instead.
When responding to an ipfs dht get
command, the daemon now encodes the
returned value using base64. The ipfs
command will automatically decode this
value before returning it to the user so this change should only affect those
using the HTTP API directly.
Unfortunately, this change was necessary as DHT records are arbitrary binary blobs which can't be directly stored in JSON strings.
Both js-ipfs and go-ipfs now encode CIDv1 CIDs using base32 by default, instead of base58. Unfortunately, base58 is case-sensitive and doesn't play well with browsers (see #4143.
The ipfs bitswap stat
and and ipfs object stat
commands now support a
--humanize
flag that formats numbers with human-readable units (GiB, MiB,
etc.).
This release improves two types of errors:
- Commands that take paths/multiaddrs now include the path/multiaddr in the error message when it fails to parse.
ipfs swarm connect
now returns a detailed error describing which addresses were tried and why the dial failed.
The ping command has received some small improvements and fixes:
- It now exits with a non-zero exit status on failure.
- It no longer succeeds with zero successful pings if we have a zombie but non-functional connection to the peer being pinged (#6298).
- It now prints out the average latency when canceled with
^C
(like the unixping
command).
Go-ipfs now intelligently wraps help text for easier reading. On an 80 character wide terminal,
Before
USAGE
ipfs add <path>... - Add a file or directory to ipfs.
SYNOPSIS
ipfs add [--recursive | -r] [--dereference-args] [--stdin-name=<stdin-name>] [
--hidden | -H] [--quiet | -q] [--quieter | -Q] [--silent] [--progress | -p] [--t
rickle | -t] [--only-hash | -n] [--wrap-with-directory | -w] [--chunker=<chunker
> | -s] [--pin=false] [--raw-leaves] [--nocopy] [--fscache] [--cid-version=<cid-
version>] [--hash=<hash>] [--inline] [--inline-limit=<inline-limit>] [--] <path>
...
ARGUMENTS
<path>... - The path to a file to be added to ipfs.
OPTIONS
-r, --recursive bool - Add directory paths recursive
ly.
--dereference-args bool - Symlinks supplied in argument
s are dereferenced.
--stdin-name string - Assign a name if the file sou
rce is stdin.
-H, --hidden bool - Include files that are hidden
. Only takes effect on recursive add.
-q, --quiet bool - Write minimal output.
-Q, --quieter bool - Write only final hash.
--silent bool - Write no output.
-p, --progress bool - Stream progress data.
-t, --trickle bool - Use trickle-dag format for da
g generation.
-n, --only-hash bool - Only chunk and hash - do not
write to disk.
-w, --wrap-with-directory bool - Wrap files with a directory o
bject.
-s, --chunker string - Chunking algorithm, size-[byt
es] or rabin-[min]-[avg]-[max]. Default: size-262144.
--pin bool - Pin this object when adding.
Default: true.
--raw-leaves bool - Use raw blocks for leaf nodes
. (experimental).
--nocopy bool - Add the file using filestore.
Implies raw-leaves. (experimental).
--fscache bool - Check the filestore for pre-e
xisting blocks. (experimental).
--cid-version int - CID version. Defaults to 0 un
less an option that depends on CIDv1 is passed. (experimental).
--hash string - Hash function to use. Implies
CIDv1 if not sha2-256. (experimental). Default: sha2-256.
--inline bool - Inline small blocks into CIDs
. (experimental).
--inline-limit int - Maximum block size to inline.
(experimental). Default: 32.
After
USAGE
ipfs add <path>... - Add a file or directory to ipfs.
SYNOPSIS
ipfs add [--recursive | -r] [--dereference-args] [--stdin-name=<stdin-name>]
[--hidden | -H] [--quiet | -q] [--quieter | -Q] [--silent]
[--progress | -p] [--trickle | -t] [--only-hash | -n]
[--wrap-with-directory | -w] [--chunker=<chunker> | -s] [--pin=false]
[--raw-leaves] [--nocopy] [--fscache] [--cid-version=<cid-version>]
[--hash=<hash>] [--inline] [--inline-limit=<inline-limit>] [--]
<path>...
ARGUMENTS
<path>... - The path to a file to be added to ipfs.
OPTIONS
-r, --recursive bool - Add directory paths recursively.
--dereference-args bool - Symlinks supplied in arguments are
dereferenced.
--stdin-name string - Assign a name if the file source is stdin.
-H, --hidden bool - Include files that are hidden. Only takes
effect on recursive add.
-q, --quiet bool - Write minimal output.
-Q, --quieter bool - Write only final hash.
--silent bool - Write no output.
-p, --progress bool - Stream progress data.
-t, --trickle bool - Use trickle-dag format for dag generation.
-n, --only-hash bool - Only chunk and hash - do not write to
disk.
-w, --wrap-with-directory bool - Wrap files with a directory object.
-s, --chunker string - Chunking algorithm, size-[bytes] or
rabin-[min]-[avg]-[max]. Default:
size-262144.
--pin bool - Pin this object when adding. Default:
true.
--raw-leaves bool - Use raw blocks for leaf nodes.
(experimental).
--nocopy bool - Add the file using filestore. Implies
raw-leaves. (experimental).
--fscache bool - Check the filestore for pre-existing
blocks. (experimental).
--cid-version int - CID version. Defaults to 0 unless an
option that depends on CIDv1 is passed.
(experimental).
--hash string - Hash function to use. Implies CIDv1 if
not sha2-256. (experimental). Default:
sha2-256.
--inline bool - Inline small blocks into CIDs.
(experimental).
--inline-limit int - Maximum block size to inline.
(experimental). Default: 32.
This release is primarily a bug fix release but it still includes two nice features from libp2p.
Go-ipfs now has experimental TLS1.3 support. Currently, libp2p (IPFS's networking library) uses a custom TLS-like protocol we call SECIO. However, the conventional wisdom concerning custom security transports is "just don't" so we are working on replacing it with TLS1.3
To choose this protocol by default, set the Experimental.PreferTLS
config
variable:
> ipfs config --bool Experimental.PreferTLS true
Why TLS1.3 and not X (noise, etc.)?
- Libp2p allows negotiating transports so there's no reason not to add noise support to libp2p as well.
- TLS has wide language support which should make implementing libp2p for new languages significantly simpler.
Go-ipfs can now (optionally) be built with OpenSSL support for improved performance when establishing connections. This is primarily useful for nodes receiving multiple inbound connections per second.
To enable openssl support, rebuild go-ipfs with:
> make build GOTAGS=openssl
The CoreAPI refactor is still underway and we've made significant progress towards a usable ipfs-as-a-library constructor. Specifically, we've integrated the fx dependency injection system and are now working on cleaning up our initialization logic. This should make it easier to inject new services into a go-ipfs process without messing with the core internals.
Build system now uses GOCC
environment variable allowing for use of specific
go versions during builds.
- github.com/ipfs/go-ipfs:
- fix: use http.Error for sending errors (ipfs/go-ipfs#6379)
- core: call app.Stop once (ipfs/go-ipfs#6380)
- explain what dhtclient does (ipfs/go-ipfs#6375)
- ci: actually enable golangci-lint (ipfs/go-ipfs#6362)
- commands/swarm(fix): handle empty multiaddrs (ipfs/go-ipfs#6355)
- feat: improve errors when a path fails to parse (ipfs/go-ipfs#6346)
- fix vendoring dependencies when building the source tarball (ipfs/go-ipfs#6349)
- core: Use correct default for connmgr lowWater (ipfs/go-ipfs#6352)
- doc: remove out of date documentation (ipfs/go-ipfs#6345)
- Add generation of dependency changes to mkreleaselog (ipfs/go-ipfs#6348)
- readme: remove mention of DCO (ipfs/go-ipfs#6344)
- Add golangci-lint (ipfs/go-ipfs#6321)
- docs+mk: update guidance for unsupported platforms (ipfs/go-ipfs#6338)
- fix formatting in object get (ipfs/go-ipfs#6340)
- fail start when loading a plugin fails (ipfs/go-ipfs#6339)
- fix a typo in the issue template (ipfs/go-ipfs#6335)
- github: turn issue template into a multiple-choice question (ipfs/go-ipfs#6333)
- object put: Allow empty objects (ipfs/go-ipfs#6330)
- Update fuse.md (ipfs/go-ipfs#6332)
- work towards fixing dht commands (ipfs/go-ipfs#6277)
- fix setting ulimit (ipfs/go-ipfs#6319)
- switch to base32 by default for CIDv1 (ipfs/go-ipfs#6300)
- cmdkit -> cmds (ipfs/go-ipfs#6318)
- raise default fd limit to 8192 (ipfs/go-ipfs#6266)
- pin: don't walk all pinned blocks when removing a non-existent pin (ipfs/go-ipfs#6311)
- ping: fix a bunch of issues (ipfs/go-ipfs#6312)
- test(coreapi): use a thread-safe datastore everywhere (ipfs/go-ipfs#6222)
- fix(Dockerfile): Allow ipfs mount in Docker container (ipfs/go-ipfs#5560)
- docs: fix Routing section (ipfs/go-ipfs#6309)
- License update to dual MIT and Apache 2 (ipfs/go-ipfs#6301)
- Go test fix (ipfs/go-ipfs#6293)
- commands(pin update): return resolved CIDs instead of paths (ipfs/go-ipfs#6275)
- core: fix autonat construction (ipfs/go-ipfs#6289)
- Test and fix GC/pin bug (ipfs/go-ipfs#6288)
- GOCC implementation & fix in make & build scripts (ipfs/go-ipfs#6282)
- gc: cancel context (ipfs/go-ipfs#6281)
- fix: windows friendly daemon help (ipfs/go-ipfs#6278)
- Invert constructor config handling (ipfs/go-ipfs#6276)
- docs: document environment variables (ipfs/go-ipfs#6268)
- add: Return error from iterator (ipfs/go-ipfs#6272)
- commands(feat): use the coreapi in the urlstore command (ipfs/go-ipfs#6259)
- humanize for ipfs bitswap stat (ipfs/go-ipfs#6258)
- Revert "raise default fd limit to 8192" (ipfs/go-ipfs#6265)
- raise default fd limit to 8192 (ipfs/go-ipfs#6261)
- Fix AutoNAT service for private network (ipfs/go-ipfs#6251)
- add: Fix adding multiple files (ipfs/go-ipfs#6255)
- reprovider: Use goprocess (ipfs/go-ipfs#6248)
- core/corehttp/gateway_handler: pass a request ctx instead of the node (ipfs/go-ipfs#6244)
- constructor: cleanup some things (ipfs/go-ipfs#6246)
- Support --human flag in cmd/object-stat (ipfs/go-ipfs#6241)
- build: fix macos build with fuse (ipfs/go-ipfs#6235)
- add an experiment to prefer TLS 1.3 over secio (ipfs/go-ipfs#6229)
- fix two small nits in the go-ipfs constructor (ipfs/go-ipfs#6234)
- DI-based core.NewNode (ipfs/go-ipfs#6162)
- coreapi: Drop error from ParsePath (ipfs/go-ipfs#6122)
- fix the wrong path configuration in root redirection (ipfs/go-ipfs#6215)
- github.com/ipfs/go-bitswap (v0.0.4 -> v0.0.7):
- feat(engine): tag peers with requests (ipfs/go-bitswap#128)
- fix(network): add mutex to avoid data race (ipfs/go-bitswap#127)
- Change bitswap provide toggle to not be static (ipfs/go-bitswap#124)
- Use shared peer task queue with Graphsync (ipfs/go-bitswap#119)
- Add missing godoc comments, refactor to avoid confusion (ipfs/go-bitswap#117)
- fix(decision): cleanup request queues (ipfs/go-bitswap#116)
- Control provider workers with experiment flag (ipfs/go-bitswap#110)
- connmgr: give peers more weight when actively participating in a session (ipfs/go-bitswap#111)
- make the WantlistManager own the PeerHandler (ipfs/go-bitswap#78)
- remove IPFS_LOW_MEM flag support (ipfs/go-bitswap#115)
- github.com/ipfs/go-cid (v0.0.1 -> v0.0.2):
- default cidv1 to base32 (ipfs/go-cid#85)
- github.com/ipfs/go-cidutil (v0.0.1 -> v0.0.2):
- default cidv1 to base32 (ipfs/go-cidutil#13)
- github.com/ipfs/go-datastore (v0.0.3 -> v0.0.5):
- MapDatastore: obey KeysOnly (ipfs/go-datastore#130)
- fix the keytransform datastore's query implementation (ipfs/go-datastore#127)
- sync: apply entire query while locked (ipfs/go-datastore#129)
- filter: values are now always bytes (ipfs/go-datastore#126)
- autobatch: batch deletes (ipfs/go-datastore#128)
- github.com/ipfs/go-ipfs-cmds (v0.0.5 -> v0.0.8):
- fix: use golang's http.Error to send errors (ipfs/go-ipfs-cmds#167)
- improve help text on narrow terminals (ipfs/go-ipfs-cmds#140)
- chore: remove an old hack (ipfs/go-ipfs-cmds#165)
- http: use the request context (ipfs/go-ipfs-cmds#163)
- merge in go-ipfs-cmdkit (ipfs/go-ipfs-cmds#164)
- fix: return the correct error (ipfs/go-ipfs-cmds#162)
- github.com/ipfs/go-ipfs-config (v0.0.1 -> v0.0.3):
- Closes: #6284 Add appropriate IPv6 ranges to defaultServerFilters (ipfs/go-ipfs-config#34)
- add an experiment to prefer TLS 1.3 over secio (ipfs/go-ipfs-config#32)
- github.com/ipfs/go-ipfs-files (v0.0.2 -> v0.0.3):
- webfile: make Size() work before Read (ipfs/go-ipfs-files#18)
- check http status code during WebFile reads and return error for non-2XX (ipfs/go-ipfs-files#17)
- github.com/ipfs/go-ipld-cbor (v0.0.1 -> v0.0.2):
- switch to base32 by default (ipfs/go-ipld-cbor#62)
- github.com/ipfs/go-ipld-git (v0.0.1 -> v0.0.2):
- switch to base32 by default (ipfs/go-ipld-git#40)
- github.com/ipfs/go-mfs (v0.0.4 -> v0.0.7):
- Fix directory mv and add tests (ipfs/go-mfs#76)
- fix: not remove file by mistakes (ipfs/go-mfs#73)
- github.com/ipfs/go-path (v0.0.3 -> v0.0.4):
- include the path in path errors (ipfs/go-path#28)
- github.com/ipfs/go-unixfs (v0.0.4 -> v0.0.6):
- chore: remove URL field (ipfs/go-unixfs#72)
- github.com/ipfs/interface-go-ipfs-core (v0.0.6 -> v0.0.8):
- switch to base32 cidv1 by default (ipfs/interface-go-ipfs-core#29)
- path: drop error from ParsePath (ipfs/interface-go-ipfs-core#22)
- tests: fix a bunch of small test lints/issues (ipfs/interface-go-ipfs-core#28)
- Update Pin.RmRecursive docs to clarify shared indirect pins are not removed (ipfs/interface-go-ipfs-core#26)
- github.com/libp2p/go-buffer-pool (v0.0.1 -> v0.0.2):
- feat: add buffered writer (libp2p/go-buffer-pool#9)
- github.com/libp2p/go-conn-security-multistream (v0.0.1 -> v0.0.2):
- block while writing (libp2p/go-conn-security-multistream#10)
- github.com/libp2p/go-libp2p (v0.0.12 -> v0.0.28):
- Close the connection manager (libp2p/go-libp2p#639)
- Frequent Relay Advertisements (libp2p/go-libp2p#637)
- ping: return a stream of results (libp2p/go-libp2p#626)
- Use cancelable background context in identify (libp2p/go-libp2p#624)
- avoid intermediate allocation in relayAddrs (libp2p/go-libp2p#609)
- cache relayAddrs for a short period of time (libp2p/go-libp2p#608)
- autorelay: break findRelays into multiple functions and avoid the goto (libp2p/go-libp2p#606)
- autorelay: curtail addrsplosion (libp2p/go-libp2p#598)
- Periodically schedule identify push if the address set has changed (libp2p/go-libp2p#597)
- Replace peer addresses in identify (libp2p/go-libp2p#599)
- github.com/libp2p/go-libp2p-circuit (v0.0.4 -> v0.0.8):
- call Stream.Reset instead of Stream.Close (libp2p/go-libp2p-circuit#76)
- Tag the hop relay when creating stop streams (libp2p/go-libp2p-circuit#77)
- Tag peers with live hop streams (libp2p/go-libp2p-circuit#75)
- Hard Limit the number of hop stream goroutines (libp2p/go-libp2p-circuit#74)
- set deadline for stop handshake (libp2p/go-libp2p-circuit#73)
- github.com/libp2p/go-libp2p-connmgr (v0.0.1 -> v0.0.6):
- Background trimming (libp2p/go-libp2p-connmgr#43)
- Implement UpsertTag (libp2p/go-libp2p-connmgr#38)
- Add peer protection capability (implementation) (libp2p/go-libp2p-connmgr#36)
- github.com/libp2p/go-libp2p-crypto (v0.0.1 -> v0.0.2):
- add openssl support (libp2p/go-libp2p-crypto#61)
- github.com/libp2p/go-libp2p-discovery (v0.0.1 -> v0.0.4):
- More consistent use of options (libp2p/go-libp2p-discovery#25)
- Use 3hrs as routing advertisement ttl (libp2p/go-libp2p-discovery#23)
- github.com/libp2p/go-libp2p-interface-connmgr (v0.0.1 -> v0.0.5):
- Add Close method to the ConnManager interface (libp2p/go-libp2p-interface-connmgr#18)
- Add UpsertTag to the interface (libp2p/go-libp2p-interface-connmgr#17)
- Fix NullConnMgr to respect ConnManager interface (libp2p/go-libp2p-interface-connmgr#15)
- Add peer protection capability (libp2p/go-libp2p-interface-connmgr#14)
- github.com/libp2p/go-libp2p-kad-dht (v0.0.7 -> v0.0.13):
- fix: reduce memory used by buffered writers (libp2p/go-libp2p-kad-dht#332)
- query: fix a goroutine leak when the routing table is empty (libp2p/go-libp2p-kad-dht#329)
- query: fix error "leak" (libp2p/go-libp2p-kad-dht#328)
- providers: run datastore GC concurrently (libp2p/go-libp2p-kad-dht#326)
- fix(providers): gc (libp2p/go-libp2p-kad-dht#325)
- Remove the old protocol from the defaults (libp2p/go-libp2p-kad-dht#320)
- Fix some provider subsystem performance issues (libp2p/go-libp2p-kad-dht#319)
- github.com/libp2p/go-libp2p-peerstore (v0.0.2 -> v0.0.6):
- segment the memory peerstore + granular locks (libp2p/go-libp2p-peerstore#78)
- don't delete under the read lock (libp2p/go-libp2p-peerstore#76)
- Read/Write locking (libp2p/go-libp2p-peerstore#74)
- optimize peerstore memory (libp2p/go-libp2p-peerstore#71)
- fix unmarshalling of peer IDs (libp2p/go-libp2p-peerstore#72)
- fix error handling in UpdateAddrs: return on error (libp2p/go-libp2p-peerstore#70)
- github.com/libp2p/go-libp2p-pubsub (v0.0.1 -> v0.0.3):
- rework validator pipeline (libp2p/go-libp2p-pubsub#176)
- Test adversarial signing (libp2p/go-libp2p-pubsub#181)
- Strict message signing by default (libp2p/go-libp2p-pubsub#180)
- github.com/libp2p/go-libp2p-secio (v0.0.1 -> v0.0.3):
- fix buffer size check (libp2p/go-libp2p-secio#44)
- github.com/libp2p/go-libp2p-swarm (v0.0.2 -> v0.0.6):
- dial: return a nice custom dial error (libp2p/go-libp2p-swarm#121)
- github.com/libp2p/go-libp2p-tls (null -> v0.0.1):
- implement the new handshake (libp2p/go-libp2p-tls#20)
- use a prefix when signing the public key (libp2p/go-libp2p-tls#26)
- use ChaCha if one of the peers doesn't have AES hardware support (libp2p/go-libp2p-tls#23)
- improve peer verification (libp2p/go-libp2p-tls#17)
- add an example (mainly for development) (libp2p/go-libp2p-tls#14)
- github.com/libp2p/go-libp2p-transport-upgrader (v0.0.1 -> v0.0.4):
- improve correctness of closing connections on failure (libp2p/go-libp2p-transport-upgrader#19)
- github.com/libp2p/go-maddr-filter (v0.0.1 -> v0.0.4):
- fix filter listing (libp2p/go-maddr-filter#13)
- Reinstate deprecated Remove() method to reverse breakage (libp2p/go-maddr-filter#12)
- Implement support for whitelists, default-deny/allow (libp2p/go-maddr-filter#8)
- github.com/libp2p/go-mplex (v0.0.1 -> v0.0.4):
- disable write coalescing (libp2p/go-mplex#61)
- fix SetDeadline error conditions (libp2p/go-mplex#59)
- don't use contexts for deadlines (libp2p/go-mplex#58)
- don't reset on pathologies, just ignore the data (libp2p/go-mplex#57)
- coalesce writes (libp2p/go-mplex#54)
- read as much as we can in one go (libp2p/go-mplex#53)
- use timeouts when sending messages for stream open, close, and reset. (libp2p/go-mplex#52)
- fix: reset a stream even if closed remotely (libp2p/go-mplex#50)
- downgrade Error log to Warning (libp2p/go-mplex#46)
- Fix race condition by adding a mutex for deadline access (libp2p/go-mplex#41)
- github.com/libp2p/go-msgio (v0.0.1 -> v0.0.2):
- fix: never claim to read more than read (libp2p/go-msgio#12)
- github.com/libp2p/go-ws-transport (v0.0.2 -> v0.0.4):
- dep: import go-smux-* into the libp2p org (libp2p/go-ws-transport#43)
- replace gx instructions with note about gomod (libp2p/go-ws-transport#42)
We're happy to release go-ipfs 0.4.20. This release includes some critical performance and stability fixes so all users should upgrade ASAP.
This is also the first release to use go modules instead of GX. While GX has been a great way to dogfood an IPFS-based package manager, building and maintaining a custom package manager is a lot of work and we haven't been able to dedicate enough time to bring the user experience of gx to an acceptable level. You can read #5850 for some discussion on this matter.
As of this release, it's now much easier to run arbitrary IPFS commands within the docker container:
> docker run --name my-ipfs ipfs/go-ipfs:v0.4.20 config profile apply server # apply the server profile
> docker start my-ipfs # start the daemon
This release also reverts a change that caused some significant trouble in 0.4.19. If you've been running into Docker permission errors in 0.4.19, please upgrade.
This release contains a major WebUI release with some significant improvements to the file browser and new opt-in, privately hosted, anonymous usage analytics.
As usual, we've made several changes and improvements to our commands. The most notable changes are listed in this section.
This release includes a new command, ipfs version deps
, to list all
dependencies (with versions) of the current go-ipfs build. This should make it
easy to tell exactly how go-ipfs was built when tracking down issues.
The ipfs add
command has gained support for URLs. This means you can:
- Add files with
ipfs add URL
instead of downloading the file first. - Replace all uses of the
ipfs urlstore
command with a call toipfs add --nocopy
. Theipfs urlstore
command will be deprecated in a future release.
The ipfs swarm connect
command has a few new features:
It now marks the newly created connection as "important". This should ensure that the connection manager won't come along later and close the connection if it doesn't think it's being used.
It can now resolve /dnsaddr
addresses that don't end in a peer ID. For
example, you can now run ipfs swarm connect /dnsaddr/bootstrap.libp2p.io
to
connect to one of the bootstrap peers at random. NOTE: This could connect you to
an arbitrary peer as DNS is not secure (by default). Please do not rely on
this except for testing or unless you know what you're doing.
Finally, ipfs swarm connect
now returns all errors on failure. This should
make it much easier to debug connectivity issues. For example, one might see an
error like:
Error: connect QmYou failure: dial attempt failed: 6 errors occurred:
* <peer.ID Qm*Me> --> <peer.ID Qm*You> (/ip4/127.0.0.1/tcp/4001) dial attempt failed: dial tcp4 127.0.0.1:4001: connect: connection refused
* <peer.ID Qm*Me> --> <peer.ID Qm*You> (/ip6/::1/tcp/4001) dial attempt failed: dial tcp6 [::1]:4001: connect: connection refused
* <peer.ID Qm*Me> --> <peer.ID Qm*You> (/ip6/2604::1/tcp/4001) dial attempt failed: dial tcp6 [2604::1]:4001: connect: network is unreachable
* <peer.ID Qm*Me> --> <peer.ID Qm*You> (/ip6/2602::1/tcp/4001) dial attempt failed: dial tcp6 [2602::1]:4001: connect: network is unreachable
* <peer.ID Qm*Me> --> <peer.ID Qm*You> (/ip4/150.0.1.2/tcp/4001) dial attempt failed: dial tcp4 0.0.0.0:4001->150.0.1.2:4001: i/o timeout
* <peer.ID Qm*Me> --> <peer.ID Qm*You> (/ip4/200.0.1.2/tcp/4001) dial attempt failed: dial tcp4 0.0.0.0:4001->200.0.1.2:4001: i/o timeout
ipfs bitswap stat
no longer lists bitswap partners unless the -v
flag is
passed. That is, it will now return:
> ipfs bitswap stat
bitswap status
provides buffer: 0 / 256
blocks received: 0
blocks sent: 79
data received: 0
data sent: 672706
dup blocks received: 0
dup data received: 0 B
wantlist [0 keys]
partners [197]
Instead of:
> ipfs bitswap stat -v
bitswap status
provides buffer: 0 / 256
blocks received: 0
blocks sent: 79
data received: 0
data sent: 672706
dup blocks received: 0
dup data received: 0 B
wantlist [0 keys]
partners [203]
QmNQTTTRCDpCYCiiu6TYWCqEa7ShAUo9jrZJvWngfSu1mL
QmNWaxbqERvdcgoWpqAhDMrbK2gKi3SMGk3LUEvfcqZcf4
QmNgSVpgZVEd41pBX6DyCaHRof8UmUJLqQ3XH2qNL9xLvN
... omitting 200 lines ...
The --human
flag in the ipfs repo stat
command now intelligently picks a
size unit instead of always using MiB.
All of the resolve commands now:
- Resolve recursively (up to 32 steps) by default to better match user
expectations (these commands used to be non-recursive by default). To turn
recursion off, pass
-r false
. - When resolving non-recursively, these commands no longer fail when partially resolving a name. Instead, they simply return the intermediate result.
The ipfs files flush
command now returns the CID of the flushed file.
This release has the usual collection of performance and reliability improvements.
Those of you using the badger datastore should notice reduced memory usage in this release due to some upstream changes. Badger still uses significantly more memory than the default datastore configuration but this will hopefully continue to improve.
We fixed some critical CPU utilization regressions in bitswap for this release. If you've been noticing CPU regressions in go-ipfs 0.4.19, especially when running a public gateway, upgrading to 0.4.20 will likely fix them.
After AutoRelay was introduced in go-ipfs 0.4.19, the number of peers connecting through relays skyrocketed to over 120K concurrent peers. This highlighted some performance issues that we've now fixed in this release. Specifically:
- We've significantly reduced the amount of memory allocated per-peer.
- We've fixed a bug where relays might, in rare cases, try to actively dial a peer to relay traffic. By default, relays only forward traffic between peers already connected to the relay.
- We've fixed quite a number of performance issues that only show up when rapidly forming new connections. This will actually help all nodes but will especially help relays.
If you've enabled relay hop (Swarm.EnableRelayHop
) in go-ipfs 0.4.19 and it
hasn't burned down your machine yet, this release should improve things
significantly. However, relays are still under heavy load so running an open
relay will continue to be resource intensive.
We're continuing to investigate this issue and have a few more patches on the way that, unfortunately, won't make it into this release.
We've fixed two notable panics in this release:
- We've fixed a frequent panic in the DHT.
- We've fixed an occasional panic in the experimental QUIC transport.
IPFS announces and finds content by sending and retrieving content routing ("provider") records to and from the DHT. Unfortunately, sending out these records can be quite resource intensive.
This release has two changes to alleviate this: a reduced number of initial provide workers and a persistent provider queue.
We've reduced the number of parallel initial provide workers (workers that send out provider records when content is initially added to go-ipfs) from 512 to 6. Each provide request (currently, due to some issues in our DHT) tries to establish hundreds of connections, significantly impacting the performance of go-ipfs and crashing some routers.
We've introduced a new persistent provider queue for files added via ipfs add
and ipfs pin add
. When new directory trees are added to go-ipfs, go-ipfs will
add the root/final CID to this queue. Then, in the background, go-ipfs will walk
the queue, sequentially sending out provider records for each CID.
This ensures that root CIDs are sent out as soon as possible and are sent even when files are added when the go-ipfs daemon isn't running.
By example, let's add a directory tree to go-ipfs:
> # We're going to do this in "online" mode first so let's start the daemon.
> ipfs daemon &
...
Daemon is ready
> # Now, we're going to create a directory to add.
> mkdir foo
> for i in {0..1000}; do echo do echo $i > foo/$i; done
> # finally, we're going to add it.
> ipfs add -r foo
added QmUQcSjQx2bg4cSe2rUZyQi6F8QtJFJb74fWL7D784UWf9 foo/0
...
added QmQac2chFyJ24yfG2Dfuqg1P5gipLcgUDuiuYkQ5ExwGap foo/990
added QmQWwz9haeQ5T2QmQeXzqspKdowzYELShBCLzLJjVa2DuV foo/991
added QmQ5D4MtHUN4LTS4n7mgyHyaUukieMMyCfvnzXQAAbgTJm foo/992
added QmZq4n4KRNq3k1ovzxJ4qdQXZSrarfJjnoLYPR3ztHd7EY foo/993
added QmdtrsuVf8Nf1s1MaSjLAd54iNqrn1KN9VoFNgKGnLgjbt foo/994
added QmbstvU9mnW2hsE94WFmw5WbrXdLTu2Sf9kWWSozrSDscL foo/995
added QmXFd7f35gAnmisjfFmfYKkjA3F3TSpvUYB9SXr6tLsdg8 foo/996
added QmV5BxS1YQ9V227Np2Cq124cRrFDAyBXNMqHHa6kpJ9cr6 foo/997
added QmcXsccUtwKeQ1SuYC3YgyFUeYmAR9CXwGGnT3LPeCg5Tx foo/998
added Qmc4mcQcpaNzyDQxQj5SyxwFg9ZYz5XBEeEZAuH4cQirj9 foo/999
added QmXpXzUhcS9edmFBuVafV5wFXKjfXkCQcjAUZsTs7qFf3G foo
In 0.4.19, we would have sent out provider records for files foo/{0..1000}
before sending out a provider record for foo
. If you were ask a friend to
download /ipfs/QmUQcSjQx2bg4cSe2rUZyQi6F8QtJFJb74fWL7D784UWf9, they would
(baring other issues) be able to find it pretty quickly as this is the first CID
you'll have announced to the network. However, if you ask your friend to
download /ipfs/QmXpXzUhcS9edmFBuVafV5wFXKjfXkCQcjAUZsTs7qFf3G/0, they'll have to
wait for you to finish telling the network about every file in foo
first.
In 0.4.20, we immediately tell the network about
QmXpXzUhcS9edmFBuVafV5wFXKjfXkCQcjAUZsTs7qFf3G
(the foo
directory) as soon
as we finish adding the directory to go-ipfs without waiting to finish
announcing foo/{0..1000}
. This is especially important in this release
because we've drastically reduced the number of provide workers.
The second benefit is that this queue is persistent. That means go-ipfs won't forget to send out this record, even if it was offline when the content was initially added. NOTE: go-ipfs does continuously re-send provider records in the background twice a day, it just might be a while before it gets around to sending one out any specific one.
Bitswap now periodically re-sends its wantlist to connected peers. This should help work around some race conditions we've seen in bitswap where one node wants a block but the other doesn't know for some reason.
You can track this issue here: ipfs#5183.
While NATs are still p2p enemy #1, this release includes slightly improved support for traversing them.
Specifically, this release now:
- Better detects the "gateway" NAT, even when multiple devices on the network claim to be NATs.
- Better guesses the external IP address when port mapping, even when the gateway lies.
The experimental AutoRelay feature can now detect NATs much faster as we've reduced initial NAT detection delay to 15 seconds. There's still room for improvement but this should make nodes that have enabled this feature dialable earlier on start.
- github.com/ipfs/go-ipfs:
- gitattributes: avoid normalizing known binary files (ipfs/go-ipfs#6209)
- gitattributes: default to LF (ipfs/go-ipfs#6198)
- Fix level db panic (ipfs/go-ipfs#6186)
- Dockerfile: Remove 2 year old deprecation warning (ipfs/go-ipfs#6188)
- align output for the command ipfs object stat (ipfs/go-ipfs#6189)
- provider queue: don't repeatedly retry the same item if we fail (ipfs/go-ipfs#6187)
- test: remove version/deps from ro commands test (ipfs/go-ipfs#6185)
- feat: add version deps command [modversion] (ipfs/go-ipfs#6115)
- readme: update for go modules (ipfs/go-ipfs#6180)
- Switch to Go 1.12 (ipfs/go-ipfs#6144)
- ci: avoid interleaving output from different sharness tests (ipfs/go-ipfs#6175)
- fix two bugs where the repo may not properly be closed (ipfs/go-ipfs#6176)
- fix error check in swarm connect (ipfs/go-ipfs#6174)
- feat(coreapi): tag all explicit connect requests in the connection manager (ipfs/go-ipfs#6171)
- chore: remove CODEOWNERS (ipfs/go-ipfs#6172)
- feat: update to IPFS Web UI 2.4.4 (ipfs/go-ipfs#6169)
- fix add error handling (ipfs/go-ipfs#6156)
- chore: remove waffle (ipfs/go-ipfs#6157)
- chore: fix a bunch of issues caught by golangci-lint (ipfs/go-ipfs#6140)
- docs/experimental-features.md: link to ipfs-ds-convert (ipfs/go-ipfs#6154)
- interrupt: fix send on closed (ipfs/go-ipfs#6147)
- docs: document Gateway.Writable not Gateway.Writeable (ipfs/go-ipfs#6151)
- Fuse fixes (ipfs/go-ipfs#6135)
- Remove duplicate blockstore from the package list (ipfs/go-ipfs#6138)
- Query for provider head/tail (ipfs/go-ipfs#6125)
- Remove dead link from ISSUE_TEMPLATE.md (ipfs/go-ipfs#6128)
- coreapi: remove Unixfs.Wrap (ipfs/go-ipfs#6123)
- coreapi unixfs: change Wrap logic to make more sense (ipfs/go-ipfs#6019)
- deps: switch back to jbenet go-is-domain (ipfs/go-ipfs#6119)
- command repo stat: add human flag tests to t0080-repo.sh (ipfs/go-ipfs#6116)
- gc: fix a potential deadlock (ipfs/go-ipfs#6112)
- fix config options in osxfuse error messages (ipfs/go-ipfs#6105)
- Command repo stat: improve human flag behavior (ipfs/go-ipfs#6106)
- Provide root node immediately on add and pin add (ipfs/go-ipfs#6068)
- gomod: Update Dockerfile, remove Dockerfile.fast (ipfs/go-ipfs#6100)
- Return CID from 'ipfs files flush' (ipfs/go-ipfs#6102)
- resolve: fix recursion (ipfs/go-ipfs#6087)
- fix(swarm): add dnsaddr support in swarm connect (ipfs/go-ipfs#5535)
- make in-memory datastore thread-safe (ipfs/go-ipfs#6085)
- Update package table to remove broken jenkins links (ipfs/go-ipfs#6084)
- mk: fix maketarball to work with gomod (ipfs/go-ipfs#6078)
- fix ls command to use the new coreinterface types (ipfs/go-ipfs#6051)
- mk: remove install_unsupported, leave a note (ipfs/go-ipfs#6063)
- mk: change git-hash command to include information about modifications (ipfs/go-ipfs#6060)
- mk: fix make install by not setting GOBIN (ipfs/go-ipfs#6059)
- go: require Golang 1.11.4 (ipfs/go-ipfs#6057)
- yamux: increase yamux window size to 8MiB. (ipfs/go-ipfs#6049)
- Introduce go modules [yey] (ipfs/go-ipfs#6038)
- cleanup daemon online logic (ipfs/go-ipfs#6050)
- ci: test on 32bit os (ipfs/go-ipfs#5429)
- feat/cmds: hide peers info default in bitswap stat (ipfs/go-ipfs#5820)
- Improve CLI help pages (ipfs/go-ipfs#6013)
- Close #6044 (ipfs/go-ipfs#6045)
- commands(dht): return final error (ipfs/go-ipfs#6034)
- Revert "Really run as non-root user in docker container" (ipfs/go-ipfs#6040)
- github.com/ipfs/go-bitswap:
- feat(messagequeue): rebroadcast wantlist (ipfs/go-bitswap#106)
- reduce provide workers to 6 (ipfs/go-bitswap#93)
- Reduce memory allocation (ipfs/go-bitswap#103)
- refactor(messagequeue): remove dead code (ipfs/go-bitswap#98)
- fix: limit use of custom context type (ipfs/go-bitswap#89)
- fix: remove non-error log message (ipfs/go-bitswap#91)
- fix(messagequeue): Remove second run loop (ipfs/go-bitswap#94)
- github.com/ipfs/go-blockservice:
- Revert "Remove verifcid as it is handled in go-cid" (ipfs/go-blockservice#25)
- Remove verifcid as it is handled in go-cid (ipfs/go-blockservice#23)
- github.com/ipfs/go-datastore:
- cleanup and optimize naive query filters (ipfs/go-datastore#125)
- Fix – sorted limited offset mount queries (ipfs/go-datastore#124)
- Fix function comments based on best practices from Effective Go (ipfs/go-datastore#122)
- remove ThreadSafeDatastore (ipfs/go-datastore#120)
- Splinter TTLDatastore interface into TTL + Datastore (ipfs/go-datastore#118)
- github.com/ipfs/go-ds-badger:
- tweak the default options (ipfs/go-ds-badger#52)
- remove thread-safe assertion (ipfs/go-ds-badger#55)
- make memory-safe against concurrent closure/operations (ipfs/go-ds-badger#53)
- make badger use our logging framework (ipfs/go-ds-badger#50)
- github.com/ipfs/go-ds-flatfs:
- remove thread-safe assertion (ipfs/go-ds-flatfs#53)
- github.com/ipfs/go-ds-leveldb:
- Fast reverse query (ipfs/go-ds-leveldb#28)
- remove thread-safe assertion (ipfs/go-ds-leveldb#27)
- github.com/ipfs/go-ipfs-cmdkit:
- Extract files package (ipfs/go-ipfs-cmdkit#31)
- github.com/ipfs/go-ipfs-cmds:
- sync: add yet another sync error (ipfs/go-ipfs-cmds#161)
- Removed broken link from readme (ipfs/go-ipfs-cmds#159)
- Fix broken link in readme (ipfs/go-ipfs-cmds#160)
- set WebFile fpath to URL base (ipfs/go-ipfs-cmds#158)
- Handle stdin name in cli/parse (ipfs/go-ipfs-cmds#157)
- support url paths as files.WebFile (ipfs/go-ipfs-cmds#154)
- typed encoder: improve pointer reflection (ipfs/go-ipfs-cmds#155)
- cli: don't sync output to NUL on Windows (ipfs/go-ipfs-cmds#153)
- github.com/ipfs/go-ipfs-files:
- return url as AbsPath from WebFile to implement FileInfo (ipfs/go-ipfs-files#13)
- fix the content disposition header (ipfs/go-ipfs-files#14)
- go format (ipfs/go-ipfs-files#15)
- simplify content type checking (ipfs/go-ipfs-files#9)
- remove extra webfile test code (ipfs/go-ipfs-files#12)
- github.com/ipfs/go-merkledag:
- add function to marshal raw nodes to json (ipfs/go-merkledag#36)
- fix some performance regressions when reading protobuf nodes (ipfs/go-merkledag#34)
- github.com/ipfs/go-metrics-interface:
- update the counter interface to match prometheus (ipfs/go-metrics-interface#2)
- github.com/ipfs/go-mfs:
- Return node from FlushPath (ipfs/go-mfs#72)
- Wire up context to FlushPath (ipfs/go-mfs#70)
- github.com/ipfs/interface-go-ipfs-core:
- don't close the top-level addr (ipfs/interface-go-ipfs-core#25)
- fix a bunch of small test "bugs" (ipfs/interface-go-ipfs-core#24)
- remove Wrap (ipfs/interface-go-ipfs-core#21)
- Unixfs.Wrap Fixes (ipfs/interface-go-ipfs-core#10)
- tweak the Ls interface (ipfs/interface-go-ipfs-core#14)
- github.com/libp2p/go-buffer-pool:
- Enable tests (libp2p/go-buffer-pool#6)
- github.com/libp2p/go-flow-metrics:
- Just repair spelling mistake (libp2p/go-flow-metrics#3)
- github.com/libp2p/go-libp2p:
- Deprecate gx in readme & link to workspace repo (libp2p/go-libp2p#591)
- Respect nodial option in routed host (libp2p/go-libp2p#590)
- fix panic in observed address activation check (libp2p/go-libp2p#586)
- Improve observed address handling (libp2p/go-libp2p#585)
- identify: avoid parsing/printing multiaddrs (libp2p/go-libp2p#583)
- move things outside of the lock in obsaddr (libp2p/go-libp2p#582)
- identify: be more careful about the addresses we store (libp2p/go-libp2p#577)
- relay: turn autorelay into a service and always filter out relay addresses (libp2p/go-libp2p#578)
- chore: fail in the libp2p constructor if we fail to store the key (libp2p/go-libp2p#576)
- Fix broken link in README.md (libp2p/go-libp2p#580)
- Link to docs & discuss in readme (libp2p/go-libp2p#571)
- Reduce autorelay boot delay and correctly handle private->public transition (libp2p/go-libp2p#570)
- reduce nat error level (libp2p/go-libp2p#568)
- relay: simplify declaration of multiaddr var (libp2p/go-libp2p#563)
- Fix UDP listen on a Unspecified Address and Dial from the Unspecified Address (libp2p/go-libp2p#561)
- Remove jenkins column from package table (libp2p/go-libp2p#562)
- Fix typos in p2p/net/README.md (libp2p/go-libp2p#555)
- better nat mapping (libp2p/go-libp2p#549)
- github.com/libp2p/go-libp2p-autonat:
- fully close the autonat client stream (libp2p/go-libp2p-autonat#21)
- parallelize dialbacks (libp2p/go-libp2p-autonat#20)
- Pacify the race detector (libp2p/go-libp2p-autonat#17)
- github.com/libp2p/go-libp2p-autonat-svc:
- full close the autonat stream (libp2p/go-libp2p-autonat-svc#20)
- reduce dialback timeout to 15s (libp2p/go-libp2p-autonat-svc#17)
- github.com/libp2p/go-libp2p-circuit:
- use buffer pool in newDelimitedReader (libp2p/go-libp2p-circuit#71)
- Use NoDial option when opening hop streams for non-active relays (libp2p/go-libp2p-circuit#70)
- use io.CopyBuffer with explicitly allocated buffers (libp2p/go-libp2p-circuit#69)
- docs and nits (libp2p/go-libp2p-circuit#66)
- github.com/libp2p/go-libp2p-kad-dht:
- dialQueue: start the control loop later (libp2p/go-libp2p-kad-dht#312)
- make it work in wasm (libp2p/go-libp2p-kad-dht#310)
- Revert "GoModules: Checksum mismatch:" (libp2p/go-libp2p-kad-dht#309)
- defer dialqueue action until initial peers have been added (libp2p/go-libp2p-kad-dht#301)
- github.com/libp2p/go-libp2p-nat:
- switch to libp2p's go-nat fork (libp2p/go-libp2p-nat#16)
- remove all uses of multiaddrs (libp2p/go-libp2p-nat#14)
- github.com/libp2p/go-libp2p-net:
- fix WithNoDial to return the context (libp2p/go-libp2p-net#43)
- NoDial context option (libp2p/go-libp2p-net#42)
- github.com/libp2p/go-libp2p-peer:
- Let ID implement encoding.Binary[Un]Marshaler and encoding.Text[Un]Marshaler (libp2p/go-libp2p-peer#44)
- github.com/libp2p/go-libp2p-peerstore:
- keep temp addresses for 2 minutes (libp2p/go-libp2p-peerstore#67)
- migrate to multiformats/go-base32 (libp2p/go-libp2p-peerstore#61)
- github.com/libp2p/go-libp2p-protocol:
- update readme (libp2p/go-libp2p-protocol#6)
- Enable standard Travis CI tests. (libp2p/go-libp2p-protocol#5)
- Fix go get address. (libp2p/go-libp2p-protocol#4)
- Add MIT license (libp2p/go-libp2p-protocol#3)
- Standardized Readme (libp2p/go-libp2p-protocol#2)
- github.com/libp2p/go-libp2p-pubsub-router:
- gx publish 0.5.17 (libp2p/go-libp2p-pubsub-router#26)
- github.com/libp2p/go-libp2p-quic-transport:
- update quic-go to v0.11.0 (libp2p/go-libp2p-quic-transport#54)
- github.com/libp2p/go-libp2p-routing-helpers:
- fix(put): fail if any router fails (libp2p/go-libp2p-routing-helpers#19)
- github.com/libp2p/go-libp2p-swarm:
- Add context option to disable dialing when opening a new stream (libp2p/go-libp2p-swarm#116)
- return all dial errors if dial has failed (libp2p/go-libp2p-swarm#115)
- Differentiate no addresses error from no good addresses (libp2p/go-libp2p-swarm#113)
- github.com/libp2p/go-libp2p-transport:
- tests: constrain concurrency with race detector. (libp2p/go-libp2p-transport#47)
- pick test timeout from env var if available. (libp2p/go-libp2p-transport#46)
- increase test timeout. (libp2p/go-libp2p-transport#45)
- github.com/libp2p/go-msgio:
- Improve test coverage (libp2p/go-msgio#10)
- github.com/libp2p/go-reuseport:
- fix: add wasm build tag to wasm module (libp2p/go-reuseport#70)
- github.com/libp2p/go-reuseport-transport:
- don't set linger to 0 (libp2p/go-reuseport-transport#14)
- github.com/libp2p/go-tcp-transport:
- set linger to 0 for both inbound and outbound connections (libp2p/go-tcp-transport#36)
- github.com/libp2p/go-ws-transport:
- modernize request handling (libp2p/go-ws-transport#41)
We're happy to announce go 0.4.19. This release contains a bunch of important fixes and a slew of new and improved features. Get pumped and upgrade ASAP to benefit from all the new goodies! 🎁
Go-ipfs can now be configured to listen on a random but stable port (across
restarts) using the new randomports
configuration profile. This should be
helpful when testing and/or running multiple go-ipfs instances on a single
machine.
To initialize a go-ipfs instance with a randomly chosen port, run:
> ipfs init --profile=randomports
IPNS (and/or DNSLink) directory listings on the gateway, e.g. https://ipfs.io/ipns/dist.ipfs.io/go-ipfs/, will now display the ipfs hash of the current directory. This way users can more easily create permanent links to otherwise mutable data.
This release introduces two new experimental features (courtesy of libp2p): AutoRelay and AutoNAT.
AutoRelay is a new service that automatically chooses a public relay when it detects that the go-ipfs node is behind a NAT. While relaying connections through a third-party node isn't the most efficient way to route around NATs, it's a reliable fallback.
To enable AutoRelay, set the Swarm.EnableAutoRelay
option in the config.
AutoNAT is the service AutoRelay uses to detect if the node is behind a NAT. You don't have to set any special config flags to enable it.
In this same config section, you may also notice options like EnableRelayHop
,
EnableAutoNATService
, etc. You do not need to enable these:
EnableRelayHop
-- Allow other nodes to use your node as a relay (disabled by default).EnableAutoNATService
-- Help other nodes detect if they're behind a NAT (disabled by default).
There are two new "offline" features in this release: a global --offline
flag
and an option to configure the gateway to not fetch files.
Most go-ipfs commands now support the --offline
flag. This causes IPFS to avoid
network operations when performing the requested operation. If you've ever used
the --local
flag, the --offline
flag is the (almost) universally supported
replacement.
For example:
- If the daemon is started with
ipfs daemon --offline
, it won't even connect to the network. (note: this feature isn't new, just an example). ipfs add --offline some_file
won't send out provider records.ipfs cat --offline Qm...
won't fetch any blocks from the network.ipfs block stat --offline Qm...
is a great way to tell if a block is locally available.
Note: It doesn't yet work with the refs
, urlstore
, or tar
commands
(#6002).
On to the gateway, there's a new Gateway.NoFetch
option to configure the
gateway to only serve locally present files. This makes it possible to run an
IPFS node as a gateway to serve content of your choosing without acting like a
public proxy. 🤫
There's a new --pin
flag for both ipfs block put
and ipfs urlstore add
to
match the --pin
flag in ipfs add
. This allows one to atomically add and pin
content with these APIs.
NOTE 1: For ipfs urlstore add
, --pin
has been enabled by default to
match the behavior in ipfs add
. However, ipfs block put
does not pin by
default to match the current behavior.
NOTE 2: If you had previously used the urlstore and weren't explicitly
pinning content after adding it, it isn't pinned and running the garbage
collector will delete it. While technically documented in the ipfs urlstore add
helptext, this behavior was non-obvious and bears mentioning.
The ipfs ls
command has two significant changes this release: it reports
file sizes instead of dag sizes and has gained a new --stream
flag.
First up, ipfs ls
now reports file sizes instead of dag sizes. Previously,
for historical reasons, ipfs ls
would report the size of a file/directory as
seen by IPFS including all the filesystem datastructures and metadata.
However, this meant that ls -l
and ipfs ls
would print different sizes:
> ipfs ls /ipfs/QmS4ustL54uo8FzR9455qaxZwuMiUhyvMcX9Ba8nUH4uVv
QmZTR5bcpQD7cFgTorqxZDYaew1Wqgfbd2ud9QqGPAkK2V 1688 about
QmYCvbfNbCwFR45HiNP45rwJgvatpiW38D961L5qAhUM5Y 200 contact
QmY5heUM5qgRubMDD1og9fhCPA6QdkMp3QCwd4s7gJsyE7 322 help
QmejvEPop4D7YUadeGqYWmZxHhLc4JBUCzJJHWMzdcMe2y 12 ping
QmXgqKTbzdh83pQtKFb19SpMCpDDcKR2ujqk3pKph9aCNF 1692 quick-start
QmPZ9gcCEpqKTo6aq61g2nXGUhM4iCL3ewB6LDXZCtioEB 1102 readme
QmQ5vhrL7uv6tuoN9KeVBwd4PwfQkXdVVmDLUZuTNxqgvm 1173 security-notes
> ipfs get /ipfs/QmS4ustL54uo8FzR9455qaxZwuMiUhyvMcX9Ba8nUH4uVv
Saving file(s) to QmS4ustL54uo8FzR9455qaxZwuMiUhyvMcX9Ba8nUH4uVv
6.39 KiB / 6.39 KiB [================================] 100.00% 0s
> ls -l QmS4ustL54uo8FzR9455qaxZwuMiUhyvMcX9Ba8nUH4uVv
total 28
-rw------- 1 user group 1677 Feb 14 17:03 about
-rw------- 1 user group 189 Feb 14 17:03 contact
-rw------- 1 user group 311 Feb 14 17:03 help
-rw------- 1 user group 4 Feb 14 17:03 ping
-rw------- 1 user group 1681 Feb 14 17:03 quick-start
-rw------- 1 user group 1091 Feb 14 17:03 readme
-rw------- 1 user group 1162 Feb 14 17:03 security-notes
This is now no longer the case. ipfs ls
and ls -l
now return the same
sizes. 🙌
Second up, ipfs ls
now has a new --stream
flag. In IPFS, very large
directories (e.g., Wikipedia) are split up into multiple chunks (shards) as
there are too many entries to fit in a single block. Unfortunately, ipfs ls
buffers the entire file list in memory and then sorts it. This means that
ipfs ls /ipfs/QmXoypizjW3WknFiJnKLwHCnL72vedxjQkDDP1mXWo6uco/wiki
(wikipedia)
will take a very long time to return anything (it'll also use quite a bit of
memory).
However, the new --stream
flag makes it possible to stream a directory listing
as new chunks are fetched from the network. To test this, you can run ipfs ls --stream --size=false --resolve-type=false /ipfs/QmXoypizjW3WknFiJnKLwHCnL72vedxjQkDDP1mXWo6uco/wiki
. You probably won't
want to wait for that command to finish, Wikipedia has a lot of entries. 😉
This release sees a new (experimental) feature contributed by our friends at
Peergos: HTTP proxy over libp2p. When enabled, the local
gateway can act as an HTTP proxy and forward HTTP requests to libp2p peers. When
combined with the ipfs p2p
command, users can use this to expose HTTP services
to other go-ipfs nodes via their gateways. For details, check out the
documentation.
This release introduces quite a few performance/reliability improvements and, as usual, fixes several memory leaks. Below is a non-exhaustive list of noticeable changes.
This release includes an important DHT fix that should significantly:
- Reduce dialing.
- Speed up DHT queries.
- Improve performance of the gateways.
Basically, in the worst case, a DHT query would turn into a random walk of the entire IPFS network. Yikes!
Relevant PR: libp2p/go-libp2p-kad-dht#237
Bitswap sessions have improved and are now used for all requests. Sessions allow us to group related content and ask peers most likely to have the content instead of broadcasting the request to all connected peers. This gives us two significant benefits:
- Less wasted upload bandwidth. Instead of broadcasting which blocks we want to everyone, we can ask fewer peers thus reducing the number of requests we send out.
- Less wasted download bandwidth. Because we know which peers likely have content, we can ask an individual peer for a block and expect to get an answer. In the past, we'd ask every peer at the same time to optimize for latency at the expense of bandwidth (getting the same block from multiple peers). We had to do this because we had to assume that most peers didn't have the requested block.
This release includes some significant reliability improvements in pubsub subscription handling. If you've previously had issues with connected pubsub peers not seeing each-other's messages, please upgrade ASAP.
In this release, we've rewritten our previously error-prone go-reuseport
library to not duplicate a significant portion of Go's low-level networking
code. This was made possible by Go's new Control
net.Dialer
option.
In the past, our first suggestion to anyone experiencing weird resource or
connectivity issues was to disable REUSEPORT
(set IPFS_REUSEPORT
to false).
This should no longer be necessary.
Badger has reached 1.0. This release brings an audit and numerous reliability fixes. We are now reasonably confident that badger will become the default datastore in a future release. 👍
This release also adds a new Truncate
configuration option for the badger
datastore (enabled by default for new IPFS nodes). When enabled, badger will
delete any un-synced data on start instead of simply refusing to start. This
should be safe on all filesystems where the sync
operation is safe and removes
the need for manual intervention when restarting an IPFS node after a crash.
Assuming you initialized your badger repo with ipfs init --profile=badgerds
,
you can enable truncate on an existing repo by running: ipfs config --json "Datastore.Spec.child.truncate" true
.
The legacy commands library shim has now been completely removed. This won't mean much for many users but the go-ipfs team is happy to have this behind them.
This release can now encode CIDs in responses in bases other than base58. This is primarily useful for web-browser integration as it allows us to (a) encode CIDs in a lower-case base (e.g., base32) and then use them in the origin part of URLs. The take away is: this release brings us a step closer to better browser integration.
Specifically, this release adds two flags:
--cid-base
: When specified, the IPFS CLI will encode all CIDv1 CIDs using the requested base.--upgrade-cidv0-in-output
: When specified, the IPFS CLI will upgrade CIDv0 CIDs to CIDv1 CIDs when returning them to the user. This upgrade is necessary because CIDv0 doesn't support multibase however, it's off by default as it changes the binary representation of the CIDs (which could have unintended consequences).
The work on the CoreAPI refactor (ipfs/go-ipfs#4498) has progressed leaps and bounds this release. The CoreAPI is a comprehensive programmatic interface designed to allow go-ipfs be used as a daemon or a library interchangeably.
As of this release, go-ipfs now has:
- External interface definitions in ipfs/interface-go-ipfs-core.
- A work-in-progress implementation (ipfs/go-ipfs-http-client) of these interfaces that uses the IPFS HTTP API. This will replace the (ipfs/go-ipfs-api) library.
- A new plugin type "Daemon". Daemon plugins are started and stopped along with the go-ipfs daemon and are instantiated with a copy of the CoreAPI. This allows them to control and extend the go-ipfs daemon from within the daemon itself.
The next steps are:
- Finishing the remaining API surface area. At the moment, the two key missing parts are:
- Config manipulation.
- The
ipfs files
API. - Finalizing the ipfs/go-ipfs-http-client implementation.
- Creating a simple way to construct and initialize a go-ipfs node when using go-ipfs as a library.
- github.com/ipfs/go-ipfs:
- fix: show interactive output from install.sh (ipfs/go-ipfs#6024)
- fix: return the shortest, completely resolved path in the resolve command (ipfs/go-ipfs#5704)
- fix a few interop test issues (ipfs/go-ipfs#6004)
- fix HAMT bookmark ln (ipfs/go-ipfs#6005)
- docs: document Gateway.NoFetch (ipfs/go-ipfs#5999)
- Improve "name publish" ttl option documentation (ipfs/go-ipfs#5979)
- fix(cmd/mv): dst filename error (ipfs/go-ipfs#5964)
- coreapi: extract interface (ipfs/go-ipfs#5978)
- coreapi: cleanup non-gx references (ipfs/go-ipfs#5976)
- coreapi: fix seek test on http impl (ipfs/go-ipfs#5971)
- block put --pin (ipfs/go-ipfs#5969)
- Port
ipfs ls
to CoreAPI (ipfs/go-ipfs#5962) - docs: duplicate default helptext in
name publish
(ipfs/go-ipfs#5960) - plugin: add a daemon plugin with access to the CoreAPI (ipfs/go-ipfs#5955)
- coreapi: add some seeker tests (ipfs/go-ipfs#5934)
- Refactor ipfs get to use CoreAPI (ipfs/go-ipfs#5943)
- refact(cmd/init): change string option to const (ipfs/go-ipfs#5949)
- cmds/pin: use coreapi/pin (ipfs/go-ipfs#5843)
- Only perform DNSLink lookups on fully qualified domain names (FQDN) (ipfs/go-ipfs#5950)
- Fix DontCheckOSXFUSE config command example (ipfs/go-ipfs#5951)
- refact(cmd/config): change string option to const (ipfs/go-ipfs#5948)
- clarification the document of --resolve flag in name.publish (ipfs/go-ipfs#5651)
- Drop some coreunix code (ipfs/go-ipfs#5938)
- commands: fix verbose flag (ipfs/go-ipfs#5940)
- Fixes #4558 (ipfs/go-ipfs#5937)
- Port dag commansds to CoreAPI (ipfs/go-ipfs#5939)
- mfs: make sure to flush after mv and chcid (ipfs/go-ipfs#5936)
- docs/code-flow : Add code flow documentation for add cmd. (ipfs/go-ipfs#5864)
- coreapi: few more error check fixes (ipfs/go-ipfs#5935)
- Fixed and cleaned up TestIpfsStressRead (ipfs/go-ipfs#5920)
- Clarify that chunker sizes are in bytes (ipfs/go-ipfs#5923)
- refact(cmd/patch): change string to const (ipfs/go-ipfs#5931)
- refact(cmd/object): change option string to const (ipfs/go-ipfs#5932)
- coreapi: replace coreiface.DagAPI with ipld.DAGService (ipfs/go-ipfs#5922)
- Add global option to specify the multibase encoding (server side) (ipfs/go-ipfs#5789)
- coreapi: Adjust some tests for go-ipfs-http-api (ipfs/go-ipfs#5926)
- chore: update to Web UI v2.3.3 (ipfs/go-ipfs#5928)
- ls: Report real file size (ipfs/go-ipfs#5906)
- Improve the Filestore document (ipfs/go-ipfs#5927)
- [CORS] Bubble go-ipfs-cmds 2.0.10 - Updates CORS library (ipfs/go-ipfs#5919)
- reduce verbosity of daemon start (ipfs/go-ipfs#5904)
- feat: update to Web UI v2.3.2 (ipfs/go-ipfs#5899)
- CoreAPI: Don't panic when testing incomplete implementions (ipfs/go-ipfs#5900)
- gateway: fix CORs headers (ipfs/go-ipfs#5893)
- Local Gateway option (ipfs/go-ipfs#5649)
- Show hash on gateway (ipfs/go-ipfs#5830)
- fix: ulimit docs mistake (ipfs/go-ipfs#5894)
- Move coreapi tests to the interface (ipfs/go-ipfs#5865)
- Move checkHelptextRecursive forward a bit (ipfs/go-ipfs#5889)
- coreapi/unixfs: Use path instead of raw hash in AddEvent (ipfs/go-ipfs#5854)
- Fix name resolve --offline (ipfs/go-ipfs#5885)
- testing: slow down republisher sharness test (ipfs/go-ipfs#5856)
- docs: flesh out plugin documentation (ipfs/go-ipfs#5876)
- main: move InterruptHandler to util (ipfs/go-ipfs#5872)
- make: fix building source tarball on macos (ipfs/go-ipfs#5860)
- fix config data race (ipfs/go-ipfs#5634)
- CoreAPI: Global offline option (ipfs/go-ipfs#5825)
- Update for go-ipfs-files refactor (ipfs/go-ipfs#5661)
- feat: update Web UI to v2.3.0 (ipfs/go-ipfs#5855)
- Stateful plugin loading (ipfs/go-ipfs#4806)
- startup: always load the private key (ipfs/go-ipfs#5844)
- add --dereference-args parameter (ipfs/go-ipfs#5801)
- config: document the connection manager (ipfs/go-ipfs#5839)
- add pinning support to the urlstore (ipfs/go-ipfs#5834)
- refact(cmd/cat): remove useless code (ipfs/go-ipfs#5836)
- Really run as non-root user in docker container (ipfs/go-ipfs#5048)
- README: document guix package (ipfs/go-ipfs#5832)
- docs: Improve config documentation (ipfs/go-ipfs#5829)
- block: rm extra output (ipfs/go-ipfs#5751)
- merge github-issue-guide with the issue template (ipfs/go-ipfs#4636)
- docs: fix inconsistent capitalization of "API". (ipfs/go-ipfs#5824)
- Update README.md (ipfs/go-ipfs#5818)
- CONTRIBUTING.md link (ipfs/go-ipfs#5811)
- README: Update required Go version (ipfs/go-ipfs#5813)
- p2p: report-peer-id option for listen (ipfs/go-ipfs#5771)
- really fix netcat race (ipfs/go-ipfs#5803)
- [http_proxy_over_p2p] (ipfs/go-ipfs#5526)
- coreapi/pin: Use CID's directly in maps instead of converting to string (ipfs/go-ipfs#5809)
- Gx update go-merkledag and related deps. (ipfs/go-ipfs#5802)
- cmds: rm old lib (ipfs/go-ipfs#5786)
- badger: add truncate flag (ipfs/go-ipfs#5625)
- docker: allow IPFS_PROFILE to choose the profile for
ipfs init
(ipfs/go-ipfs#5473) - Add --stream option to
ls
command (ipfs/go-ipfs#5611) - Switch to using request.Context() (ipfs/go-ipfs#5782)
- Update go-ipfs-delay and assoc deps (ipfs/go-ipfs#5762)
- Suppress bootstrap error (ipfs/go-ipfs#5769)
- ISSUE_TEMPLATE: move the support question comment to the very top (ipfs/go-ipfs#5770)
- cmds: use MakeTypedEncoder (ipfs/go-ipfs#5760)
- cmds/bitswap: sort wantlist (ipfs/go-ipfs#5759)
- cmds/update: use new cmds lib (ipfs/go-ipfs#5730)
- cmds/file: use new cmds lib (ipfs/go-ipfs#5756)
- cmds: remove reduntant func (ipfs/go-ipfs#5750)
- commands/refs: use new cmds (ipfs/go-ipfs#5679)
- commands/pin: use new cmds lib (ipfs/go-ipfs#5674)
- commands/boostrap: use new cmds (ipfs/go-ipfs#5678)
- fix(cmd/add): progressbar output error when input is read from stdin (ipfs/go-ipfs#5743)
- unexport GOFLAGS (ipfs/go-ipfs#5747)
- refactor(cmds): use new cmds (ipfs/go-ipfs#5659)
- commands/filestore: use new cmds lib (ipfs/go-ipfs#5673)
- Fix broken links (ipfs/go-ipfs#5721)
- fix
ipfs help
bug #5557 (ipfs/go-ipfs#5573) - commands/bitswap: use new cmds lib (ipfs/go-ipfs#5676)
- refact(cmd/repo): repo's sub cmds uses new cmd lib (ipfs/go-ipfs#5677)
- fix the maketarball script (ipfs/go-ipfs#5718)
- output link to WebUI on daemon startup (ipfs/go-ipfs#5729)
- Move persistent datastores to plugins (ipfs/go-ipfs#5695)
- Update IPTB test (ipfs/go-ipfs#5636)
- enhance(cmd/verify): add goroutine count to improve verify speed (ipfs/go-ipfs#5710)
- Update go-mfs and go-unixfs (ipfs/go-ipfs#5714)
- fix(flag/version): flag
all
should have a higher priority (ipfs/go-ipfs#5719) - commands/p2p: use new cmds lib (ipfs/go-ipfs#5672)
- commands/dht: use new cmds lib (ipfs/go-ipfs#5671)
- commands/object: use new cmds (ipfs/go-ipfs#5666)
- commands/files: use new cmds (ipfs/go-ipfs#5665)
- cmds/env: add a config path helper (ipfs/go-ipfs#5712)
- github.com/ipfs/dir-index-html:
- show hash if given (ipfs/dir-index-html#21)
- Add "jpeg" as an alias to "jpg". (ipfs/dir-index-html#16)
- github.com/libp2p/go-addr-util:
- Improve test coverage (libp2p/go-addr-util#14)
- github.com/ipfs/go-bitswap:
- fix(prq): fix a bunch of goroutine leaks and deadlocks (ipfs/go-bitswap#87)
- remove allocations round two (ipfs/go-bitswap#84)
- fix(bitswap): remove CancelWants function (ipfs/go-bitswap#80)
- Avoid allocating for wantlist entries (ipfs/go-bitswap#79)
- ci(Jenkins): remove Jenkinsfile (ipfs/go-bitswap#83)
- More specific wantlists (ipfs/go-bitswap#74)
- fix(wantlist): remove races on setup (ipfs/go-bitswap#72)
- fix multiple data races (ipfs/go-bitswap#76)
- ci: add travis (ipfs/go-bitswap#75)
- providers: don't add every connected node as a provider (ipfs/go-bitswap#59)
- refactor(GetBlocks): Merge session/non-session (ipfs/go-bitswap#64)
- Feat: A more robust provider finder for sessions (for now) and soon for all bitswap (ipfs/go-bitswap#60)
- fix(tests): stabilize session tests (ipfs/go-bitswap#63)
- contexts: make sure to abort when a context is canceled (ipfs/go-bitswap#58)
- fix(sessions): explicitly connect found peers (ipfs/go-bitswap#56)
- Speed up sessions Round #1 (ipfs/go-bitswap#27)
- Fix debug log formatting issues (ipfs/go-bitswap#37)
- Feat/bandwidth limited tests (ipfs/go-bitswap#42)
- fix(tests): stabilize unreliable session tests (ipfs/go-bitswap#44)
- Bitswap Refactor #4: Extract session peer manager from sessions (ipfs/go-bitswap#26)
- Bitswap Refactor #3: Extract sessions to package (ipfs/go-bitswap#30)
- docs(comments): end comment sentences to have full-stop (ipfs/go-bitswap#33)
- Bitswap Refactor #2: Extract PeerManager From Want Manager + Unit Test (ipfs/go-bitswap#29)
- Bitswap Refactor #1: Session Manager & Extract Want Manager (ipfs/go-bitswap#28)
- fix(Receiver): Ignore unwanted blocks (ipfs/go-bitswap#24)
- feat(Benchmarks): Add real world dup blocks test (ipfs/go-bitswap#25)
- Feat/bitswap pr improvements (ipfs/go-bitswap#19)
- github.com/ipfs/go-blockservice:
- Don't return errors on closed exchange (ipfs/go-blockservice#15)
- github.com/ipfs/go-cid:
- fix inline CIDs generated by Prefix.Sum (ipfs/go-cid#84)
- Let Cid implement Binary[Un]Marshaler and Text[Un]Marshaler interfaces. (ipfs/go-cid#81)
- fix typo in comment (ipfs/go-cid#80)
- add codecs for Dash blocks, tx (ipfs/go-cid#78)
- github.com/ipfs/go-cidutil:
- Fix Travis CI to run all tests. (ipfs/go-cidutil#11)
- Changes needed for
--cid-base
option in go-ipfs (simplified vesion) (ipfs/go-cidutil#10) - add a utility method for sorting CID slices (ipfs/go-cidutil#5)
- github.com/libp2p/go-conn-security:
- fix link to usage example in README (libp2p/go-conn-security#4)
- github.com/ipfs/go-datastore:
- interfaces: make GetBacked* take a Read instead of a Datastore (ipfs/go-datastore#115)
- remove closer type assertions (ipfs/go-datastore#112)
- remove io.Closer from the transaction interface (ipfs/go-datastore#113)
- feat(datastore): expose datastore Close() (ipfs/go-datastore#111)
- query: make datastore ordering act like a user would expect (ipfs/go-datastore#110)
- delayed: implement io.Closer and export datastore type. (ipfs/go-datastore#108)
- split the datastore into a read and a write interface (ipfs/go-datastore#107)
- Describe behavior of Batching datastores (ipfs/go-datastore#105)
- handle concurrent puts/deletes in BasicBatch (ipfs/go-datastore#103)
- add a GetSize method (ipfs/go-datastore#99)
- github.com/ipfs/go-ds-badger:
- removed additional/wasteful Prefix conversion (ipfs/go-ds-badger#45)
- Enable Jenkins (ipfs/go-ds-badger#35)
- fix application or ordering for interface change (ipfs/go-ds-badger#44)
- Update badger (ipfs/go-ds-badger#40)
- github.com/ipfs/go-ds-flatfs:
- fix a goroutine leak killing the gateways (ipfs/go-ds-flatfs#51)
- github.com/ipfs/go-ds-leveldb:
- Expose Datastore type (ipfs/go-ds-leveldb#20)
- fix application or ordering for interface change (ipfs/go-ds-leveldb#23)
- github.com/ipfs/go-ipfs-cmds:
- fix sync error with go1.12 on darwin (ipfs/go-ipfs-cmds#147)
- cli: fix ignoring std{out,err} sync errors on windows (ipfs/go-ipfs-cmds#146)
- roundup of cleanup fixes (ipfs/go-ipfs-cmds#144)
- Update cors library (ipfs/go-ipfs-cmds#139)
- expand on the api error (ipfs/go-ipfs-cmds#138)
- set the connection close header if we have a body to read (ipfs/go-ipfs-cmds#116)
- print a nicer error on timeout/cancel (ipfs/go-ipfs-cmds#137)
- Add link traversal option (ipfs/go-ipfs-cmds#96)
- Don't skip stdin test on Windows (ipfs/go-ipfs-cmds#136)
- MakeTypedEncoder: accept results by pointer or value (ipfs/go-ipfs-cmds#134)
- github.com/ipfs/go-ipfs-config:
- Gateway.NoFetch (ipfs/go-ipfs-config#19)
- add a Clone function (ipfs/go-ipfs-config#16)
- randomports: give user ability to init ipfs using random port for swarm. (ipfs/go-ipfs-config#17)
- Allow the use of the User-Agent header (ipfs/go-ipfs-config#15)
- autorelay options (ipfs/go-ipfs-config#21)
- profile: add badger truncate option (ipfs/go-ipfs-config#20)
- github.com/ipfs/go-ipfs-delay:
- Feat/refactor wait time (ipfs/go-ipfs-delay#1)
- github.com/ipfs/go-ipfs-files:
- multipart: fix handling of common prefixes (ipfs/go-ipfs-files#7)
- create implicit directories from multipart requests (ipfs/go-ipfs-files#6)
- TarWriter (ipfs/go-ipfs-files#4)
- Refactor filename - file relation (ipfs/go-ipfs-files#2)
- github.com/ipfs/go-ipld-cbor:
- cbor: decode undefined as null (ipfs/go-ipld-cbor#54)
- error when trying to encode an empty link (ipfs/go-ipld-cbor#52)
- test for struct with both a cid and a bigint (ipfs/go-ipld-cbor#51)
- github.com/ipfs/go-ipld-format:
- Add a DAG walker with support for IPLD
Node
s (ipfs/go-ipld-format#39) - Add BufferedDAG wrapping Batch as a DAGService. (ipfs/go-ipld-format#48)
- Add a DAG walker with support for IPLD
- github.com/ipfs/go-ipld-git:
- Fix blob marshalling (ipfs/go-ipld-git#37)
- Re-enable assertion on commit size -- it is correct after #31 (ipfs/go-ipld-git#33)
- Use OS path separator in testing, fixes #30 (ipfs/go-ipld-git#34)
- Use rawdata length for size, fixes #7 (ipfs/go-ipld-git#31)
- Cache RawData for Commit, Tag, & Tree, fixes #6 (ipfs/go-ipld-git#28)
- Precompute Blob CID, fixes #21 (ipfs/go-ipld-git#27)
- Enable Jenkins (ipfs/go-ipld-git#29)
- github.com/ipfs/go-ipns:
- fix community/CONTRIBUTING.md link in README.md (ipfs/go-ipns#20)
- fix typo in README.md (ipfs/go-ipns#21)
- testing: disable inline peer ID test (ipfs/go-ipns#19)
- github.com/libp2p/go-libp2p:
- Fixed race conditions in mock package mock_stream and mock_conn (libp2p/go-libp2p#535)
- increase initial relay advertisement delay to 30s (libp2p/go-libp2p#534)
- Use PeerRouting in autorelay to find relay peer addresses (libp2p/go-libp2p#531)
- docs: update broken links in NEWS.md (libp2p/go-libp2p#517)
- don't advertise the raw public address in autorelay (libp2p/go-libp2p#511)
- mock: export ratelimiter as RateLimiter (libp2p/go-libp2p#507)
- readme: remove duplicate repo entries in README and package-list.json (libp2p/go-libp2p#506)
- explicit option to enable autorelay (libp2p/go-libp2p#500)
- Add delay in initial relay advertisement to allow the dht time to bootstrap (libp2p/go-libp2p#495)
- suppressing error msg for NoSecurity option (libp2p/go-libp2p#498)
- pulling updates (libp2p/go-libp2p#4)
- fix contributing link in README (libp2p/go-libp2p#494)
- Fix badges and links on README.md (libp2p/go-libp2p#485)
- mocknet: fix NewStream and self dials (libp2p/go-libp2p#480)
- deflake identify test (libp2p/go-libp2p#479)
- mocknet: use peer ID in peer address (libp2p/go-libp2p#476)
- autorelay (libp2p/go-libp2p#454)
- Getting updates (libp2p/go-libp2p#3)
- github.com/libp2p/go-libp2p-autonat:
- track autonat peer addresses (libp2p/go-libp2p-autonat#7)
- github.com/libp2p/go-libp2p-circuit:
- Don't log raw binary (libp2p/go-libp2p-circuit#53)
- github.com/libp2p/go-libp2p-connmgr:
- Fix concurrency and silence period not being honoured (libp2p/go-libp2p-connmgr#26)
- github.com/libp2p/go-libp2p-crypto:
- Fix: Remove redundant Ed25519 public key (#36). (libp2p/go-libp2p-crypto#54)
- libp2p badges, remove IPFS (libp2p/go-libp2p-crypto#52)
- Fix broken contribute link in README (libp2p/go-libp2p-crypto#46)
- forbid RSA keys smaller than 512 bits (libp2p/go-libp2p-crypto#43)
- Added ECDSA; Added RSA tests; Fixed linting errors; Handling all un-handled errors (libp2p/go-libp2p-crypto#35)
- switch to the go-crypto ed25519 implementation (libp2p/go-libp2p-crypto#38)
- update gogo protobuf (libp2p/go-libp2p-crypto#37)
- github.com/libp2p/go-libp2p-discovery:
- add a timeout to Provide in routing.Advertise (libp2p/go-libp2p-discovery#12)
- correctly encode ns to CID (libp2p/go-libp2p-discovery#11)
- use 6hrs as ttl for routing based advertisements (libp2p/go-libp2p-discovery#8)
- github.com/libp2p/go-libp2p-host:
- Helper to get PeerInfo from Host (libp2p/go-libp2p-host#20)
- github.com/libp2p/go-libp2p-kad-dht:
- fix(dialQueue): account for failed dials (libp2p/go-libp2p-kad-dht#277)
- Fix Bootstrap sub-queries (libp2p/go-libp2p-kad-dht#264)
- dial queue: fix possible goroutine leak (libp2p/go-libp2p-kad-dht#262)
- Alter some logging (libp2p/go-libp2p-kad-dht#269)
- Revert #236: Test go mod in travis and use major versioning in import paths (libp2p/go-libp2p-kad-dht#259)
- fix tests on freebsd (libp2p/go-libp2p-kad-dht#255)
- Fix "no protocol with name dnsaddr" error (libp2p/go-libp2p-kad-dht#247)
- Fix a race in dial queue (libp2p/go-libp2p-kad-dht#248)
- Fix races with DialQueue variables (libp2p/go-libp2p-kad-dht#241)
- Fix CircleCI (libp2p/go-libp2p-kad-dht#238)
- Adaptive queue for staging dials (libp2p/go-libp2p-kad-dht#237)
- Add the full libp2p default bootstrap peer list (libp2p/go-libp2p-kad-dht#226)
- Revert "Tidy up bootstrapping" (libp2p/go-libp2p-kad-dht#232)
- Tidy up bootstrapping (libp2p/go-libp2p-kad-dht#225)
- Revert "Remove signal bootstrapping" (libp2p/go-libp2p-kad-dht#227)
- Remove signal bootstrapping (libp2p/go-libp2p-kad-dht#224)
- fix a potential DHT query hang (libp2p/go-libp2p-kad-dht#219)
- docs: duplicate pkg documentation (libp2p/go-libp2p-kad-dht#218)
- tests: skip key inlining test (libp2p/go-libp2p-kad-dht#212)
- Rephrase "betterPeersToQuery" method comment to be less cryptic (libp2p/go-libp2p-kad-dht#206)
- github.com/libp2p/go-libp2p-loggables:
- test: add unit tests (libp2p/go-libp2p-loggables#21)
- github.com/libp2p/go-libp2p-netutil:
- Add tests (libp2p/go-libp2p-netutil#28)
- github.com/libp2p/go-libp2p-peer:
- fix: re-enable peer ID inlining but make it configurable (libp2p/go-libp2p-peer#42)
- Protobuf and JSON (un-)marshalling methods for peer.ID (libp2p/go-libp2p-peer#41)
- disable key inlining (libp2p/go-libp2p-peer#40)
- github.com/libp2p/go-libp2p-peerstore:
- Add unit test to verify AddAddr doesn't shorten TTL (libp2p/go-libp2p-peerstore#52)
- disable inline-peer id test (libp2p/go-libp2p-peerstore#49)
- README: Update contributing guideline linkrot. (libp2p/go-libp2p-peerstore#48)
- Deterministic benchmark order; Keybook interface benchmarks (libp2p/go-libp2p-peerstore#43)
- PeerInfo UnMarshal Error #393 (libp2p/go-libp2p-peerstore#45)
- fix the inline key test (libp2p/go-libp2p-peerstore#44)
- github.com/libp2p/go-libp2p-pubsub:
- move timecache check/update after validation (libp2p/go-libp2p-pubsub#156)
- fix nonsensical check (libp2p/go-libp2p-pubsub#154)
- Extend validator interface to include message source (libp2p/go-libp2p-pubsub#151)
- Implement peer blacklist (libp2p/go-libp2p-pubsub#149)
- make timecache duration configurable (libp2p/go-libp2p-pubsub#148)
- godoc is not html either (libp2p/go-libp2p-pubsub#147)
- godoc documentation is not markdown (libp2p/go-libp2p-pubsub#146)
- Add documentation for subscribe's non-instanteneous semantics (libp2p/go-libp2p-pubsub#145)
- Some documentation (libp2p/go-libp2p-pubsub#140)
- rework peer tracking logic to handle multiple connections (libp2p/go-libp2p-pubsub#132)
- github.com/libp2p/go-libp2p-pubsub-router:
- encode record-store keys in pubsub (libp2p/go-libp2p-pubsub-router#17)
- github.com/libp2p/go-libp2p-quic-transport:
- fix badges in README (libp2p/go-libp2p-quic-transport#39)
- Fix missing transport parameter in dialed connection (libp2p/go-libp2p-quic-transport#38)
- github.com/libp2p/go-libp2p-routing:
- Update the comment on IpfsRouting.Bootstrap (libp2p/go-libp2p-routing#36)
- github.com/libp2p/go-libp2p-swarm:
- Make FD limits configurable by environment property (libp2p/go-libp2p-swarm#102)
- Fix logging race (libp2p/go-libp2p-swarm#100)
- Add CircleCI config (libp2p/go-libp2p-swarm#99)
- Enhance debug logging in dial limiter (libp2p/go-libp2p-swarm#98)
- dialer: handle dial cancel and/or completion before trying new addresses (libp2p/go-libp2p-swarm#96)
- avoid spawning goroutines for canceled dials (libp2p/go-libp2p-swarm#95)
- warn when we encounter a useless transport (libp2p/go-libp2p-swarm#90)
- github.com/libp2p/go-libp2p-transport:
- fix transport tests for quic (libp2p/go-libp2p-transport#39)
- fix: fully close streams before returning (libp2p/go-libp2p-transport#37)
- fix typo in README (libp2p/go-libp2p-transport#36)
- github.com/libp2p/go-libp2p-transport-upgrader:
- annotate errors (libp2p/go-libp2p-transport-upgrader#11)
- github.com/ipfs/go-log:
- uglify the (event) logs (ipfs/go-log#53)
- add environment variable for writing tracing information to a file (ipfs/go-log#52)
- correctly display the line number when FinishWithErr fails (ipfs/go-log#51)
- github.com/libp2p/go-maddr-filter:
- test: extend test to improve coverage (libp2p/go-maddr-filter#7)
- github.com/ipfs/go-merkledag:
- Increase FetchGraphConcurrency to 32 (ipfs/go-merkledag#29)
- Enable CI (ipfs/go-merkledag#9)
- fix a fetch deadlock on error (ipfs/go-merkledag#21)
- Wait for all go routines to finish before function returns (ipfs/go-merkledag#19)
- github.com/ipfs/go-metrics-prometheus:
- use prometheus instead of gxed (ipfs/go-metrics-prometheus#3)
- github.com/ipfs/go-mfs:
- fix(mv): dst filename error (ipfs/go-mfs#62)
- fix over-wait in WaitPub (ipfs/go-mfs#53)
- Fix/32/pr ports from go-ipfs to go-mfs (ipfs/go-mfs#49)
- remove the
fullSync
option fromupdateChildEntry
(ipfs/go-mfs#45) - Various refactorings (ipfs/go-mfs#36)
- use RW lock for the
File
's lock (ipfs/go-mfs#43) - add documentation links in README (ipfs/go-mfs#41)
- [WIP] documentation notes (ipfs/go-mfs#27)
- feat(inode): add inode struct (ipfs/go-mfs#12)
- github.com/libp2p/go-mplex:
- fix deadlock (libp2p/go-mplex#39)
- When a stream is closed, cancel pending writes (libp2p/go-mplex#35)
- make sure to but the buffer back in the pool (libp2p/go-mplex#34)
- reduce the packet count (libp2p/go-mplex#29)
- github.com/ipfs/go-path:
- fix: no components error (ipfs/go-path#18)
- nit: validate CIDs in IPLD paths (ipfs/go-path#16)
- github.com/libp2p/go-reuseport:
- Fix build on wasm (libp2p/go-reuseport#59)
- Use Go Control API (libp2p/go-reuseport#56)
- Support WASM (libp2p/go-reuseport#54)
- github.com/libp2p/go-reuseport-transport:
- Update to go-reuseport 0.2.0 (libp2p/go-reuseport-transport#6)
- github.com/libp2p/go-stream-muxer:
- add standard reset error (libp2p/go-stream-muxer#23)
- ci: fix (libp2p/go-stream-muxer#24)
- Document Reset versus Close (libp2p/go-stream-muxer#18)
- WIP document Conn.Close (libp2p/go-stream-muxer#19)
- github.com/libp2p/go-tcp-transport:
- Deprecate IPFS_REUSEPORT, use LIBP2P_TCP_REUSEPORT (libp2p/go-tcp-transport#27)
- github.com/ipfs/go-unixfs:
- unixfile: precalc dir size (ipfs/go-unixfs#61)
- Archive refactor (ipfs/go-unixfs#59)
- decouple the DAG traversal logic from the DAG reader (local branch) (ipfs/go-unixfs#60)
- Unixfs: enforce refs on files when using nocopy (ipfs/go-unixfs#56)
- Fix/handle overflow (ipfs/go-unixfs#53)
- feat(Directory): Add EnumLinksAsync method (ipfs/go-unixfs#39)
This is probably one of the largest go-ipfs releases in recent history, 3 months in the making.
The headline features this release are experimental QUIC support, the gossipsub
pubsub routing algorithm, pubsub message signing, and a refactored ipfs p2p
command. However, that's just scratching the surface.
First up, on the networking front, this release has also introduced experimental support for the QUIC protocol. QUIC is a new UDP-based network transport that solves many of the long standing issues with TCP.
For us, this means (eventually):
- Fewer local resources. TCP requires a file-descriptor per connection while QUIC (and most UDP based transports) can share a single file descriptor between all connections. This should allow us to dial faster and keep more connections open.
- Faster connection establishment. When client authentication is included, QUIC has a three-way handshake like TCP. However, unlike TCP, this handshake brings us from all the way from 0 to a fully encrypted, authenticated, and multiplexed connection. In theory (not yet in practice), this should significantly reduce the latency of DHT queries.
- Behaves better on lossy networks. When multiplexing multiple requests over a single TCP connection, a single dropped packet will bring the entire connection to a halt while the packet is re-transmitted. However, because QUIC handles multiplexing internally, dropping a single packets affects only the related stream.
- Better NAT traversal. TL;DR: NAT hole-punching is significantly easier and, in many cases, more reliable with UDP than with TCP.
However, we still have a long way to go. While we encourage users to test this, the IETF QUIC protocol is still being actively developed and will change. You can find instructions for enabling it here.
In terms of pubsub, go-ipfs now supports the gossipsub routing algorithm and message signing.
The gossipsub routing algorithm is significantly more efficient than the current floodsub routing algorithm. Even better, it's fully backwards compatible so you can enable it and still talk to nodes using the floodsub algorithm. You can find instructions to enable gossipsub in go-ipfs here.
Messages are now signed by their authors. While signing has now been enabled by default, strict signature verification has not been and will not be for at least one release (probably multiple) to avoid breaking existing applications. You can read about how to configure this feature here.
In terms of new toys, this release introduces a new ipfs cid
subcommand for
working with CIDs, a completely refactored ipfs p2p
command, streaming name
resolution, and complete inline block support.
The new ipfs cid
command allows users to both inspect CIDs and convert them
between various formats and versions. For example:
# Print out the CID metadata (prefix)
> ipfs cid format -f %P QmT78zSuBmuS4z925WZfrqQ1qHaJ56DQaTfyMUF7F8ff5o
cidv0-protobuf-sha2-256-32
# Get the hex sha256 hash from the CID.
> ipfs cid format -b base16 -f '0x%D' QmT78zSuBmuS4z925WZfrqQ1qHaJ56DQaTfyMUF7F8ff5o
0x46d44814b9c5af141c3aaab7c05dc5e844ead5f91f12858b021eba45768b4c0e
# Convert a base58 v0 CID to a base32 v1 CID.
> ipfs cid base32 QmT78zSuBmuS4z925WZfrqQ1qHaJ56DQaTfyMUF7F8ff5o
bafybeicg2rebjoofv4kbyovkw7af3rpiitvnl6i7ckcywaq6xjcxnc2mby
The refactored ipfs p2p
command allows forwarding TCP streams through two IPFS
nodes from one host to another. It's ssh -L
but for IPFS. You can find
documentation
here.
It's still experimental but we don't expect too many breaking changes at this
point (it will very likely be stabilized in the next release). Quick summary of
breaking changes:
- We don't stop listening for local (forwarded) connections after accepting a single connection.
ipfs p2p stream ls
output now returns more useful output, first address is always the initiator address.ipfs p2p listener ls
is renamed toipfs p2p ls
ipfs p2p listener close
is renamed toipfs p2p close
- Protocol names have to be prefixed with
/x/
and are now just passed to libp2p as handler name. Previous version did this 'under the hood' and with/p2p/
prefix. There is a--allow-custom-protocol
flag which allows you to use any libp2p handler name. ipfs p2p listener open
andipfs p2p stream dial
got renamed:ipfs p2p listener open p2p-test /ip4/127.0.0.1/tcp/10101
new becomesipfs p2p listen /x/p2p-test /ip4/127.0.0.1/tcp/10101
ipfs p2p stream dial $NODE_A_PEERID p2p-test /ip4/127.0.0.1/tcp/10102
is nowipfs p2p forward /x/p2p-test /ip4/127.0.0.1/tcp/10102 /ipfs/$NODE_A_PEERID
There is now a new flag for ipfs name resolve
- --stream
. When the command
is invoked with the flag set, it will start returning results as soon as they
are discovered in the DHT and other routing mechanisms. This enables certain
applications to start prefetching/displaying data while the discovery is still
running. Note that this command will likely return many outdated records
before it finding and returning the latest. However, it will always return
valid records (even if a bit stale).
Finally, in the previous release, we added support for extracting blocks inlined
into CIDs. In this release, we've added support for creating these CIDs. You can
now run ipfs add
with the --inline
flag to inline blocks less than or equal
to 32 bytes in length into a CID, instead of writing an actual block. This
should significantly reduce the size of filesystem trees with many empty
directories and tiny files.
You can now publish and resolve paths with namespaces other than /ipns
and
/ipfs
through IPNS. Critically, IPNS can now be used with IPLD paths (paths
starting with /ipld
).
Finally, this release includes the shiny updated webui. You can view it by installing go-ipfs and visiting http://localhost:5001/webui.
This release includes some significant performance improvements, both in terms of resource utilization and speed. This section will go into some technical details so feel free to skip it if you're just looking for shiny new features.
In this release, we've (a) fixed a slow memory leak in libp2p and (b) significantly reduced the allocation load. Together, these should improve both memory and CPU usage.
We've changed two of our most frequently used datastructures, CIDs and Multiaddrs, to reduce allocation load.
First, we now store CIDs encode as strings, instead of decoded in structs
(behind pointers). In addition to being more compact, our Cid
type is now a
valid map
key so we no longer have to encode CIDs every time we want to use
them in a map/set. Allocations when inserting CIDs into maps/sets was showing up
as a significant source of allocations under heavy load so this change should
improve memory usage.
Second, we've changed many of our multiaddr parsing/processing/formatting functions to allocate less. Much of our DHT related-work includes processing multiaddrs so this should reduce CPU utilization when heavily using the DHT.
Streams have always plagued us in terms of memory utilization. This was partially solved by introducing the connection manager, keeping our maximum connection count to a reasonable number but they're still a major memory sink.
This release sees two improvements on this front:
- A memory leak in identify has been fixed. This was slowly causing us to leak connections (locking up the memory used by the connections' streams).
- Yamux streams now use a buffer-pool backed, auto shrinking read buffer. Before, this read buffer would grow to its maximum size (a few megabytes) and never shrink but these buffers now shrink as they're emptied.
Bitswap will now pack multiple small blocks into a single message thanks ipfs/go-bitswap#5. While this won't help when transferring large files (with large blocks), this should help when transferring many tiny files.
This release saw yet another commands-library refactor, work towards the CoreAPI, and the first step towards reliable base32 CID support.
We've completely refactored our commands library (again). While it still needs quite a bit of work, it now requires significantly less boilerplate and should be significantly more robust. The refactor immediately found two broken tests and probably fixed quite a few bugs around properly returning and handling errors.
CoreAPI is a new way to interact with IPFS from Go. While it's still not final, most things you can do via the CLI or HTTP interfaces, can now be done through the new API.
Currently there is only one implementation, backed by go-ipfs node, and there are plans to start http-api backed one soon. We are also looking into creating RPC interface using this API, which could help performance in some use cases.
You can track progress in ipfs#4498
We introduced new path type which introduces distinction between IPLD and
IPFS (unixfs) paths. From now on paths prefixed with /ipld/
will always
use IPLD link traversal and /ipfs/
will use unixfs path resolver, which
takes things like shardnig into account.
Note that this is only initial support and there likely are some bugs in how the paths are handled internally, so consider this feature experimental for now.
Currently, IPFS is usually used in browsers by browsing to
https://SOME_GATEWAY/ipfs/CID/...
. There are two significant drawbacks to this
approach:
- From a browser security standpoint, all IPFS "sites" will live under the same origin (SOME_GATEWAY).
- From a UX standpoint, this doesn't feel very "native" (even if the gateway is a local IPFS node).
To fix the security issue, we intend to switch IPFS gateway links
https://ipfs.io/ipfs/CID
to to https://CID.ipfs.dweb.link
. This way, the CID
will be a part of the
"origin" so
each IPFS website will get a separate security origin.
To fix the UX issue, we've been working on adding support for ipfs://CID/...
to web browsers through our
ipfs-companion add-on and some new,
experimental extension APIs from Mozilla. This has the same effect of putting
the CID in the URL origin but has the added benefit of looking "native".
Unfortunately, origins must be case insensitive. Currently, most CIDs users
see are CIDv0 CIDs (those starting with Qm
) which are always base58
encoded and are therefore case-sensitive.
Fortunately, CIDv1 (the latest CID format) supports arbitrary bases using the multibase standard. Unfortunately, IPFS has always treated equivalent CIDv0 and CIDv1 CIDs as distinct. This means that files added with CIDv0 CIDs (the default) can't be looked up using the equivalent CIDv1.
This release makes some significant progress towards solving this issue by introducing two features:
(1) The previous mentioned ipfs cid base32
command for converting CID to a
case intensive encoding required by domain names. This command converts a CID to
version 1 and encodes it using base32.
(2) A hack to allow locally looking up blocks associated with a CIDv0 CID using the equivalent CIDv1 CID (or the reverse). This hack will eventually be replaced with a multihash indexed blockstore, which is agnostic to both the CID version and multicodec content type.
Features (i.e., users take heed):
- gossipsub (ipfs/go-ipfs#5373)
- support /ipfs/CID in
ipfs dht findprovs
(ipfs/go-ipfs#5329) - return a json object from config show (ipfs/go-ipfs#5345)
- Set filename in Content-Disposition if filename=x is passed in URI query (ipfs/go-ipfs#4177)
- Allow mfs files.write command to create parent directories (ipfs/go-ipfs#5359)
- Run DNS lookup for --api endpoint provided in CLI (ipfs/go-ipfs#5372)
- Add support for inlinling blocks into CIDs the id-hash (ipfs/go-ipfs#5281)
- depth limited refs -r (ipfs/go-ipfs#5337)
- remove bitswap unwant (ipfs/go-ipfs#5308)
- add experimental QUIC support (ipfs/go-ipfs#5350)
- add a --stdin-name flag for naming files from stdin (ipfs/go-ipfs#5399)
- Refactor
ipfs p2p
(ipfs/go-ipfs#4929) - add dns support in
ipfs p2p forward
and refactor code (ipfs/go-ipfs#5533) - feat(command): expose connection direction (ipfs/go-ipfs#5457)
- error when publishing ipns records without a running daemon (ipfs/go-ipfs#5477)
- feat(daemon): print version on start (ipfs/go-ipfs#5503)
- add quieter option to name publish (ipfs/go-ipfs#5494)
- Provide new "cid" sub-command. (ipfs/go-ipfs#5385)
- feat(command): add force flag for files rm (ipfs/go-ipfs#5555)
- Add support for datastore plugins (ipfs/go-ipfs#5187)
- files ls: append slash to directory names (ipfs/go-ipfs#5605)
- ipfs name resolve --stream (ipfs/go-ipfs#5404)
- update webui to 2.1.0 (ipfs/go-ipfs#5627)
- feat: add dry-run flag for config profile apply command (ipfs/go-ipfs#5455)
- configurable pubsub signing (ipfs/go-ipfs#5647)
Fixes (i.e., users take note):
- pin update fixes (ipfs/go-ipfs#5265)
- Fix inability to pin two things at once (ipfs/go-ipfs#5512)
- wait for all connections to close before exiting on shutdown. (ipfs/go-ipfs#5322)
- Fixed ipns address resolution in fuse unix mount (ipfs/go-ipfs#5384)
- core/commands/ls: wrap
NewDirectoryFromNode
error (ipfs/go-ipfs#5166) - fix goroutine leaks in filestore.go (ipfs/go-ipfs#5427)
- move VersionOption after GatewayOption to fix #5422 (ipfs/go-ipfs#5424)
- fix(commands): fix filestore.go goroutine leak (ipfs/go-ipfs#5439)
- fix(commands): goroutine leaks in ping.go (ipfs/go-ipfs#5444)
- fix output of object command (ipfs/go-ipfs#5459)
- add warning when no bootstrap in config (ipfs/go-ipfs#5445)
- fix behaviour of key rename to same name (ipfs/go-ipfs#5465)
- fix(object): print object diff error (ipfs/go-ipfs#5469)
- fix(pin): goroutine leaks (ipfs/go-ipfs#5453)
- fix offline id bug (ipfs/go-ipfs#5486)
- files cp: improve flush error message (ipfs/go-ipfs#5485)
- resolve: fix unixfs resolution through sharded directories (ipfs/go-ipfs#5484)
- Switch name publish/resolve to coreapi (ipfs/go-ipfs#5563)
- use CoreAPI resolver everywhere (fixes sharded directory resolution) (ipfs/go-ipfs#5492)
- add pin lock in AddallPin function (ipfs/go-ipfs#5506)
- take the pinlock when updating pins (ipfs/go-ipfs#5550)
- fix(object): add support for raw leaves in object diff (ipfs/go-ipfs#5472)
- don't use the domain name as a filename in /ipns/a.com (ipfs/go-ipfs#5564)
- refactor(command): modify int to int64 (ipfs/go-ipfs#5612)
- fix(core): ipns config RecordLifetime panic (ipfs/go-ipfs#5648)
- simplify dag put and correctly take pin lock (ipfs/go-ipfs#5667)
- fix prometheus concurrent map write bug (ipfs/go-ipfs#5706)
Regressions Fixes (fixes for bugs introduced since the last release):
- namesys: properly attach path in name.Resolve (ipfs/go-ipfs#5660)
- fix(p2p): issue #5523 (ipfs/go-ipfs#5529)
- fix infinite loop in
stats bw
(ipfs/go-ipfs#5598) - make warnings on no bootstrap peers less noisy (ipfs/go-ipfs#5466)
- fix two transport related bugs (ipfs/go-ipfs#5417)
- Fix pin ls output when hash is specified (ipfs/go-ipfs#5699)
- ping: switch to the ping service enabled in the libp2p constructor (ipfs/go-ipfs#5698)
- commands: fix a bunch of tiny commands-lib issues (ipfs/go-ipfs#5697)
- cleanup the ping command (ipfs/go-ipfs#5680)
- fix gossipsub goroutine explosion (ipfs/go-ipfs#5688)
- fix(cmd/gc): Run func does not return error when Emit func returns error (ipfs/go-ipfs#5687)
Extractions:
- Extract bitswap to go-bitswap (ipfs/go-ipfs#5294)
- Extract blockservice and verifcid (ipfs/go-ipfs#5296)
- Extract merkledag package, move dagutils to top level (ipfs/go-ipfs#5298)
- Extract path and resolver (ipfs/go-ipfs#5306)
- Extract config package (ipfs/go-ipfs#5277)
- Extract unixfs and importers to go-unixfs (ipfs/go-ipfs#5316)
- delete unixfs code... (ipfs/go-ipfs#5319)
- Extract /mfs to github.com/ipfs/go-mfs (ipfs/go-ipfs#5391)
- re-format log output as ndjson (ipfs/go-ipfs#5708)
- error on resolving non-terminal paths (ipfs/go-ipfs#5705)
Documentation:
- document the fact that we now publish releases on GitHub (ipfs/go-ipfs#5301)
- docs: add url to dev weekly sync to the README (ipfs/go-ipfs#5371)
- docs: README refresh, add cli-http-api-core diagram (ipfs/go-ipfs#5396)
- add some basic gateway documentation (ipfs/go-ipfs#5393)
- fix the default gateway port (ipfs/go-ipfs#5419)
- fix order of events in the release process (ipfs/go-ipfs#5434)
- docs: add some minimal read-only API documentation (ipfs/go-ipfs#5437)
- feat: use package-table (ipfs/go-ipfs#5395)
- link to go-{libp2p,ipld} package tables (ipfs/go-ipfs#5446)
- api: fix outdated HTTPHeaders config documentation (ipfs/go-ipfs#5451)
- add version, usage, and planning info for urlstore (ipfs/go-ipfs#5552)
- debug-guide.md added memory statistics command (ipfs/go-ipfs#5546)
- Change to point to combined go contributing guidelines (ipfs/go-ipfs#5607)
- docs: Update link format (ipfs/go-ipfs#5617)
- Fix link in readme (ipfs/go-ipfs#5632)
- docs: add a note for dns command (ipfs/go-ipfs#5629)
- Dockerfile: Specifies comments on exposed ports (ipfs/go-ipfs#5615)
- document pubsub message signing (ipfs/go-ipfs#5669)
Testing:
- Include cid-fmt binary in test/bin. (ipfs/go-ipfs#5297)
- wait for the nodes to fully stop (ipfs/go-ipfs#5315)
- apply timeout for build steps after getting node (ipfs/go-ipfs#5313)
- ci: check for gx deps dupes (ipfs/go-ipfs#5338)
- ci: call cleanWs after each step (ipfs/go-ipfs#5374)
- add correct test for GC completeness (ipfs/go-ipfs#5364)
- fix the urlstore tests (ipfs/go-ipfs#5397)
- improve gateway options test (ipfs/go-ipfs#5433)
- coreapi name: Increase test swarm size (ipfs/go-ipfs#5481)
- fix fuse unmount test (ipfs/go-ipfs#5476)
- test(add): add test for issue #5456 (ipfs/go-ipfs#5493)
- fixed tests of raised fd limits (ipfs/go-ipfs#5496)
- pprof: create HTTP endpoint for setting MutexProfileFraction (ipfs/go-ipfs#5527)
- fix(command):update
add --chunker
test (ipfs/go-ipfs#5571) - switch to go 1.11 (ipfs/go-ipfs#5483)
- fix: sharness race in directory_size if file is removed (ipfs/go-ipfs#5586)
- Bump Go versions and use '.x' to always get latest minor versions (ipfs/go-ipfs#5682)
- add rabin min error test (ipfs/go-ipfs#5449)
- Use CircleCI 2.0 (ipfs/go-ipfs#5691)
Internal:
- Add ability to retrieve blocks even if given using a different CID version (ipfs/go-ipfs#5285)
- update gogo-protobuf (ipfs/go-ipfs#5355)
- update protobuf files in go-ipfs (ipfs/go-ipfs#5356)
- string-backed CIDs (ipfs/go-ipfs#5441)
- commands: switch object to CoreAPI (ipfs/go-ipfs#4643)
- coreapi: dag: Batching interface (ipfs/go-ipfs#5340)
- key cmd: Refactor to use coreapi (ipfs/go-ipfs#5339)
- coreapi: DHT API (ipfs/go-ipfs#4804)
- block cmd: Use coreapi (ipfs/go-ipfs#5331)
- mk: embed CurrentCommit in the right place (ipfs/go-ipfs#5507)
- added binary executable files to .dockerignore (ipfs/go-ipfs#5544)
- Add sessions when fetching MerkleDAG in LS (ipfs/go-ipfs#5509)
- coreapi: Swarm API (ipfs/go-ipfs#4803)
- coreapi swarm: unify impl type with other apis (ipfs/go-ipfs#5551)
- Refactor UnixFS CoreAPI (ipfs/go-ipfs#5501)
- coreapi: PubSub API (ipfs/go-ipfs#4805)
- fix: maketarball.sh for OSX (ipfs/go-ipfs#5575)
- test the correct return value when checking directory size (ipfs/go-ipfs#5580)
- coreapi unixfs: remove Cat (ipfs/go-ipfs#5574)
- Explicitally use BufferedDAG after removing Batch from importers (ipfs/go-ipfs#5626)
Cleanup:
- Fix some weird code in core/coreunix/add.go (ipfs/go-ipfs#5354)
- name cmd: move subcommands to subdirectory (ipfs/go-ipfs#5392)
- directly parse peer IDs as peer IDs (ipfs/go-ipfs#5409)
- don't bother caching if we're using a nil repo (ipfs/go-ipfs#5414)
- object:refactor data encode error (ipfs/go-ipfs#5426)
- remove Godeps (ipfs/go-ipfs#5440)
- update for the go-ipfs-cmds refactor (ipfs/go-ipfs#5035)
- fix(unixfs): issue #5217 (Avoid use of
pb.Data
) (ipfs/go-ipfs#5505) - fix(unixfs): issue #5055 (ipfs/go-ipfs#5525)
- add offline id test #4978 and refactor command code (ipfs/go-ipfs#5562)
- refact(command): replace option name with const string (ipfs/go-ipfs#5642)
- remove p2p-circuit addr hack in ipfs swarm peers (ipfs/go-ipfs#5645)
- refactor(commands/id): use new command (ipfs/go-ipfs#5646)
- object patch rm-link: change arg from 'link' to 'name' (ipfs/go-ipfs#5638)
- refactor(cmds): use new cmds lib in version, tar and dns (ipfs/go-ipfs#5650)
- cmds/dag: use new cmds lib (ipfs/go-ipfs#5662)
- commands/ping: use new cmds lib (ipfs/go-ipfs#5675)
Changes to sub-packages go-ipfs depends on. This does not include libp2p or multiformats.
github.com/ipfs/go-log
- update gogo protobuf (ipfs/go-log#39)
- rename the protobuf to loggabletracer (ipfs/go-log#41)
- protect loggers with rwmutex (ipfs/go-log#44)
- make logging prettier (ipfs/go-log#45)
- add env vars for logging to file and syslog (ipfs/go-log#46)
- remove syslogger (ipfs/go-log#47)
github.com/ipfs/go-datastore
- implement DiskUsage for the rest of the datastores (ipfs/go-datastore#86)
- switch to google's uuid library (ipfs/go-datastore#89)
- return ErrNotFound from the NullDatastore instead of nil, nil (ipfs/go-datastore#92)
- Add TTL and Transactional interfaces (ipfs/go-datastore#91)
- improve testing (ipfs/go-datastore#93)
- Add support for querying entry expiration (ipfs/go-datastore#96)
- Allow ds.NewTransaction() to return an error (ipfs/go-datastore#98)
- add a GetSize method (ipfs/go-datastore#99)
github.com/ipfs/go-cid
- Add tests for Set type (ipfs/go-cid#63)
- Create new Builder interface for creating CIDs. (ipfs/go-cid#53)
- cid-fmt Enhancments (ipfs/go-cid#61)
- add String benchmark (ipfs/go-cid#44)
- add a streaming CID set (ipfs/go-cid#67)
- Extract non-core functionality from go-cid into go-cidutil (ipfs/go-cid#69)
- cid implementation research (ipfs/go-cid#70)
- cid implementation variations++ (ipfs/go-cid#72)
- Create a new Encode method that is like StringOfBase but never errors (ipfs/go-cid#60)
- add codecs for Dash blocks, tx (ipfs/go-cid#78)
github.com/ipfs/go-ds-flatfs
- check error before defer-removing disk usage file (ipfs/go-ds-flatfs#47)
- add GetSize function (ipfs/go-ds-flatfs#48)
github.com/ipfs/go-ds-measure
github.com/ipfs/go-ds-leveldb
- recover datastore on corruption (ipfs/go-ds-leveldb#15)
- Add transactional support to leveldb datastore. (ipfs/go-ds-leveldb#17)
- implement GetSize (ipfs/go-ds-leveldb#18)
github.com/ipfs/go-metrics-prometheus
- use an existing metric when it has already been registered (ipfs/go-metrics-prometheus#1)
github.com/ipfs/go-metrics-interface
- update the counter interface to match prometheus (ipfs/go-metrics-interface#2)
github.com/ipfs/go-ipld-format
- add copy dagservice function (ipfs/go-ipld-format#41)
github.com/ipfs/go-ipld-cbor
- Refactor to refmt (ipfs/go-ipld-cbor#30)
- import changes from the filecoin branch (ipfs/go-ipld-cbor#41)
- register the BitIntAtlasEntry for the tests (ipfs/go-ipld-cbor#43)
- attempt to allocate a bit less (ipfs/go-ipld-cbor#45)
github.com/ipfs/go-ipfs-cmds
- check if we can decode an error before trying (ipfs/go-ipfs-cmds#108)
- fix(option): print error message for error timeout option (ipfs/go-ipfs-cmds#118)
- Create Jenkinsfile (ipfs/go-ipfs-cmds#89)
- fix(add): refer to ipfs issue #5456 (ipfs/go-ipfs-cmds#121)
- commands refactor 2.0 (ipfs/go-ipfs-cmds#112)
- always assign keks to review new PRs (ipfs/go-ipfs-cmds#123)
- extract go-ipfs-files (ipfs/go-ipfs-cmds#125)
- split the value encoder and the error encoder (ipfs/go-ipfs-cmds#128)
github.com/ipfs/go-ipfs-cmdkit
- all: gofmt (ipfs/go-ipfs-cmdkit#22)
- add standard ci scripts (ipfs/go-ipfs-cmdkit#23)
- only count size for regular files (ipfs/go-ipfs-cmdkit#25)
- Create Jenkinsfile (ipfs/go-ipfs-cmdkit#16)
- Feat: add WebFile File implementation. (ipfs/go-ipfs-cmdkit#26)
- feat(type): fix issue #28 (ipfs/go-ipfs-cmdkit#29)
- Extract files package (ipfs/go-ipfs-cmdkit#31)
github.com/ipfs/go-ds-badger
- update protobuf (ipfs/go-ds-badger#26)
- exported type datastore => Datastore (ipfs/go-ds-badger#1)
- using exported Datastore type (ipfs/go-ds-badger#2)
- exported type datastore => Datastore (ipfs/go-ds-badger#28)
- Implement new TxDatastore and Txn interfaces (ipfs/go-ds-badger#27)
- Avoid discarding transaction too early in queries (ipfs/go-ds-badger#31)
- Ability to get entry expirations (ipfs/go-ds-badger#32)
- Update badger to 2.8.0 (ipfs/go-ds-badger#33)
- ds.NewTransaction() now returns an error parameter (ipfs/go-ds-badger#36)
- make has faster (ipfs/go-ds-badger#37)
- Implement GetSize and update badger (ipfs/go-ds-badger#38)
github.com/ipfs/go-ipfs-addr
- Remove dependency on libp2p-circuit (ipfs/go-ipfs-addr#7)
github.com/ipfs/go-ipfs-chunker
- return err when rabin min less than 16 (ipfs/go-ipfs-chunker#3)
- switch to go-buffer-pool (ipfs/go-ipfs-chunker#8)
- fix size-0 chunker bug (ipfs/go-ipfs-chunker#9)
github.com/ipfs/go-ipfs-routing
- update protobuf (ipfs/go-ipfs-routing#8)
- Implement SearchValue (ipfs/go-ipfs-routing#12)
github.com/ipfs/go-ipfs-blockstore
- blockstore: Adding Stat method to map from Cid to BlockSize (ipfs/go-ipfs-blockstore#5)
- correctly convert the datastore not found errors (ipfs/go-ipfs-blockstore#10)
- Fix typo: Change 'should not' to 'should' (ipfs/go-ipfs-blockstore#14)
- fix test race condition (ipfs/go-ipfs-blockstore#9)
- make arccache.GetSize return ErrNotFound when not found (ipfs/go-ipfs-blockstore#16)
- use datastore.GetSize (ipfs/go-ipfs-blockstore#17)
github.com/ipfs/go-ipns
- update gogo protobuf (ipfs/go-ipns#16)
- use new ExtractPublicKey signature (ipfs/go-ipns#17)
github.com/ipfs/go-bitswap
- update gogo protobuf (ipfs/go-bitswap#2)
- ci: add jenkins (ipfs/go-bitswap#9)
- bitswap: Bitswap now sends multiple blocks per message (ipfs/go-bitswap#5)
- reduce allocations (ipfs/go-bitswap#12)
- buffer writes (ipfs/go-bitswap#15)
- delay finding providers (ipfs/go-bitswap#17) github.com/ipfs/go-blockservice
- Avoid allocating a session unless we need it (ipfs/go-blockservice#6)
github.com/ipfs/go-cidutil
- add a utility method for sorting CID slices (ipfs/go-cidutil#5)
github.com/ipfs/go-ipfs-config
- Add pubsub configuration options (ipfs/go-ipfs-config#3)
- add QUIC experiment (ipfs/go-ipfs-config#4)
- Add Gateway.APICommands for /api allowlists (ipfs/go-ipfs-config#10)
- allow multiple API/Gateway addresses (ipfs/go-ipfs-config#11)
- Fix handling of null strings (ipfs/go-ipfs-config#12)
- add experiment for p2p http proxy (ipfs/go-ipfs-config#13)
- add message signing config options (ipfs/go-ipfs-config#18)
github.com/ipfs/go-merkledag
- Add FetchGraphWithDepthLimit to specify depth-limited graph fetching. (ipfs/go-merkledag#2)
- update gogo protobuf (ipfs/go-merkledag#4)
- Update to use new Builder interface for creating CIDs. (ipfs/go-merkledag#6)
- perf: avoid allocations when filtering nodes (ipfs/go-merkledag#11)
github.com/ipfs/go-mfs
- fix(unixfs): issue #6 (ipfs/go-mfs#7)
- fix(type): issue #13 (ipfs/go-mfs#14)
github.com/ipfs/go-path
- fix: don't dag.Get in ResolveToLastNode when not needed (ipfs/go-path#1)
github.com/ipfs/go-unixfs
- update gogo protobuf (ipfs/go-unixfs#6)
- Update to use new Builder interface for creating CIDs. (ipfs/go-unixfs#7)
- nit: make dagTruncate a method on DagModifier (ipfs/go-unixfs#13)
- fix(fsnode): issue #17 (ipfs/go-unixfs#18)
- Use EnumerateChildrenAsync in for enumerating HAMT links (ipfs/go-unixfs#19)
Ipfs 0.4.17 is a quick release to fix a major performance regression in bitswap (mostly affecting go-ipfs -> js-ipfs transfers). However, while motivated by this fix, this release contains a few other goodies that will excite some users.
The headline feature in this release is urlstore support. Urlstore is a generalization of the filestore backend that can fetch file blocks from remote URLs on-demand instead of storing them in the local datastore.
Additionally, we've added support for extracting inline blocks from CIDs (blocks inlined into CIDs using the identity hash function). However, go-ipfs won't yet create such CIDs so you're unlikely to see any in the wild.
Features:
- URLStore (ipfs/go-ipfs#4896)
- Add trickle-dag support to the urlstore (ipfs/go-ipfs#5245).
- Allow specifying how the data field in the
object get
is encoded (ipfs/go-ipfs#5139) - Add a
-U
flag tofiles ls
to disable sorting (ipfs/go-ipfs#5219) - Add an efficient
--size-only
flag to therepo stat
(ipfs/go-ipfs#5010) - Inline blocks in CIDs (ipfs/go-ipfs#5117)
Changes/Fixes:
- Make
ipfs files ls -l
correctly report the hash and size of files (ipfs/go-ipfs#5045) - Fix sorting of
files ls
(ipfs/go-ipfs#5219) - Improve prefetching in
ipfs cat
and related commands (ipfs/go-ipfs#5162) - Better error message when
ipfs cp
fails (ipfs/go-ipfs#5218) - Don't wait for the peer to close it's end of a bitswap stream before considering the block "sent" (ipfs/go-ipfs#5258)
- Fix resolving links in sharded directories via the gateway (ipfs/go-ipfs#5271)
- Fix building when there's a space in the current directory (ipfs/go-ipfs#5261)
Documentation:
- Improve documentation about the bloomfilter config options (ipfs/go-ipfs#4924)
General refactorings and internal bug fixes:
- Remove the
Offset()
method from the DAGReader (ipfs/go-ipfs#5190) - Fix TestLargeWriteChunks seek behavior (ipfs/go-ipfs#5276)
- Add a build tag to disable dynamic plugins (ipfs/go-ipfs#5274)
- Use FSNode instead of the Protobuf structure in PBDagReader (ipfs/go-ipfs#5189)
- Remove support for non-directory MFS roots (ipfs/go-ipfs#5170)
- Remove
UnixfsNode
from the balanced builder (ipfs/go-ipfs#5118) - Fix truncating files (internal) when already at the correct size (ipfs/go-ipfs#5253)
- Fix
dagTruncate
(internal) to preserve the node type (ipfs/go-ipfs#5216) - Add an internal interface for unixfs directories (ipfs/go-ipfs#5160)
- Refactor the CoreAPI path types and interfaces (ipfs/go-ipfs#4672)
- Refactor
precalcNextBuf
in the dag reader (ipfs/go-ipfs#5237) - Update a bunch of dependencies that haven't been updated for a while (ipfs/go-ipfs#5268)
Ipfs 0.4.16 is a fairly small release in terms of changes to the ipfs codebase, but it contains a huge amount of changes and improvements from the libraries we depend on, notably libp2p.
This release includes small a repo migration to account for some changes to the DHT. It should only take a second to run but, depending on your configuration, you may need to run it manually.
You can run a migration by either:
- Selecting "Yes" when the daemon prompts you to migrate.
- Running the daemon with the
--migrate=true
flag. - Manually running the migration.
This version of ipfs contains the changes made in libp2p from v5.0.14 through v6.0.5. In that time, we have made significant changes to the codebase to allow for easier integration of future transports and modules along with the usual performance and reliability improvements. You can find many of these improvements in the libp2p 6.0 release blog post.
The primary motivation for this refactor was adding support for network transports like QUIC that have built-in support for encryption, authentication, and stream multiplexing. It will also allow us to plug-in new security transports (like TLS) without hard-coding them.
For example, our QUIC transport currently works, and can be plugged into libp2p manually (though note that it is still experimental, as the upstream spec is still in flux). Further work is needed to make enabling this inside ipfs easy and not require recompilation.
On the user-visible side of things, we've improved our dialing logic and timeouts. We now abort dials to local subnets after 5 seconds and abort all dials if the TCP handshake takes longer than 5 seconds. This should significantly improve performance in some cases as we limit the number of concurrent dials and slow dials to non-responsive peers have been known to clog the dialer, blocking dials to reachable peers. Importantly, this should improve DHT performance as it tends to spend a disproportional amount of time connecting to peers.
We have also made a few noticeable changes to the DHT: we've significantly improved the chances of finding a value on the DHT, tightened up some of our validation logic, and fixed some issues that should reduce traffic to nodes running in dhtclient mode over time.
Of these, the first one will likely see the most impact. In the past, when putting a value (e.g., an IPNS entry) into the DHT, we'd try to put the value to K peers (where K for us is 20). However, we'd often fail to connect to many of these peers so we'd end up putting the value to significantly fewer than K peers. We now try to put the value to the K peers we can actually connect to.
Finally, we've fixed JavaScript interoperability in go-multiplex, the one stream muxer that both go-libp2p and js-libp2p implement. This should significantly improve go-libp2p and js-libp2p interoperability.
We are also changing the way that people write 'ipfs' multiaddrs. Currently,
ipfs multiaddrs look something like
/ip4/104.131.131.82/tcp/4001/ipfs/QmaCpDMGvV2BGHeYERUEnRQAwe3N8SzbUtfsmvsqQLuvuJ
.
However, calling them 'ipfs' multiaddrs is a bit misleading, as this is actually
the multiaddr of a libp2p peer that happens to run ipfs. Other protocols built
on libp2p right now still have to use multiaddrs that say 'ipfs', even if they
have nothing to do with ipfs. Therefore, we are renaming them to 'p2p'
multiaddrs. Moving forward, these addresses will be written as:
/ip4/104.131.131.82/tcp/4001/p2p/QmaCpDMGvV2BGHeYERUEnRQAwe3N8SzbUtfsmvsqQLuvuJ
.
This release adds support for parsing both types of addresses (.../ipfs/...
and .../p2p/...
) into the same network format, and the network format is
remaining exactly the same. A future release will have the ipfs daemon switch to
printing out addresses this way once a large enough portion of the network
has upgraded.
N.B., these addresses are not related to IPFS file names (/ipfs/Qm...
).
Disambiguating the two was yet another motivation to switch the protocol name to
/p2p/
.
On the ipfs side of things, we've started embedding public keys inside IPNS records and have enabled the Git plugin by default.
Embedding public keys inside IPNS records allows lookups to be faster as we only need to fetch the record itself (and not the public key separately). It also fixes an issue where DHT peers wouldn't store a record for a peer if they didn't have their public key already. Combined with some of the DHT and dialing fixes, this should improve the performance of IPNS (once a majority of the network updates).
Second, our public builds now include the Git plugin (in past builds, you could add it yourself, but doing so was not easy). With this, ipfs can ingest and operate over Git repositories and commit graphs directly. For more information on this, see the go-ipld-git repo.
Finally, we've included many smaller bugfixes, refactorings, improved documentation, and a good bit more. For the full details, see the changelog below.
- Bugfixes
- Fix dht commands when ipns over pubsub is enabled (ipfs/go-ipfs#5200)
- Fix content routing when ipns over pubsub is enabled (ipfs/go-ipfs#5200)
- Correctly handle multi-hop dnslink resolution (ipfs/go-ipfs#5202)
- Bugfixes
- Fix usage of file name vs path name in adder (ipfs/go-ipfs#5167)
- Fix
ipfs update
working with migrations (ipfs/go-ipfs#5194)
- Documentation
- Grammar fix in fuse docs (ipfs/go-ipfs#5164)
- Features
- Embed public keys inside ipns records, use for validation (ipfs/go-ipfs#5079)
- Preload git plugin by default (ipfs/go-ipfs#4991)
- Improvements
- Only resolve dnslinks once in the gateway (ipfs/go-ipfs#4977)
- Libp2p transport refactor update (ipfs/go-ipfs#4817)
- Improve swarm connect/disconnect commands (ipfs/go-ipfs#5107)
- Documentation
- Fix typo of sudo install command (ipfs/go-ipfs#5001)
- Fix experimental features Table of Contents (ipfs/go-ipfs#4976)
- Fix link to systemd init scripts in the README (ipfs/go-ipfs#4968)
- Add package overview comments to coreapi (ipfs/go-ipfs#5108)
- Add README to docs folder (ipfs/go-ipfs#5095)
- Add system requirements to README (ipfs/go-ipfs#5137)
- Bugfixes
- Fix goroutine leak in pin verify (ipfs/go-ipfs#5011)
- Fix commit string in version (ipfs/go-ipfs#4982)
- Fix
key rename
command output error (ipfs/go-ipfs#4962) - Report error source when failing to construct private network (ipfs/go-ipfs#4952)
- Fix build on DragonFlyBSD (ipfs/go-ipfs#5031)
- Fix goroutine leak in dag put (ipfs/go-ipfs#5016)
- Fix goroutine leaks in refs.go (ipfs/go-ipfs#5018)
- Fix panic, Don't handle errors with fallthrough (ipfs/go-ipfs#5072)
- Fix how filestore is hooked up with caching (ipfs/go-ipfs#5122)
- Add record validation to offline routing (ipfs/go-ipfs#5116)
- Fix
ipfs update
working with migrations (ipfs/go-ipfs#5194)
- General Changes and Refactorings
- Remove leftover bits of dead code (ipfs/go-ipfs#5022)
- Remove fuse platform build constraints (ipfs/go-ipfs#5033)
- Warning when legacy NoSync setting is set (ipfs/go-ipfs#5036)
- Clean up and refactor namesys module (ipfs/go-ipfs#5007)
- When raw-leaves are used for empty files use 'Raw' nodes (ipfs/go-ipfs#4693)
- Update dist_root in build scripts (ipfs/go-ipfs#5093)
- Integrate
pb.Data
intoFSNode
to avoid duplicating fields (ipfs/go-ipfs#5098) - Reduce log level when we can't republish (ipfs/go-ipfs#5091)
- Extract ipns record logic to go-ipns (ipfs/go-ipfs#5124)
- Testing
- Collect test times for sharness (ipfs/go-ipfs#4959)
- Fix sharness iptb connect timeout (ipfs/go-ipfs#4966)
- Add more timeouts to the jenkins pipeline (ipfs/go-ipfs#4958)
- Use go 1.10 on jenkins (ipfs/go-ipfs#5009)
- Speed up multinode sharness test (ipfs/go-ipfs#4967)
- Print out iptb logs on iptb test failure (for debugging CI) (ipfs/go-ipfs#5069)
- Disable the MacOS tests in jenkins (ipfs/go-ipfs#5119)
- Make republisher test robust against timing issues (ipfs/go-ipfs#5125)
- Archive sharness trash dirs in jenkins (ipfs/go-ipfs#5071)
- Fixup DHT sharness tests (ipfs/go-ipfs#5114)
- Dependencies
- Update go-ipld-git to fix mergetag resolving (ipfs/go-ipfs#4988)
- Fix duplicate /x/sys imports (ipfs/go-ipfs#5068)
- Update stream multiplexers (ipfs/go-ipfs#5075)
- Update dependencies: go-log, sys, go-crypto (ipfs/go-ipfs#5100)
- Explicitly import go-multiaddr-dns in config/bootstrap_peers (ipfs/go-ipfs#5144)
- Gx update with dht and dialing improvements (ipfs/go-ipfs#5158)
This release is significantly smaller than the last as much of the work on improving our datastores, and other libraries libp2p has yet to be merged. However, it still includes many welcome improvements.
As with 0.4.12 and 0.4.14 (0.4.13 was a patch), this release has a negative diff-stat. Unfortunately, much of this code isn't actually going away but at least it's being moved out into separate repositories.
Much of the work that made it into this release is under the hood. We've cleaned up some code, extracted several packages into their own repositories, and made some long neglected optimizations (e.g., handling of sharded directories). Additionally, this release includes a bunch of tests for our CLI commands that should help us avoid some of the issues we've seen in the past few releases.
More visibly, thanks to @djdv's efforts, this release includes some significant
Windows improvements (with more on the way). Specifically, this release includes
better handling of repo lockfiles (no more ipfs repo fsck
), stdin command-line
support, and, last but not least, IPFS no longer writes random files with scary
garbage in the drive root. To read more about future windows improvements, take
a look at this blog post.
To better support low-power devices, we've added a low-power config profile.
This can be enabled when initializing a repo by running ipfs init
with the
--profile=lowpower
flag or later by running ipfs config profile apply lowpower
.
Finally, with this release we have begun distributing self-contained source archives of go-ipfs and its dependencies. This should be a welcome improvement for both packagers and those living in countries with harmonized internet access.
-
Features
- Add options for record count and timeout for resolving DHT paths (ipfs/go-ipfs#4733)
- Add low power init profile (ipfs/go-ipfs#4154)
- Add Opentracing plugin support (ipfs/go-ipfs#4506)
- Add make target to build source tarballs (ipfs/go-ipfs#4920)
-
Improvements
- Add BlockedFetched/Added/Removed events to Blockservice (ipfs/go-ipfs#4649)
- Improve performance of HAMT code (ipfs/go-ipfs#4889)
- Avoid unnecessarily resolving child nodes when listing a sharded directory (ipfs/go-ipfs#4884)
- Tar writer now supports sharded ipfs directories (ipfs/go-ipfs#4873)
- Infer type from CID when possible in
ipfs ls
(ipfs/go-ipfs#4890) - Deduplicate keys in GetMany (ipfs/go-ipfs#4888)
-
Documentation
- Fix spelling of retrieval (ipfs/go-ipfs#4819)
- Update broken links (ipfs/go-ipfs#4798)
- Remove roadmap.md (ipfs/go-ipfs#4834)
- Remove link to IPFS paper in contribute.md (ipfs/go-ipfs#4812)
- Fix broken todo link in readme.md (ipfs/go-ipfs#4865)
- Document ipns pubsub (ipfs/go-ipfs#4903)
- Fix missing profile docs (ipfs/go-ipfs#4846)
- Fix a few typos (ipfs/go-ipfs#4835)
- Fix typo in fsrepo error message (ipfs/go-ipfs#4933)
- Remove go-ipfs version from issue template (ipfs/go-ipfs#4943)
- Add docs for --profile=lowpower (ipfs/go-ipfs#4970)
- Improve Windows build documentation (ipfs/go-ipfs#4691)
-
Bugfixes
- Check CIDs in base case when diffing nodes (ipfs/go-ipfs#4767)
- Support for CIDv1 with custom mhtype in
ipfs block put
(ipfs/go-ipfs#4563) - Clean path in DagArchive (ipfs/go-ipfs#4743)
- Set the prefix for MFS root in
ipfs add --hash-only
(ipfs/go-ipfs#4755) - Fix get output path (ipfs/go-ipfs#4809)
- Fix incorrect Read calls (ipfs/go-ipfs#4792)
- Use prefix in bootstrapWritePeers (ipfs/go-ipfs#4832)
- Fix mfs Directory.Path not working (ipfs/go-ipfs#4844)
- Remove header in
ipfs stats bw
if not polling (ipfs/go-ipfs#4856) - Match Go's GOPATH defaults behaviour in build scripts (ipfs/go-ipfs#4678)
- Fix default-net profile not reverting bootstrap config (ipfs/go-ipfs#4845)
- Fix excess goroutines in bitswap caused by insecure CIDs (ipfs/go-ipfs#4946)
-
General Changes and Refactorings
- Refactor trickle DAG builder (ipfs/go-ipfs#4730)
- Split the coreapi interface into multiple files (ipfs/go-ipfs#4802)
- Make
ipfs init
command use new cmds lib (ipfs/go-ipfs#4732) - Extract thirdparty/tar package (ipfs/go-ipfs#4857)
- Reduce log level when for disconnected peers to info (ipfs/go-ipfs#4811)
- Only visit nodes in EnumerateChildrenAsync when asked (ipfs/go-ipfs#4885)
- Refactor coreapi options (ipfs/go-ipfs#4807)
- Fix error style for most errors (ipfs/go-ipfs#4829)
- Ensure
--help
always works, even with /dev/null stdin (ipfs/go-ipfs#4849) - Deduplicate AddNodeLinkClean into AddNodeLink (ipfs/go-ipfs#4940)
- Remove some dead code (ipfs/go-ipfs#4833)
- Remove unused imports (ipfs/go-ipfs#4955)
- Fix go vet warnings (ipfs/go-ipfs#4859)
-
Testing
- Generate JUnit test reports for sharness tests (ipfs/go-ipfs#4530)
- Fix t0063-daemon-init.sh by adding test profile to daemon (ipfs/go-ipfs#4816)
- Remove circular dependencies in merkledag package tests (ipfs/go-ipfs#4704)
- Check that all the commands fail when passed a bad flag (ipfs/go-ipfs#4848)
- Allow for some small margin of code coverage dropping on commit (ipfs/go-ipfs#4867)
- Add confirmation to archive-branches script (ipfs/go-ipfs#4797)
-
Dependencies
- Update lock package (ipfs/go-ipfs#4855)
- Update to latest go-datastore. Remove thirdparty/datastore2 (ipfs/go-ipfs#4742)
- Extract fs lock into go-fs-lock (ipfs/go-ipfs#4631)
- Extract: exchange/interface.go, blocks/blocksutil, exchange/offline (ipfs/go-ipfs#4912)
- Remove unused lock dep (ipfs/go-ipfs#4971)
- Update iptb (ipfs/go-ipfs#4965)
- Update go-ipfs-cmds to fix stdin on windows (ipfs/go-ipfs#4975)
- Update go-ds-flatfs to fix windows corruption issue (ipfs/go-ipfs#4872)
Ipfs 0.4.14 is a big release with a large number of improvements and bugfixes. It is also the first release of 2018, and our first release in over three months. The release took longer than expected due to our refactoring and extracting of our commands library. This refactor had two stages. The first round of the refactor disentangled the commands code from core ipfs code, allowing us to move it out into a separate repository. The code was previously very entangled with the go-ipfs codebase and not usable for other projects. The second round of the refactor had the goal of fixing several major issues around streaming outputs, progress bars, and error handling. It also paved the way for us to more easily provide an API over other transports, such as websockets and unix domain sockets. It took a while to flush out all the kinks on such a massive change. We're pretty sure we've got most of them, but if you notice anything weird, please let us know.
Beyond that, we've added a new experimental way to use IPNS. With the new
pubsub IPNS resolver and publisher, you can subscribe to updates of an IPNS
entry, and the owner can publish out changes in real time. With this, IPNS can
become nearly instantaneous. To make use of this, simply start your ipfs daemon
with the --enable-namesys-pubsub
option, and all IPNS resolution and
publishing will use pubsub. Note that resolving an IPNS name via pubsub without
someone publishing it via pubsub will result in a fallback to using the DHT.
Please give this a try and let us know how it goes!
Memory and CPU usage should see a noticeable improvement in this release. We have spent considerable time fixing excess memory usage throughout the codebase and down into libp2p. Fixes in peer tracking, bitswap allocation, pinning, and many other places have brought down both peak and average memory usage. An upgraded hashing library, base58 encoding library, and improved allocation patterns all contribute to overall lower CPU usage across the board. See the full changelist below for more memory and CPU usage improvements.
This release also brings the beginning of the ipfs 'Core API'. Once finished, the Core API will be the primary way to interact with go-ipfs using go. Both embedded nodes and nodes accessed over the http API will have the same interface. Stay tuned for future updates and documentation.
These are only a sampling of the changes that made it into this release, the full list (almost 100 PRs!) is below.
Finally, I'd like to thank everyone who contributed to this release, whether you're just contributing a typo fix or driving new features. We are really grateful to everyone who has spent their their time pushing ipfs forward.
SECURITY NOTE:
This release of ipfs disallows the usage of insecure hash functions and lengths. Ipfs does not create these insecure objects for any purpose, but it did allow manually creating them and fetching them from other peers. If you currently have objects using insecure hashes in your local ipfs repo, please remove them before updating.
- Fix bug in stdin argument parsing (ipfs/go-ipfs#4827)
- Revert commands back to sending a single response (ipfs/go-ipfs#4822)
-
Fix issue in ipfs get caused by go1.10 changes (ipfs/go-ipfs#4790)
-
Features
- Pubsub IPNS Publisher and Resolver (experimental) (ipfs/go-ipfs#4047)
- Implement coreapi Dag interface (ipfs/go-ipfs#4471)
- Add --offset flag to ipfs cat (ipfs/go-ipfs#4538)
- Command to apply config profile after init (ipfs/go-ipfs#4195)
- Implement coreapi Name and Key interfaces (ipfs/go-ipfs#4477)
- Add --length flag to ipfs cat (ipfs/go-ipfs#4553)
- Implement coreapi Object interface (ipfs/go-ipfs#4492)
- Implement coreapi Block interface (ipfs/go-ipfs#4548)
- Implement coreapi Pin interface (ipfs/go-ipfs#4575)
- Add a --with-local flag to ipfs files stat (ipfs/go-ipfs#4638)
- Disallow usage of blocks with insecure hashes (ipfs/go-ipfs#4751)
-
Improvements
- Add uuid to event logs (ipfs/go-ipfs#4392)
- Add --quiet flag to object put (ipfs/go-ipfs#4411)
- Pinning memory improvements and fixes (ipfs/go-ipfs#4451)
- Update WebUI version (ipfs/go-ipfs#4449)
- Check strong and weak ETag validator (ipfs/go-ipfs#3983)
- Improve and refactor FD limit handling (ipfs/go-ipfs#3801)
- Support linking to non-dagpb objects in ipfs object patch (ipfs/go-ipfs#4460)
- Improve allocation patterns of slices in bitswap (ipfs/go-ipfs#4458)
- Secio handshake now happens synchronously (libp2p/go-libp2p-secio#25)
- Don't block closing connections on pending writes (libp2p/go-msgio#7)
- Improve memory usage of multiaddr parsing (multiformats/go-multiaddr#56)
- Don't lock up 256KiB buffers when adding small files (ipfs/go-ipfs#4508)
- Clear out memory after reads from the dagreader (ipfs/go-ipfs#4525)
- Improve error handling in ipfs ping (ipfs/go-ipfs#4546)
- Allow install.sh to be run without being the script dir (ipfs/go-ipfs#4547)
- Much faster base58 encoding (libp2p/go-libp2p-peer#24)
- Use faster sha256 and blake2b libs (multiformats/go-multihash#63)
- Greatly improve peerstore memory usage (libp2p/go-libp2p-peerstore#22)
- Improve dht memory usage and peer tracking (libp2p/go-libp2p-kad-dht#111)
- New libp2p metrics lib with lower overhead (libp2p/go-libp2p-metrics#8)
- Fix memory leak that occurred when dialing many peers (libp2p/go-libp2p-swarm#51)
- Wire up new dag interfaces to make sessions easier (ipfs/go-ipfs#4641)
-
Documentation
- Correct StorageMax config description (ipfs/go-ipfs#4388)
- Add how to download IPFS with IPFS doc (ipfs/go-ipfs#4390)
- Document gx release checklist item (ipfs/go-ipfs#4480)
- Add some documentation to CoreAPI (ipfs/go-ipfs#4493)
- Add interop tests to the release checklist (ipfs/go-ipfs#4501)
- Add badgerds to experimental-features ToC (ipfs/go-ipfs#4537)
- Fix typos and inconsistencies in commands documentation (ipfs/go-ipfs#4552)
- Add a document to help troubleshoot data transfers (ipfs/go-ipfs#4332)
- Add a bunch of documentation on public interfaces (ipfs/go-ipfs#4599)
- Expand the issue template and remove the severity field (ipfs/go-ipfs#4624)
- Add godocs for importers module (ipfs/go-ipfs#4640)
- Document make targets (ipfs/go-ipfs#4653)
- Add godocs for merkledag module (ipfs/go-ipfs#4665)
- Add godocs for unixfs module (ipfs/go-ipfs#4664)
- Add sharding to experimental features list (ipfs/go-ipfs#4569)
- Add godocs for routing module (ipfs/go-ipfs#4676)
- Add godocs for path module (ipfs/go-ipfs#4689)
- Add godocs for pin module (ipfs/go-ipfs#4696)
- Update link to filestore experimental status (ipfs/go-ipfs#4557)
-
Bugfixes
- Remove trailing slash in ipfs get paths, fixes #3729 (ipfs/go-ipfs#4365)
- fix deadlock in bitswap sessions (ipfs/go-ipfs#4407)
- Fix two race conditions (and possibly go routine leaks) in commands (ipfs/go-ipfs#4406)
- Fix output delay in ipfs pubsub sub (ipfs/go-ipfs#4402)
- Use correct context in AddWithContext (ipfs/go-ipfs#4433)
- Fix various IPNS republisher issues (ipfs/go-ipfs#4440)
- Fix error handling in commands add and get (ipfs/go-ipfs#4454)
- Fix hamt (sharding) delete issue (ipfs/go-ipfs#4398)
- More correctly check for reuseport support (libp2p/go-reuseport#40)
- Fix goroutine leak in websockets transport (libp2p/go-ws-transport#21)
- Update badgerds to fix i386 windows build (ipfs/go-ipfs#4464)
- Only construct bitswap event loggable if necessary (ipfs/go-ipfs#4533)
- Ensure that flush on the mfs root flushes its directory (ipfs/go-ipfs#4509)
- Fix deferred unlock of pin lock in AddR (ipfs/go-ipfs#4562)
- Fix iOS builds (ipfs/go-ipfs#4610)
- Calling repo gc now frees up space with badgerds (ipfs/go-ipfs#4578)
- Fix leak in bitswap sessions shutdown (ipfs/go-ipfs#4658)
- Fix make on windows (ipfs/go-ipfs#4682)
- Ignore invalid key files in keystore directory (ipfs/go-ipfs#4700)
-
General Changes and Refactorings
- Extract and refactor commands library (ipfs/go-ipfs#3856)
- Remove all instances of
Default(false)
(ipfs/go-ipfs#4042) - Build for all supported platforms when testing (ipfs/go-ipfs#4445)
- Refine gateway and namesys logging (ipfs/go-ipfs#4428)
- Demote bitswap error to an info (ipfs/go-ipfs#4472)
- Extract posinfo package to github.com/ipfs/go-ipfs-posinfo (ipfs/go-ipfs#4669)
- Move signature verification to ipns validator (ipfs/go-ipfs#4628)
- Extract importers/chunk module as go-ipfs-chunker (ipfs/go-ipfs#4661)
- Extract go-detect-race from Godeps (ipfs/go-ipfs#4686)
- Extract flags, delay, ds-help (ipfs/go-ipfs#4685)
- Extract routing package to go-ipfs-routing (ipfs/go-ipfs#4703)
- Extract blocks/blockstore package to go-ipfs-blockstore (ipfs/go-ipfs#4707)
- Add exchange.SessionExchange interface for exchanges that support sessions (ipfs/go-ipfs#4709)
- Extract thirdparty/pq to go-ipfs-pq (ipfs/go-ipfs#4711)
- Separate "path" from "path/resolver" (ipfs/go-ipfs#4713)
-
Testing
- Increase verbosity of t0088-repo-stat-symlink.sh test (ipfs/go-ipfs#4434)
- Make repo size test pass deterministically (ipfs/go-ipfs#4443)
- Always set IPFS_PATH in test-lib.sh (ipfs/go-ipfs#4469)
- Fix sharness docker (ipfs/go-ipfs#4489)
- Fix loops in sharness tests to fail the test if the inner command fails (ipfs/go-ipfs#4482)
- Improve bitswap tests, fix race conditions (ipfs/go-ipfs#4499)
- Fix circleci cache directory list (ipfs/go-ipfs#4564)
- Only run the build test on test_go_expensive (ipfs/go-ipfs#4645)
- Fix go test on Windows (ipfs/go-ipfs#4632)
- Fix some tests on FreeBSD (ipfs/go-ipfs#4662)
Ipfs 0.4.13 is a patch release that fixes two high priority issues that were discovered in the 0.4.12 release.
Bugfixes:
- Fix periodic bitswap deadlock (ipfs/go-ipfs#4386)
- Fix badgerds crash on startup (ipfs/go-ipfs#4384)
Ipfs 0.4.12 brings with it many important fixes for the huge spike in network
size we've seen this past month. These changes include the Connection Manager,
faster batching in ipfs add
, libp2p fixes that reduce CPU usage, and a bunch
of new documentation.
The most critical change is the 'Connection Manager': it allows an ipfs node to maintain a limited set of connections to other peers in the network. By default (and with no config changes required by the user), ipfs nodes will now try to maintain between 600 and 900 open connections. These limits are still likely higher than needed, and future releases may lower the default recommendation, but for now we want to make changes gradually. The rationale for this selection of numbers is as follows:
- The DHT routing table for a large network may rise to around 400 peers
- Bitswap connections tend to be separate from the DHT
- PubSub connections also generally are another distinct set of peers (including js-ipfs nodes)
Because of this, we selected 600 as a 'LowWater' number, and 900 as a
'HighWater' number to avoid having to clear out connections too frequently.
You can configure different numbers as you see fit via the Swarm.ConnMgr
field in your ipfs config file. See
here for
more details.
Disk utilization during ipfs add
has been optimized for large files by doing
batch writes in parallel. Previously, when adding a large file, users might have
noticed that the add progressed by about 8MB at a time, with brief pauses in between.
This was caused by quickly filling up the batch, then blocking while it was
writing to disk. We now write to disk in the background while continuing to add
the remainder of the file.
Other changes in this release have noticeably reduced memory consumption and CPU usage. This was done by optimising some frequently called functions in libp2p that were expensive in terms of both CPU usage and memory allocations. We also lowered the yamux accept buffer sizes which were raised over a year ago to combat a separate bug that has since been fixed.
And finally, thank you to everyone who filed bugs, tested out the release candidates, filed pull requests, and contributed in any other way to this release!
- Features
- Implement Connection Manager (ipfs/go-ipfs#4288)
- Support multiple files in dag put (ipfs/go-ipfs#4254)
- Add 'raw' support to the dag put command (ipfs/go-ipfs#4285)
- Improvements
- Parallelize dag batch flushing (ipfs/go-ipfs#4296)
- Update go-peerstream to improve CPU usage (ipfs/go-ipfs#4323)
- Add full support for CidV1 in Files API and Dag Modifier (ipfs/go-ipfs#4026)
- Lower yamux accept buffer size (ipfs/go-ipfs#4326)
- Optimise
ipfs pin update
command (ipfs/go-ipfs#4348)
- Documentation
- Add some docs on plugins (ipfs/go-ipfs#4255)
- Add more info about private network bootstrap (ipfs/go-ipfs#4270)
- Add more info about
ipfs add
chunker option (ipfs/go-ipfs#4306) - Remove cruft in readme and mention discourse forum (ipfs/go-ipfs#4345)
- Add note about updating before reporting issues (ipfs/go-ipfs#4361)
- Bugfixes
- Fix FreeBSD build issues (ipfs/go-ipfs#4275)
- Don't crash when Datastore.StorageMax is not defined (ipfs/go-ipfs#4246)
- Do not call 'Connect' on NewStream in bitswap (ipfs/go-ipfs#4317)
- Filter out "" from active peers in bitswap sessions (ipfs/go-ipfs#4316)
- Fix "seeker can't seek" on specific files (ipfs/go-ipfs#4320)
- Do not set "gecos" field in Dockerfile (ipfs/go-ipfs#4331)
- Handle sym links in when calculating repo size (ipfs/go-ipfs#4305)
- General Changes and Refactorings
- Fix indent in sharness tests (ipfs/go-ipfs#4212)
- Remove supernode routing (ipfs/go-ipfs#4302)
- Extract go-ipfs-addr (ipfs/go-ipfs#4340)
- Remove dead code and config files (ipfs/go-ipfs#4357)
- Update badgerds to 1.0 (ipfs/go-ipfs#4327)
- Wrap help descriptions under 80 chars (ipfs/go-ipfs#4121)
- Testing
- Make sharness t0180-p2p less racy (ipfs/go-ipfs#4310)
Ipfs 0.4.11 is a larger release that brings many long-awaited features and performance improvements. These include new datastore options, more efficient bitswap transfers, greatly improved resource consumption, circuit relay support, ipld plugins, and more! Take a look at the full changelog below for a detailed list of every change.
The ipfs datastore has, until now, been a combination of leveldb and a custom git-like storage backend called 'flatfs'. This works well enough for the average user, but different ipfs usecases demand different backend configurations. To address this, we have changed the configuration file format for datastores to be a modular way of specifying exactly how you want the datastore to be structured. You will now be able to configure ipfs to use flatfs, leveldb, badger, an in-memory datastore, and more to suit your needs. See the new datastore documentation for more information.
Bitswap received some much needed attention during this release cycle. The
concept of 'Bitswap Sessions' allows bitswap to associate requests for
different blocks to the same underlying session, and from that infer better
ways of requesting that data. In more concrete terms, parts of the ipfs
codebase that take advantage of sessions (currently, only ipfs pin add
) will
cause much less extra traffic than before. This is done by making optimistic
guesses about which nodes might be providing given blocks and not sending
wantlist updates to every connected bitswap partner, as well as searching the
DHT for providers less frequently. In future releases we will migrate over more
ipfs commands to take advantage of bitswap sessions. As nodes update to this
and future versions, expect to see idle bandwidth usage on the ipfs network
go down noticeably.
The never ending effort to reduce resource consumption had a few important updates this release. First, the bitswap sessions changes discussed above will help with improving bandwidth usage. Aside from that there are two important libp2p updates that improved things significantly. The first was a fix to a bug in the dial limiter code that was causing it to not limit outgoing dials correctly. This resulted in ipfs running out of file descriptors very frequently (as well as incurring a decent amount of excess outgoing bandwidth), this has now been fixed. Users who previously received "too many open files" errors should see this much less often in 0.4.11. The second change was a memory leak in the DHT that was identified and fixed. Streams being tracked in a map in the DHT weren't being cleaned up after the peer disconnected leading to the multiplexer session not being cleaned up properly. This issue has been resolved, and now memory usage appears to be stable over time. There is still a lot of work to be done improving memory usage, but we feel this is a solid victory.
It is often said that NAT traversal is the hardest problem in peer to peer technology, we tend to agree with this. In an effort to provide a more ubiquitous p2p mesh, we have implemented a relay mechanism that allows willing peers to relay traffic for other peers who might not otherwise be able to communicate with each other. This feature is still pretty early, and currently users have to manually connect through a relay. The next step in this endeavour is automatic relaying, and research for this is currently in progress. We expect that when it lands, it will improve the perceived performance of ipfs by spending less time attempting connections to hard to reach nodes. A short guide on using the circuit relay feature can be found here.
The last feature we want to highlight (but by no means the last feature in this release) is our new plugin system. There are many different workflows and usecases that ipfs should be able to support, but not everyone wants to be able to use every feature. We could simply merge in all these features, but that causes problems for several reasons: first off, the size of the ipfs binary starts to get very large very quickly. Second, each of these different pieces needs to be maintained and updated independently, which would cause significant churn in the codebase. To address this, we have come up with a system that allows users to install plugins to the vanilla ipfs daemon that augment its capabilities. The first of these plugins are a git plugin that allows ipfs to natively address git objects and an ethereum plugin that lets ipfs ingest and operate on all ethereum blockchain data. Soon to come are plugins for the bitcoin and zcash data formats. In the future, we will be adding plugins for other things like datastore backends and specialized libp2p network transports. You can read more on this topic in Plugin docs
In order to simplify its integration with fs-repo-migrations, we've switched the ipfs/go-ipfs docker image from a musl base to a glibc base. For most users this will not be noticeable, but if you've been building your own images based off this image, you'll have to update your dockerfile. We recommend a multi-stage dockerfile, where the build stage is based off of a regular Debian or other glibc-based image, and the assembly stage is based off of the ipfs/go-ipfs image, and you copy build artifacts from the build stage to the assembly stage. Note, if you are using the docker image and see a deprecation message, please update your usage. We will stop supporting the old method of starting the dockerfile in the next release.
Finally, I would like to thank all of our contributors, users, supporters, and friends for helping us along the way. Ipfs would not be where it is without you.
- Features
- Add
--pin
option toipfs dag put
(ipfs/go-ipfs#4004) - Add
--pin
option toipfs object put
(ipfs/go-ipfs#4095) - Implement
--profile
option onipfs init
(ipfs/go-ipfs#4001) - Add CID Codecs to
ipfs block put
(ipfs/go-ipfs#4022) - Bitswap sessions (ipfs/go-ipfs#3867)
- Create plugin API and loader, add ipld-git plugin (ipfs/go-ipfs#4033)
- Make announced swarm addresses configurable (ipfs/go-ipfs#3948)
- Reprovider strategies (ipfs/go-ipfs#4113)
- Circuit Relay integration (ipfs/go-ipfs#4091)
- More configurable datastore configs (ipfs/go-ipfs#3575)
- Add experimental support for badger datastore (ipfs/go-ipfs#4007)
- Add
- Improvements
- Add better support for Raw Nodes in MFS and elsewhere (ipfs/go-ipfs#3996)
- Added file size to response of
ipfs add
command (ipfs/go-ipfs#4082) - Add /dnsaddr bootstrap nodes (ipfs/go-ipfs#4127)
- Do not publish public keys extractable from ID (ipfs/go-ipfs#4020)
- Documentation
- Adding documentation that PubSub Sub can be encoded. (ipfs/go-ipfs#3909)
- Add Comms items from js-ipfs, including blog (ipfs/go-ipfs#3936)
- Add Developer Certificate of Origin (ipfs/go-ipfs#4006)
- Add
transports.md
document (ipfs/go-ipfs#4034) - Add
experimental-features.md
document (ipfs/go-ipfs#4036) - Update release docs (ipfs/go-ipfs#4165)
- Add documentation for datastore configs (ipfs/go-ipfs#4223)
- General update and clean-up of docs (ipfs/go-ipfs#4222)
- Bugfixes
- Fix shutdown check in t0023 (ipfs/go-ipfs#3969)
- Fix pinning of unixfs sharded directories (ipfs/go-ipfs#3975)
- Show escaped url in gateway 404 message (ipfs/go-ipfs#4005)
- Fix early opening of bitswap message sender (ipfs/go-ipfs#4069)
- Fix determination of 'root' node in dag put (ipfs/go-ipfs#4072)
- Fix bad multipart message panic in gateway (ipfs/go-ipfs#4053)
- Add blocks to the blockstore before returning them from blockservice sessions (ipfs/go-ipfs#4169)
- Various fixes for /ipfs fuse code (ipfs/go-ipfs#4194)
- Fix memory leak in dht stream tracking (ipfs/go-ipfs#4251)
- General Changes and Refactorings
- Require go 1.8 (ipfs/go-ipfs#4044)
- Change IPFS to use the new pluggable Block to IPLD decoding framework. (ipfs/go-ipfs#4060)
- Remove tour command from ipfs (ipfs/go-ipfs#4123)
- Add support for Go 1.9 (ipfs/go-ipfs#4156)
- Remove some dead code (ipfs/go-ipfs#4204)
- Switch docker image from musl to glibc (ipfs/go-ipfs#4219)
Ipfs 0.4.10 is a patch release that contains several exciting new features, bugfixes and general improvements. Including new commands, easier corruption recovery, and a generally cleaner codebase.
The ipfs pin
command has two new subcommands, verify
and update
. ipfs pin verify
is used to scan the repo for pinned object graphs and check their
integrity. Any issues are reported back with helpful error text to make error
recovery simpler. This subcommand was added to help recover from datastore
corruptions, particularly if using the experimental filestore and accidentally
deleting tracked files.
ipfs pin update
was added to make the task of keeping a large, frequently
changing object graph pinned. Previously users had to call ipfs pin rm
on the
old pin, and ipfs pin add
on the new one. The 'new' ipfs pin add
call would
be very expensive as it would need to verify the entirety of the graph again.
The ipfs pin update
command takes shortcuts, portions of the graph that were
covered under the old pin are assumed to be fine, and the command skips
checking them.
Next up, we have finally implemented an ipfs shutdown
command so users can
shut down their ipfs daemons via the API. This is especially useful on
platforms that make it difficult to control processes (Android, for example),
and is also useful when needing to shut down a node remotely and you do not
have access to the machine itself.
ipfs add
has gained a new flag; the --hash
flag allows you to select which
hash function to use and we have given it the ability to select blake2b-256
.
This pushes us one step closer to shifting over to using blake2b as the
default. Blake2b is significantly faster than sha2-256, and also is conjectured
to provide superior security.
We have also finally implemented a very early (and experimental) ipfs p2p
.
This command and its subcommands will allow you to open up arbitrary streams to
other ipfs peers through libp2p. The interfaces are a little bit clunky right
now, but shouldn't get in the way of anyone wanting to try building a fully
peer to peer application on top of ipfs and libp2p. For more info on this
command, to ask questions, or to provide feedback, head over to the feedback
issue for the command.
A few other subcommands and flags were added around the API, as well as many other requested improvements. See below for the full list of changes.
- Features
- Add support for specifying the hash function in
ipfs add
(ipfs/go-ipfs#3919) - Implement
ipfs key {rm, rename}
(ipfs/go-ipfs#3892) - Implement
ipfs shutdown
command (ipfs/go-ipfs#3884) - Implement
ipfs pin update
(ipfs/go-ipfs#3846) - Implement
ipfs pin verify
(ipfs/go-ipfs#3843) - Implemented experimental p2p commands (ipfs/go-ipfs#3943)
- Add support for specifying the hash function in
- Improvements
- Add MaxStorage field to output of "repo stat" (ipfs/go-ipfs#3915)
- Add Suborigin header to gateway responses (ipfs/go-ipfs#3914)
- Add "--file-order" option to "filestore ls" and "verify" (ipfs/go-ipfs#3938)
- Allow selecting ipns keys by Peer ID (ipfs/go-ipfs#3882)
- Don't redirect to trailing slash in gateway for
go get
(ipfs/go-ipfs#3963) - Add 'ipfs dht findprovs --num-providers' to allow choosing number of providers to find (ipfs/go-ipfs#3966)
- Make sure all keystore keys get republished (ipfs/go-ipfs#3951)
- Documentation
- Adding documentation on PubSub encodings (ipfs/go-ipfs#3909)
- Change 'neccessary' to 'necessary' (ipfs/go-ipfs#3941)
- README.md: add Nix to the linux package managers (ipfs/go-ipfs#3939)
- More verbose errors in filestore (ipfs/go-ipfs#3964)
- Bugfixes
- Fix typo in message when file size check fails (ipfs/go-ipfs#3895)
- Clean up bitswap ledgers when disconnecting (ipfs/go-ipfs#3437)
- Make odds of 'process added after close' panic less likely (ipfs/go-ipfs#3940)
- General Changes and Refactorings
- Remove 'ipfs diag net' from codebase (ipfs/go-ipfs#3916)
- Update to dht code with provide announce option (ipfs/go-ipfs#3928)
- Apply the megacheck code vetting tool (ipfs/go-ipfs#3949)
- Expose port 8081 in docker container for /ws listener (ipfs/go-ipfs#3954)
Ipfs 0.4.9 is a maintenance release that contains several useful bugfixes and
improvements. Notably, ipfs add
has gained the ability to select which CID
version will be output. The common ipfs hash that looks like this:
QmRjNgF2mRLDT8AzCPsQbw1EYF2hDTFgfUmJokJPhCApYP
is a multihash. Multihashes
allow us to specify the hashing algorithm that was used to verify the data, but
it doesn't give us any indication of what format that data might be. To address
that issue, we are adding another couple of bytes to the prefix that will allow us
to indicate the format of the data referenced by the hash. This new format is
called a Content ID, or CID for short. The previous bare multihashes will still
be fully supported throughout the entire application as CID version 0. The new
format with the type information will be CID version 1. To give an example,
the content referenced by the hash above is "Hello Ipfs!". That same content,
in the same format (dag-protobuf) using CIDv1 is
zb2rhkgXZVkT2xvDiuUsJENPSbWJy7fdYnsboLBzzEjjZMRoG
.
CIDv1 hashes are supported in ipfs versions back to 0.4.5. Nodes running 0.4.4 and older will not be able to load content via CIDv1 and we recommend that they update to a newer version.
There are many other use cases for CIDs. Plugins can be written to allow ipfs to natively address content from any other merkletree based system, such as git, bitcoin, zcash and ethereum -- a few systems we've already started work on.
Aside from the CID flag, there were many other changes as noted below:
- Features
- Add support for using CidV1 in 'ipfs add' (ipfs/go-ipfs#3743)
- Improvements
- Use CID as an ETag strong validator (ipfs/go-ipfs#3869)
- Update go-multihash with keccak and bitcoin hashes (ipfs/go-ipfs#3833)
- Update go-is-domain to contain new gTLD (ipfs/go-ipfs#3873)
- Periodically flush cached directories during ipfs add (ipfs/go-ipfs#3888)
- improved gateway directory listing for sharded nodes (ipfs/go-ipfs#3897)
- Documentation
- Change issue template to use Severity instead of Priority (ipfs/go-ipfs#3834)
- Fix link to commit hook script in contribute.md (ipfs/go-ipfs#3863)
- Fix install_unsupported for openbsd, add docs (ipfs/go-ipfs#3880)
- Bugfixes
- Fix wanlist typo in prometheus metric name (ipfs/go-ipfs#3841)
- Fix
make install
not using ldflags for git hash (ipfs/go-ipfs#3838) - Fix
make install
not installing dependencies (ipfs/go-ipfs#3848) - Fix erroneous Cache-Control: immutable on dir listings (ipfs/go-ipfs#3870)
- Fix bitswap accounting of 'BytesSent' in ledger (ipfs/go-ipfs#3876)
- Fix gateway handling of sharded directories (ipfs/go-ipfs#3889)
- Fix sharding memory growth, and fix resolver for unixfs paths (ipfs/go-ipfs#3890)
- General Changes and Refactorings
- Use ctx var consistently in daemon.go (ipfs/go-ipfs#3864)
- Handle 404 correctly in dist_get tool (ipfs/go-ipfs#3879)
- Testing
- Fix go fuse tests (ipfs/go-ipfs#3840)
Ipfs 0.4.8 brings with it several improvements, bugfixes, documentation improvements, and the long awaited directory sharding code.
Currently, when too many items are added into a unixfs directory, the object gets too large and you may experience issues. To pervent this problem, and generally make working really large directories more efficient, we have implemented a HAMT structure for unixfs. To enable this feature, run:
ipfs config --json Experimental.ShardingEnabled true
And restart your daemon if it was running.
Note: With this setting enabled, the hashes of any newly added directories will be different than they previously were, as the new code will use the sharded HAMT structure for all directories. Also, nodes running ipfs 0.4.7 and earlier will not be able to access directories created with this option.
That said, please do give it a try, let us know how it goes, and then take a look at all the other cool things added in 0.4.8 below.
- Features
- Implement unixfs directory sharding (ipfs/go-ipfs#3042)
- Add DisableNatPortMap option (ipfs/go-ipfs#3798)
- Basic Filestore utilty commands (ipfs/go-ipfs#3653)
- Improvements
- More Robust GC (ipfs/go-ipfs#3712)
- Automatically fix permissions for docker volumes (ipfs/go-ipfs#3744)
- Core API refinements and efficiency improvements (ipfs/go-ipfs#3493)
- Improve IsPinned() lookups for indirect pins (ipfs/go-ipfs#3809)
- Documentation
- Improve 'name' and 'key' helptexts (ipfs/go-ipfs#3806)
- Update link to paper in dev.md (ipfs/go-ipfs#3812)
- Add test to enforce helptext on commands (ipfs/go-ipfs#2648)
- Bugfixes
- Remove bloom filter check on Put call in blockstore (ipfs/go-ipfs#3782)
- Re-add the GOPATH checking functionality (ipfs/go-ipfs#3787)
- Use fsrepo.IsInitialized to test for initialization (ipfs/go-ipfs#3805)
- Return 404 Not Found for failed path resolutions (ipfs/go-ipfs#3777)
- Fix 'dist_get' failing without failing (ipfs/go-ipfs#3818)
- Update iptb with fix for t0130 hanging issue (ipfs/go-ipfs#3823)
- fix hidden file detection on windows (ipfs/go-ipfs#3829)
- General Changes and Refactorings
- Fix multiple govet warnings (ipfs/go-ipfs#3824)
- Make Golint happy in the blocks submodule (ipfs/go-ipfs#3827)
- Testing
- Enable codeclimate for automated linting and vetting (ipfs/go-ipfs#3821)
- Fix EOF test failure with Multipart.Read (ipfs/go-ipfs#3804)
Ipfs 0.4.7 contains several exciting new features! First off, The long awaited filestore feature has been merged, allowing users the option to not have ipfs store chunked copies of added files in the blockstore, pushing to burden of ensuring those files are not changed to the user. The filestore feature is currently still experimental, and must be enabled in your config with:
ipfs config --json Experimental.FilestoreEnabled true
before it can be used. Please see this issue for more details.
Next up, We have merged initial support for ipfs 'Private Networks'. This feature allows users to run ipfs in a mode that will only connect to other peers in the private network. This feature, like the filestore is being released experimentally, but if you're interested please try it out. Instructions for setting it up can be found here.
This release also enables support for the 'mplex' stream muxer by default. This
stream multiplexing protocol was available previously via the
--enable-mplex-experiment
daemon flag, but has now graduated to being 'less
experimental' and no longer requires the flag to use it.
Aside from those, we have a good number of bugfixes, perf improvements and new tests. Heres a list of highlights:
- Features
- Implement basic filestore 'no-copy' functionality (ipfs/go-ipfs#3629)
- Add support for private ipfs networks (ipfs/go-ipfs#3697)
- Enable 'mplex' stream muxer by default (ipfs/go-ipfs#3725)
- Add
--quieter
option toipfs add
(ipfs/go-ipfs#3770) - Report progress during
pin add
via--progress
(ipfs/go-ipfs#3671)
- Improvements
- Allow
ipfs get
to handle content added with raw leaves option (ipfs/go-ipfs#3757) - Fix accuracy of progress bar on
ipfs get
(ipfs/go-ipfs#3758) - Limit number of objects in batches to prevent too many fds issue (ipfs/go-ipfs#3756)
- Add more info to bitswap stat (ipfs/go-ipfs#3635)
- Add multiple performance metrics (ipfs/go-ipfs#3615)
- Make
dist_get
fall back to other downloaders if one fails (ipfs/go-ipfs#3692)
- Allow
- Documentation
- Add Arch Linux install instructions to readme (ipfs/go-ipfs#3742)
- Improve release checklist document (ipfs/go-ipfs#3717)
- Bugfixes
- Fix drive root parsing on windows (ipfs/go-ipfs#3328)
- Fix panic in ipfs get when passing no parameters to API (ipfs/go-ipfs#3768)
- Fix breakage of
ipfs pin add
api output (ipfs/go-ipfs#3760) - Fix issue in DHT queries that was causing poor record replication (ipfs/go-ipfs#3748)
- Fix
ipfs mount
crashing if no name was published before (ipfs/go-ipfs#3728) - Add
self
key to theipfs key list
listing (ipfs/go-ipfs#3734) - Fix panic when shutting down
ipfs daemon
pre gateway setup (ipfs/go-ipfs#3723)
- General Changes and Refactorings
- Refactor
EnumerateChildren
to avoid need for bestEffort parameter (ipfs/go-ipfs#3700) - Update fuse dependency, fixing several issues (ipfs/go-ipfs#3727)
- Add
install_unsupported
makefile target for 'exotic' systems (ipfs/go-ipfs#3719) - Deprecate implicit daemon argument in Dockerfile (ipfs/go-ipfs#3685)
- Refactor
- Testing
- Add test to ensure helptext is under 80 columns wide (ipfs/go-ipfs#3774)
- Add unit tests for auto migration code (ipfs/go-ipfs#3618)
- Fix iptb stop issue in sharness tests (ipfs/go-ipfs#3714)
Ipfs 0.4.6 contains several bugfixes related to migrations and also contains a few other improvements to other parts of the codebase. Notably:
-
The default config will now contain some ipv6 addresses for bootstrap nodes.
-
ipfs pin add
should be faster and consume less memory. -
Pinning thousands of files no longer causes superlinear usage of storage space.
-
Improvements
- Make pinset sharding deterministic (ipfs/go-ipfs#3640)
- Update to go-multihash with blake2 (ipfs/go-ipfs#3649)
- Pass cids instead of nodes around in EnumerateChildrenAsync (ipfs/go-ipfs#3598)
- Add /ip6 bootstrap nodes (ipfs/go-ipfs#3523)
- Add sub-object support to
dag get
command (ipfs/go-ipfs#3687) - Add half-closed streams support to multiplex experiment (ipfs/go-ipfs#3695)
-
Documentation
- Add the snap installation instructions (ipfs/go-ipfs#3663)
- Add closed PRs, Issues throughput (ipfs/go-ipfs#3602)
-
Bugfixes
- Fix auto-migration on docker nodes (ipfs/go-ipfs#3698)
- Update flatfs to v1.1.2, fixing directory fd issue (ipfs/go-ipfs#3711)
-
General Changes and Refactorings
- Remove
FindProviders
from routing mocks (ipfs/go-ipfs#3617) - Use Marshalers instead of PostRun to process
block rm
output (ipfs/go-ipfs#3708)
- Remove
-
Testing
- Makefile rework and sharness test coverage (ipfs/go-ipfs#3504)
- Print out all daemon stderr files when iptb stop fails (ipfs/go-ipfs#3701)
- Add tests for recursively pinning a dag (ipfs/go-ipfs#3691)
- Fix lack of commit hash during build (ipfs/go-ipfs#3705)
- Update to fixed webui. (ipfs/go-ipfs#3669)
- Fix handling of null arrays in cbor ipld objects. (ipfs/go-ipfs#3666)
- Add env var to enable yamux debug logging. (ipfs/go-ipfs#3668)
- Fix libc check during auto-migrations. (ipfs/go-ipfs#3665)
- Fixed json output of ipld objects in
ipfs dag get
(ipfs/go-ipfs#3655)
-
Notable changes
- IPLD and CIDs
- Rework go-ipfs to use Content IDs (ipfs/go-ipfs#3187) (ipfs/go-ipfs#3290)
- Turn merkledag.Node into an interface (ipfs/go-ipfs#3301)
- Implement cbor ipld nodes (ipfs/go-ipfs#3325)
- Allow cid format selection in block put command (ipfs/go-ipfs#3324) (ipfs/go-ipfs#3483)
- Bitswap protocol extension to handle cids (ipfs/go-ipfs#3297)
- Add dag get to read-only api (ipfs/go-ipfs#3499)
- Raw Nodes
- Implement 'Raw Node' node type for addressing raw data (ipfs/go-ipfs#3307)
- Optimize DagService GetLinks for Raw Nodes. (ipfs/go-ipfs#3351)
- Experimental PubSub
- Added a very basic pubsub implementation (ipfs/go-ipfs#3202)
- Core API
- gateway: use core api for serving GET/HEAD/POST (ipfs/go-ipfs#3244)
- IPLD and CIDs
-
Improvements
- Disable auto-gc check in 'ipfs cat' (ipfs/go-ipfs#3100)
- Add
bitswap ledger
command (ipfs/go-ipfs#2852) - Add
ipfs block rm
command. (ipfs/go-ipfs#2962) - Add config option to disable bandwidth metrics (ipfs/go-ipfs#3381)
- Add experimental dht 'client mode' flag (ipfs/go-ipfs#3269)
- Add config option to set reprovider interval (ipfs/go-ipfs#3101)
- Add
ipfs dht provide
command (ipfs/go-ipfs#3106) - Add stream info to
ipfs swarm peers -v
(ipfs/go-ipfs#3352) - Add option to enable go-multiplex experiment (ipfs/go-ipfs#3447)
- Basic Keystore implementation (ipfs/go-ipfs#3472)
- Make
ipfs add --local
not send providers messages (ipfs/go-ipfs#3102) - Fix bug in
ipfs tar add
that buffered input in memory (ipfs/go-ipfs#3334) - Make blockstore retry operations on temporary errors (ipfs/go-ipfs#3091)
- Don't hold the PinLock in adder when not pinning. (ipfs/go-ipfs#3222)
- Validate repo/api file and improve error message (ipfs/go-ipfs#3219)
- no longer hard code gomaxprocs (ipfs/go-ipfs#3357)
- Updated Bash complete script (ipfs/go-ipfs#3377)
- Remove expensive debug statement in blockstore AllKeysChan (ipfs/go-ipfs#3384)
- Remove GC timeout, fix GC tests (ipfs/go-ipfs#3494)
- Fix
ipfs pin add
resource consumption (ipfs/go-ipfs#3495) (ipfs/go-ipfs#3571) - Add IPNS entry to DHT cache after publish (ipfs/go-ipfs#3501)
- Add in
--routing=none
daemon option (ipfs/go-ipfs#3605)
-
Bitswap
- Don't re-provide blocks we've provided very recently (ipfs/go-ipfs#3105)
- Add a deadline to sendmsg calls (ipfs/go-ipfs#3445)
- cleanup bitswap and handle message send failure slightly better (ipfs/go-ipfs#3408)
- Increase wantlist resend delay to one minute (ipfs/go-ipfs#3448)
- Fix issue where wantlist fullness wasn't included in messages (ipfs/go-ipfs#3461)
- Only pass keys down newBlocks chan in bitswap (ipfs/go-ipfs#3271)
-
Bugfixes
- gateway: fix --writable flag (ipfs/go-ipfs#3206)
- Fix relative seek in unixfs not expanding file properly (ipfs/go-ipfs#3095)
- Update multicodec service names for ipfs services (ipfs/go-ipfs#3132)
- dht: add missing protocol ID to newStream call (ipfs/go-ipfs#3203)
- Return immediately on namesys error (ipfs/go-ipfs#3345)
- Improve osxfuse handling (ipfs/go-ipfs#3098) (ipfs/go-ipfs#3413)
- commands: fix opt.Description panic when desc was empty (ipfs/go-ipfs#3521)
- Fixes #3133: Properly handle release candidates in version comparison (ipfs/go-ipfs#3136)
- Don't drop error in readStreamedJson. (ipfs/go-ipfs#3276)
- Error out on invalid
--routing
option (ipfs/go-ipfs#3482) - Respect contexts when returning diagnostics responses (ipfs/go-ipfs#3353)
- Fix json marshalling of pbnode (ipfs/go-ipfs#3507)
-
General changes and refactorings
- Disable Suborigins the spec changed and our impl conflicts (ipfs/go-ipfs#3519)
- Avoid sending provide messages for pinsets (ipfs/go-ipfs#3103)
- Refactor cli handling to expose argument parsing functionality (ipfs/go-ipfs#3308)
- Create a FilestoreNode object to carry PosInfo (ipfs/go-ipfs#3314)
- Print 'n/a' instead of zero latency in
ipfs swarm peers
(ipfs/go-ipfs#3491) - Add DAGService.GetLinks() method to optimize traversals. (ipfs/go-ipfs#3255)
- Make path resolver no longer require whole IpfsNode for construction (ipfs/go-ipfs#3321)
- Distinguish between Offline and Local Modes of daemon operation. (ipfs/go-ipfs#3259)
- Separate out the GC Locking from the Blockstore interface. (ipfs/go-ipfs#3348)
- Avoid unnecessary allocs in datastore key handling (ipfs/go-ipfs#3407)
- Use NextSync method for datastore queries (ipfs/go-ipfs#3386)
- Switch unixfs.Metadata.MimeType to optional (ipfs/go-ipfs#3458)
- Fix path parsing in
ipfs name publish
(ipfs/go-ipfs#3592) - Fix inconsistent
ipfs stats bw
formatting (ipfs/go-ipfs#3554) - Set the libp2p agent version based on version string (ipfs/go-ipfs#3569)
-
Cross Platform Changes
- Fix 'dist_get' script on BSDs. (ipfs/go-ipfs#3264)
- ulimit: Tune resource limits on BSDs (ipfs/go-ipfs#3374)
-
Metrics
- Introduce go-metrics-interface (ipfs/go-ipfs#3189)
- Fix metrics injection (ipfs/go-ipfs#3315)
-
Misc
- Bump Go requirement to 1.7 (ipfs/go-ipfs#3111)
- Merge 0.4.3 release candidate changes back into master (ipfs/go-ipfs#3248)
- Add [email protected] GPG key to assets (ipfs/go-ipfs#2997)
- Improve makefiles (ipfs/go-ipfs#2999) (ipfs/go-ipfs#3265)
- Refactor install.sh script (ipfs/go-ipfs#3194)
- Add test check for go code formatting (ipfs/go-ipfs#3421)
- bin: dist_get script: prevents get_go_vars() returns same values twice (ipfs/go-ipfs#3079)
-
Dependencies
- Update libp2p to have fixed spdystream dep (ipfs/go-ipfs#3210)
- Update libp2p and dht packages (ipfs/go-ipfs#3263)
- Update to libp2p 4.0.1 and propogate other changes (ipfs/go-ipfs#3284)
- Update to libp2p 4.0.4 (ipfs/go-ipfs#3361)
- Update go-libp2p across codebase (ipfs/go-ipfs#3406)
- Update to go-libp2p 4.1.0 (ipfs/go-ipfs#3373)
- Update deps for libp2p 3.4.0 (ipfs/go-ipfs#3110)
- Update go-libp2p-swarm with deadlock fixes (ipfs/go-ipfs#3339)
- Update to new cid and ipld node packages (ipfs/go-ipfs#3326)
- Update to newer ipld node interface with Copy and better Tree (ipfs/go-ipfs#3391)
- Update experimental go-multiplex to 0.2.6 (ipfs/go-ipfs#3475)
- Rework routing interfaces to make separation easier (ipfs/go-ipfs#3107)
- Update to dht code with fixed GetClosestPeers (ipfs/go-ipfs#3346)
- Move go-is-domain to gx (ipfs/go-ipfs#3077)
- Extract thirdparty/loggables and thirdparty/peerset (ipfs/go-ipfs#3204)
- Completely remove go-key dep (ipfs/go-ipfs#3439)
- Remove randbo dep, its no longer needed (ipfs/go-ipfs#3118)
- Update libp2p for identify configuration updates (ipfs/go-ipfs#3539)
- Use newer flatfs sharding scheme (ipfs/go-ipfs#3608)
-
Testing
- fix test_fsh arg quoting in ipfs-test-lib (ipfs/go-ipfs#3085)
- 100% coverage for blocks/blocksutil (ipfs/go-ipfs#3090)
- 100% coverage on blocks/set (ipfs/go-ipfs#3084)
- 81% coverage on blockstore (ipfs/go-ipfs#3074)
- 80% coverage of unixfs/mod (ipfs/go-ipfs#3096)
- 82% coverage on blocks (ipfs/go-ipfs#3086)
- 87% coverage on unixfs (ipfs/go-ipfs#3492)
- Improve coverage on routing/offline (ipfs/go-ipfs#3516)
- Add test for flags package (ipfs/go-ipfs#3449)
- improve test coverage on merkledag package (ipfs/go-ipfs#3113)
- 80% coverage of unixfs/io (ipfs/go-ipfs#3097)
- Accept more than one digit in repo version tests (ipfs/go-ipfs#3130)
- Fix typo in hash in t0050 (ipfs/go-ipfs#3170)
- fix bug in pinsets and add a stress test for the scenario (ipfs/go-ipfs#3273) (ipfs/go-ipfs#3302)
- Report coverage to codecov (ipfs/go-ipfs#3473)
- Add test for 'ipfs config replace' (ipfs/go-ipfs#3073)
- Fix netcat on macOS not closing socket when the stdin sends EOF (ipfs/go-ipfs#3515)
-
Documentation
- Update dns help with a correct domain name (ipfs/go-ipfs#3087)
- Add period to
ipfs pin rm
(ipfs/go-ipfs#3088) - Make all Taglines use imperative mood (ipfs/go-ipfs#3041)
- Document listing commands better (ipfs/go-ipfs#3083)
- Add notes to readme on building for uncommon systems (ipfs/go-ipfs#3051)
- Add branch naming conventions doc (ipfs/go-ipfs#3035)
- Replace keyword with <> (ipfs/go-ipfs#3129)
- Fix Add() docs regarding pinning (ipfs/go-ipfs#3513)
- Add sudo to install commands. (ipfs/go-ipfs#3201)
- Add docs for
"commands".Command.Run
(ipfs/go-ipfs#3382) - Put config keys in proper case (ipfs/go-ipfs#3365)
- Fix link in
ipfs stats bw
help message (ipfs/go-ipfs#3620)
This release contains an important hotfix for a bug we discovered in how pinning works. If you had a large number of pins, new pins would overwrite existing pins. Apart from the hotfix, this release is equal to the previous release 0.4.3.
- Fix bug in pinsets fanout, and add stress test. (@whyrusleeping, ipfs/go-ipfs#3273)
We published a detailed account of the bug and fix in a blog post.
There have been no changes since the last release candidate 0.4.3-rc4. \o/
This release candidate fixes issues in Bitswap and the ipfs add
command, and improves testing.
We plan for this to be the last release candidate before the release of go-ipfs v0.4.3.
With this release candidate, we're also moving go-ipfs to Go 1.7, which we expect will yield improvements in runtime performance, memory usage, build time and size of the release binaries.
- Require Go 1.7. (@whyrusleeping, @Kubuxu, @lgierth, ipfs/go-ipfs#3163)
- For this purpose, switch Docker image from Alpine 3.4 to Alpine Edge.
- Fix cancellation of Bitswap
wantlist
entries. (@whyrusleeping, ipfs/go-ipfs#3182) - Fix clearing of
active
state of Bitswap provider queries. (@whyrusleeping, ipfs/go-ipfs#3169) - Fix a panic in the DHT code. (@Kubuxu, ipfs/go-ipfs#3200)
- Improve handling of
Identity
field inipfs config
command. (@Kubuxu, @whyrusleeping, ipfs/go-ipfs#3141) - Fix explicit adding of symlinked files and directories. (@kevina, ipfs/go-ipfs#3135)
- Fix bash auto-completion of
ipfs daemon --unrestricted-api
option. (@lgierth, ipfs/go-ipfs#3159) - Introduce a new timeout tool for tests to avoid licensing issues. (@Kubuxu, ipfs/go-ipfs#3152)
- Improve output for migrations of fs-repo. (@lgierth, ipfs/go-ipfs#3158)
- Fix info notice of commands taking input from stdin. (@Kubuxu, ipfs/go-ipfs#3134)
- Bring back a few tests for stdin handling of
ipfs cat
andipfs add
. (@Kubuxu, ipfs/go-ipfs#3144) - Improve sharness tests for
ipfs repo verify
command. (@whyrusleeping, ipfs/go-ipfs#3148) - Improve sharness tests for CORS headers on the gateway. (@Kubuxu, ipfs/go-ipfs#3142)
- Improve tests for pinning within
ipfs files
. (@kevina, ipfs/go-ipfs#3151) - Improve tests for the automatic raising of file descriptor limits. (@whyrusleeping, ipfs/go-ipfs#3149)
This release candidate fixes a panic that occurs when input from stdin was expected, but none was given: ipfs/go-ipfs#3050
This release includes bugfixes and fixes for regressions that were introduced between 0.4.2 and 0.4.3-rc1.
- Regressions
- Fix daemon panic when there is no multipart input provided over the HTTP API. (@whyrusleeping, ipfs/go-ipfs#2989)
- Fix
ipfs refs --edges
not printing edges. (@Kubuxu, ipfs/go-ipfs#3007) - Fix progress option for
ipfs add
defaulting to true on the HTTP API. (@whyrusleeping, ipfs/go-ipfs#3025) - Fix erroneous printing of stdin reading message. (@whyrusleeping, ipfs/go-ipfs#3033)
- Fix panic caused by passing
--mount
and--offline
flags toipfs daemon
. (@Kubuxu, ipfs/go-ipfs#3022) - Fix symlink path resolution on windows. (@Kubuxu, ipfs/go-ipfs#3023)
- Add in code to prevent issue 3032 from crashing the daemon. (@whyrusleeping, ipfs/go-ipfs#3037)
This is a maintenance release which comes with a couple of nice enhancements, and improves the performance of Storage, Bitswap, as well as Content and Peer Routing. It also introduces a handful of new commands and options, and fixes a good bunch of bugs.
This is the first Release Candidate. Unless there are vulnerabilities or regressions discovered, the final 0.4.3 release will happen about one week from now.
-
Security Vulnerability
- The
master
branch if go-ipfs suffered from a vulnerability for about 3 weeks. It allowed an attacker to use an iframe to request malicious HTML and JS from the API of a local go-ipfs node. The attacker could then gain unrestricted access to the node's API, and e.g. extract the private key. We fixed this issue by reintroducing restrictions on which particular objects can be loaded through the API (@lgierth, ipfs/go-ipfs#2949), and by completely excluding the private key from the API (@Kubuxu, ipfs/go-ipfs#2957). We will also work on more hardening of the API in the next release. - The previous release 0.4.2 is not vulnerable. That means if you're using official binaries from dist.ipfs.io you're not affected. If you're running go-ipfs built from the
master
branch between June 17th (ipfs/go-ipfs@1afebc21) and July 7th (ipfs/go-ipfs@39bef0d5), please update to v0.4.3-rc1 immediately. - We are grateful to the group of independent researchers who made us aware of this vulnerability. We wanna use this opportunity to reiterate that we're very happy about any additional review of pull requests and releases. You can contact us any time at [email protected] (GPG 4B9665FB 92636D17 7C7A86D3 50AAE8A9 59B13AF3).
- The
-
Notable changes
- Improve Bitswap performance. (@whyrusleeping, ipfs/go-ipfs#2727, ipfs/go-ipfs#2798)
- Improve Content Routing and Peer Routing performance. (@whyrusleeping, ipfs/go-ipfs#2817, ipfs/go-ipfs#2841)
- Improve datastore, blockstore, and dagstore performance. (@kevina, @Kubuxu, @whyrusleeping ipfs/go-datastore#43, ipfs/go-ipfs#2885, ipfs/go-ipfs#2961, ipfs/go-ipfs#2953, ipfs/go-ipfs#2960)
- Content Providers are now stored on disk to gain savings on process memory. (@whyrusleeping, ipfs/go-ipfs#2804, ipfs/go-ipfs#2860)
- Migrations of the fs-repo (usually stored at
~/.ipfs
) now run automatically. If there's a TTY available, you'll get prompted when runningipfs daemon
, and in addition you can use the--migrate=true
or--migrate=false
options to avoid the prompt. (@whyrusleeping, @lgierth, ipfs/go-ipfs#2939) - The internal naming of blocks in the blockstore has changed, which requires a migration of the fs-repo, from version 3 to 4. (@whyrusleeping, ipfs/go-ipfs#2903)
- We now automatically raise the file descriptor limit to 1024 if neccessary. (@whyrusleeping, ipfs/go-ipfs#2884, ipfs/go-ipfs#2891)
- After a long struggle with deadlocks and hanging connections, we've decided to disable the uTP transport by default for now. (@whyrusleeping, ipfs/go-ipfs#2840, ipfs/go-libp2p-transport@88244000)
- There is now documentation for the configuration options in
docs/config.md
. (@whyrusleeping, ipfs/go-ipfs#2974) - All commands now sanely handle the combination of stdin and optional flags in certain edge cases. (@lgierth, ipfs/go-ipfs#2952)
-
New Features
- Add
--offline
option toipfs daemon
command, which disables all swarm networking. (@Kubuxu, ipfs/go-ipfs#2696, ipfs/go-ipfs#2867) - Add
Datastore.HashOnRead
option for verifying block hashes on read access. (@Kubuxu, ipfs/go-ipfs#2904) - Add
Datastore.BloomFilterSize
option for tuning the blockstore's new lookup bloom filter. (@Kubuxu, ipfs/go-ipfs#2973)
- Add
-
Bugfixes
- Fix publishing of local IPNS entries, and more. (@whyrusleeping, ipfs/go-ipfs#2943)
- Fix progress bars in
ipfs add
andipfs get
. (@whyrusleeping, ipfs/go-ipfs#2893, ipfs/go-ipfs#2948) - Make sure files added through
ipfs files
are pinned and don't get GC'd. (@kevina, ipfs/go-ipfs#2872) - Fix copying into directory using
ipfs files cp
. (@whyrusleeping, ipfs/go-ipfs#2977) - Fix
ipfs version --commit
with Docker containers. (@lgierth, ipfs/go-ipfs#2734) - Run
ipfs diag
commands in the daemon instead of the CLI. (@Kubuxu, ipfs/go-ipfs#2761) - Fix protobuf encoding on the API and in commands. (@stebalien, ipfs/go-ipfs#2516)
- Fix goroutine leak in
/ipfs/ping
protocol handler. (@whyrusleeping, ipfs/go-libp2p#58) - Fix
--flags
option onipfs commands
. (@Kubuxu, ipfs/go-ipfs#2773) - Fix the error channels in
namesys
. (@whyrusleeping, ipfs/go-ipfs#2788) - Fix consumptions of observed swarm addresses. (@whyrusleeping, ipfs/go-libp2p#63, ipfs/go-ipfs#2771)
- Fix a rare DHT panic. (@whyrusleeping, ipfs/go-ipfs#2856)
- Fix go-ipfs/js-ipfs interoperability issues in SPDY. (@whyrusleeping, whyrusleeping/go-smux-spdystream@fae17783)
- Fix a logging race condition during shutdown. (@Kubuxu, ipfs/go-log#3)
- Prevent DHT connection hangs. (@whyrusleeping, ipfs/go-ipfs#2826, ipfs/go-ipfs#2863)
- Fix NDJSON output of
ipfs refs local
. (@Kubuxu, ipfs/go-ipfs#2812) - Fix race condition in NAT detection. (@whyrusleeping, ipfs/go-libp2p#69)
- Fix error messages. (@whyrusleeping, @Kubuxu, ipfs/go-ipfs#2905, ipfs/go-ipfs#2928)
-
Enhancements
- Increase maximum object size on
ipfs put
from 1 MiB to 2 MiB. The maximum object size on the wire including all framing is 4 MiB. (@kpcyrd, ipfs/go-ipfs#2980) - Add CORS headers to the Gateway's default config. (@Kubuxu, ipfs/go-ipfs#2778)
- Clear the dial backoff for a peer when using
ipfs swarm connect
. (@whyrusleeping, ipfs/go-ipfs#2941) - Allow passing options to daemon in Docker container. (@lgierth, ipfs/go-ipfs#2955)
- Add
-v/--verbose
toìpfs swarm peers
command. (@csasarak, ipfs/go-ipfs#2713) - Add
--format
,--hash
, and--size
options toipfs files stat
command. (@Kubuxu, ipfs/go-ipfs#2706) - Add
--all
option toipfs version
command. (@Kubuxu, ipfs/go-ipfs#2790) - Add
ipfs repo version
command. (@pfista, ipfs/go-ipfs#2598) - Add
ipfs repo verify
command. (@whyrusleeping, ipfs/go-ipfs#2924, ipfs/go-ipfs#2951) - Add
ipfs stats repo
andipfs stats bitswap
command aliases. (@pfista, ipfs/go-ipfs#2810) - Add success indication to responses of
ipfs ping
command. (@Kubuxu, ipfs/go-ipfs#2813) - Save changes made via
ipfs swarm filter
to the config file. (@yuvallanger, ipfs/go-ipfs#2880) - Expand
ipfs_p2p_peers
metric to include libp2p transport. (@lgierth, ipfs/go-ipfs#2728) - Rework
ipfs files add
internals to avoid caching and prevent memory leaks. (@whyrusleeping, ipfs/go-ipfs#2795) - Support
GOPATH
with multiple path components. (@karalabe, @lgierth, @djdv, ipfs/go-ipfs#2808, ipfs/go-ipfs#2862, ipfs/go-ipfs#2975)
- Increase maximum object size on
-
General Codebase
- Take steps towards the
filestore
datastore. (@kevina, ipfs/go-ipfs#2792, ipfs/go-ipfs#2634) - Update recommended Golang version to 1.6.2 (@Kubuxu, ipfs/go-ipfs#2724)
- Update to Gx 0.8.0 and Gx-Go 1.2.1, which is faster and less noisy. (@whyrusleeping, ipfs/go-ipfs#2979)
- Use
go4.org/lock
instead ofcamlistore/lock
for locking. (@whyrusleeping, ipfs/go-ipfs#2887) - Manage
go.uuid
,hamming
,backoff
,proquint
,pb
,go-context
,cors
,go-datastore
packages with Gx. (@Kubuxu, ipfs/go-ipfs#2733, ipfs/go-ipfs#2736, ipfs/go-ipfs#2757, ipfs/go-ipfs#2825, ipfs/go-ipfs#2838) - Clean up the gateway's surface. (@lgierth, ipfs/go-ipfs#2874)
- Simplify the API gateway's access restrictions. (@lgierth, ipfs/go-ipfs#2949, ipfs/go-ipfs#2956)
- Update docker image to Alpine Linux 3.4 and remove Go version constraint. (@lgierth, ipfs/go-ipfs#2901, ipfs/go-ipfs#2929)
- Clarify
Dockerfile
andDockerfile.fast
. (@lgierth, ipfs/go-ipfs#2796) - Simplify resolution of Git commit refs in Dockerfiles. (@lgierth, ipfs/go-ipfs#2754)
- Consolidate
--verbose
description across commands. (@Kubuxu, ipfs/go-ipfs#2746) - Allow setting position of default values in command option descriptions. (@Kubuxu, ipfs/go-ipfs#2744)
- Set explicit default values for boolean command options. (@RichardLitt, ipfs/go-ipfs#2657)
- Autogenerate command synopsises. (@Kubuxu, ipfs/go-ipfs#2785)
- Fix and improve lots of documentation. (@RichardLitt, ipfs/go-ipfs#2741, ipfs/go-ipfs#2781)
- Improve command descriptions to fit a width of 78 characters. (@RichardLitt, ipfs/go-ipfs#2779, ipfs/go-ipfs#2780, ipfs/go-ipfs#2782)
- Fix filename conflict in the debugging guide. (@Kubuxu, ipfs/go-ipfs#2752)
- Decapitalize log messages, according to Golang style guides. (@RichardLitt, ipfs/go-ipfs#2853)
- Add Github Issues HowTo guide. (@RichardLitt, @chriscool, ipfs/go-ipfs#2889, ipfs/go-ipfs#2895)
- Add Github Issue template. (@chriscool, ipfs/go-ipfs#2786)
- Apply standard-readme to the README file. (@RichardLitt, ipfs/go-ipfs#2883)
- Fix issues pointed out by
govet
. (@Kubuxu, ipfs/go-ipfs#2854) - Clarify
ipfs get
error message. (@whyrusleeping, ipfs/go-ipfs#2886) - Remove dead code. (@whyrusleeping, ipfs/go-ipfs#2819)
- Add changelog for v0.4.3. (@lgierth, ipfs/go-ipfs#2984)
- Take steps towards the
-
Tests & CI
- Fix flaky
ipfs mount
sharness test by using theiptb
tool. (@noffle, ipfs/go-ipfs#2707) - Fix flaky IP port selection in tests. (@Kubuxu, ipfs/go-ipfs#2855)
- Fix CLI tests on OSX by resolving /tmp symlink. (@Kubuxu, ipfs/go-ipfs#2926)
- Fix flaky GC test by running the daemon in offline mode. (@Kubuxu, ipfs/go-ipfs#2908)
- Add tests for
ipfs add
with hidden files. (@Kubuxu, ipfs/go-ipfs#2756) - Add test to make sure the body of HEAD responses is empty. (@Kubuxu, ipfs/go-ipfs#2775)
- Add test to catch misdials. (@Kubuxu, ipfs/go-ipfs#2831)
- Mark flaky tests for
ipfs dht query
as known failure. (@noffle, ipfs/go-ipfs#2720) - Remove failing blockstore-without-context test. (@Kubuxu, ipfs/go-ipfs#2857)
- Fix
--version
tests for versions with a suffix like-dev
or-rc1
. (@lgierth, ipfs/go-ipfs#2937) - Make sharness tests work in cases where go-ipfs is symlinked into GOPATH. (@lgierth, ipfs/go-ipfs#2937)
- Add variable delays to blockstore mocks. (@rikonor, ipfs/go-ipfs#2871)
- Disable Travis CI email notifications. (@Kubuxu, ipfs/go-ipfs#2896)
- Fix flaky
This is a patch release which fixes performance and networking bugs in go-libp2p, You should see improvements in CPU and RAM usage, as well as speed of object lookups. There are also a few other nice improvements.
-
Notable Fixes
- Set a deadline for dialing attempts. This prevents a node from accumulating failed connections. (@whyrusleeping)
- Avoid unnecessary string/byte conversions in go-multihash. (@whyrusleeping)
- Fix a deadlock around the yamux stream muxer. (@whyrusleeping)
- Fix a bug that left channels open, causing hangs. (@whyrusleeping)
- Fix a bug around yamux which caused connection hangs. (@whyrusleeping)
- Fix a crash caused by nil multiaddrs. (@whyrusleeping)
-
Enhancements
- Add NetBSD support. (@erde74)
- Set Cache-Control: immutable on /ipfs responses. (@kpcyrd)
- Have
ipfs init
optionally accept a default configuration from stdin. (@sivachandran) - Add
ipfs log ls
command for listing logging subsystems. (@hsanjuan) - Allow bitswap to read multiple messages per stream. (@whyrusleeping)
- Remove
make toolkit_upgrade
step. (@chriscool)
-
Documentation
- Add a debug-guidelines document. (@richardlitt)
- Update the contribute document. (@richardlitt)
- Fix documentation of many
ipfs
commands. (@richardlitt) - Fall back to ShortDesc if LongDesc is missing. (@Kubuxu)
-
Removals
- Remove -f option from
ipfs init
command. (@whyrusleeping)
- Remove -f option from
-
Bugfixes
- Fix
ipfs object patch
argument handling and validation. (@jbenet) - Fix
ipfs config edit
command by running it client-side. (@Kubuxu) - Set default value for
ipfs refs
arguments. (@richardlitt) - Fix parsing of incorrect command and argument permutations. (@thomas-gardner)
- Update Dockerfile to latest go1.5.4-r0. (@chriscool)
- Allow passing IPFS_LOGGING to Docker image. (@lgierth)
- Fix dot path parsing on Windows. (@djdv)
- Fix formatting of
ipfs log ls
output. (@richardlitt)
- Fix
-
General Codebase
- Refactor Makefile. (@kevina)
- Wire context into bitswap requests more deeply. (@whyrusleeping)
- Use gx for iptb. (@chriscool)
- Update gx and gx-go. (@chriscool)
- Make blocks.Block an interface. (@kevina)
- Silence check for Docker existance. (@chriscool)
- Add dist_get script for fetching tools from dist.ipfs.io. (@whyrusleeping)
- Add proper defaults to all
ipfs
commands. (@richardlitt) - Remove dead
count
option fromipfs pin ls
. (@richardlitt) - Initialize pin mode strings only once. (@chriscool)
- Add changelog for v0.4.2. (@lgierth)
- Specify a dist.ipfs.io hash for tool downloads instead of trusting DNS. (@lgierth)
-
CI
- Fix t0170-dht sharness test. (@chriscool)
- Increase timeout in t0060-daemon sharness test. (@Kubuxu)
- Have CircleCI use
make deps
instead ofgx
directly. (@whyrusleeping)
This is a patch release that fixes a few bugs, and adds a few small (but not insignificant) features. The primary reason for this release is the listener hang bugfix that was shipped in the 0.4.0 release.
-
Features
- implemented ipfs object diff (@whyrusleeping)
- allow promises (used in get, refs) to fail (@whyrusleeping)
-
Tool changes
- Adds 'toolkit_upgrade' to the makefile help target (@achin)
-
General Codebase
- Use extracted go-libp2p-crypto, -secio, -peer packages (@lgierth)
- Update go-libp2p (@lgierth)
- Fix package manifest fields (@lgierth)
- remove incfusever dead-code (@whyrusleeping)
- remove a ton of unused godeps (@whyrusleeping)
- metrics: add prometheus back (@lgierth)
- clean up dead code and config fields (@whyrusleeping)
- Add log events when blocks are added/removed from the blockstore (@michealmure)
- repo: don't create logs directory, not used any longer (@lgierth)
-
Bugfixes
- fixed ipfs name resolve --local multihash error (@pfista)
- ipfs patch commands won't return null links field anymore (@whyrusleeping)
- Make non recursive resolve print the result (@Kubuxu)
- Output dirs on ipfs add -rn (@noffle)
- update libp2p dep to fix hanging listeners problem (@whyrusleeping)
- Fix Swarm.AddrFilters config setting with regard to
/ip6
addresses (@lgierth) - fix dht command key escaping (@whyrusleeping)
-
Testing
- Adds tests to make sure 'object patch' writes. (@noffle)
- small sharness test for promise failure checking (@whyrusleeping)
- sharness/Makefile: clean all BINS when cleaning (@chriscool)
-
Documentation
- Fix disconnect argument description (@richardlitt)
- Added a note about swarm disconnect (@richardlitt)
- Also fixed syntax for comment (@richardlitt)
- Alphabetized swarm subcmds (@richardlitt)
- Added note to ipfs stats bw interval option (@richardlitt)
- Small syntax changes to repo stat man (@richardlitt)
- update log command help text (@pfista)
- Added a long description to add (@richardlitt)
- Edited object patch set-data doc (@richardlitt)
- add roadmap.md (@Jeromy)
- Adds files api cmd to helptext (@noffle)
This is a major release with plenty of new features and bugfixes. It also includes breaking changes which make it incompatible with v0.3.x on the networking layer.
- Major Changes
- Multistream
- The addition of multistream is a breaking change on the networking layer, but gives IPFS implementations the ability to mix and match different stream multiplexers, e.g. yamux, spdystream, or muxado. This adds a ton of flexibility on one of the lower layers of the protocol, and will help us avoid further breaking protocol changes in the future.
- Files API
- The new
files
command and API allow a program to interact with IPFS using familiar filesystem operations, namely: creating directories, reading, writing, and deleting files, listing out different directories, and so on. This feature enables any other application that uses a filesystem-like backend for storage, to use IPFS as its storage driver without having change the application logic at all.
- The new
- Gx
- go-ipfs now uses gx to manage its
dependencies. This means that under the hood, go-ipfs's dependencies are
backed by IPFS itself! It also means that go-ipfs is no longer installed
using
go get
. Usemake install
instead.
- go-ipfs now uses gx to manage its
dependencies. This means that under the hood, go-ipfs's dependencies are
backed by IPFS itself! It also means that go-ipfs is no longer installed
using
- Multistream
- New Features
- Web UI
- Update to new version which is compatible with 0.4.0. (@dignifiedquire)
- Networking
- Implement uTP transport. (@whyrusleeping)
- Allow multiple addresses per configured bootstrap node. (@whyrusleeping)
- IPNS
- Improve IPNS resolution performance. (@whyrusleeping)
- Have dnslink prefer
TXT _dnslink.example.com
, allows usage of CNAME records. (@Kubuxu) - Prevent
ipfs name publish
when/ipns
is mounted. (@noffle)
- Repo
- Improve performance of
ipfs add
. (@whyrusleeping) - Add
Datastore.NoSync
config option for flatfs. (@rht) - Implement mark-and-sweep GC. (@whyrusleeping)
- Allow for GC during
ipfs add
. (@whyrusleeping) - Add
ipfs repo stat
command. (@tmg, @diasdavid)
- Improve performance of
- General
- Add support for HTTP OPTIONS requests. (@lidel)
- Add
ipfs diag cmds
to view active API requests (@whyrusleeping) - Add an
IPFS_LOW_MEM
environment variable which relaxes Bitswap's memory usage. (@whyrusleeping) - The Docker image now lives at
ipfs/go-ipfs
and has been completely reworked. (@lgierth)
- Web UI
- Security fixes
- The gateway path prefix added in v0.3.10 was vulnerable to cross-site
scripting attacks. This release introduces a configurable list of allowed
path prefixes. It's called
Gateway.PathPrefixes
and takes a list of strings, e.g.["/blog", "/foo/bar"]
. The v0.3.x line will not receive any further updates, so please update to v0.4.0 as soon as possible. (@lgierth)
- The gateway path prefix added in v0.3.10 was vulnerable to cross-site
scripting attacks. This release introduces a configurable list of allowed
path prefixes. It's called
- Incompatible Changes
- Install using
make install
instead ofgo get
(@whyrusleeping) - Rewrite pinning to store pins in IPFS objects. (@tv42)
- Bump fs-repo version to 3. (@whyrusleeping)
- Use multistream muxer (@whyrusleeping)
- The default for
--type
inipfs pin ls
is nowall
. (@chriscool)
- Install using
- Bug Fixes
- Remove msgio double wrap. (@jbenet)
- Buffer msgio. (@whyrusleeping)
- Perform various fixes to the FUSE code. (@tv42)
- Compute
ipfs add
size in background to not stall add operation. (@whyrusleeping) - Add option to have
ipfs add
include top-level hidden files. (@noffle) - Fix CORS checks on the API. (@rht)
- Fix
ipfs update
error message. (@tomgg) - Resolve paths in
ipfs pin rm
without network lookup. (@noffle) - Detect FUSE unmounts and track mount state. (@noffle)
- Fix go1.6rc2 panic caused by CloseNotify being called from wrong goroutine. (@rwcarlsen)
- Bump DHT kvalue from 10 to 20. (@whyrusleeping)
- Put public key and IPNS entry to DHT in parallel. (@whyrusleeping)
- Fix panic in CLI argument parsing. (@whyrusleeping)
- Fix range error by using larger-than-zero-length buffer. (@noffle)
- Fix yamux hanging issue by increasing AcceptBacklog. (@whyrusleeping)
- Fix double Transport-Encoding header bug. (@whyrusleeping)
- Fix uTP panic and file descriptor leak. (@whyrusleeping)
- Tool Changes
- Add
--pin
option toipfs add
, which defaults totrue
and allows--pin=false
. (@eminence) - Add arguments to
ipfs pin ls
. (@chriscool) - Add
dns
andresolve
commands to read-only API. (@Kubuxu) - Add option to display headers for
ipfs object links
. (@palkeo)
- Add
- General Codebase Changes
- Check Golang version in Makefile. (@chriscool)
- Improve Makefile. (@tomgg)
- Remove dead Jenkins CI code. (@lgierth)
- Add locking interface to blockstore. (@whyrusleeping)
- Add Merkledag FetchGraph and EnumerateChildren. (@whyrusleeping)
- Rename Lock/RLock to GCLock/PinLock. (@jbenet)
- Implement pluggable datastore types. (@tv42)
- Record datastore metrics for non-default datastores. (@tv42)
- Allow multistream to have zero-rtt stream opening. (@whyrusleeping)
- Refactor
ipnsfs
into a more generic and well testedmfs
. (@whyrusleeping) - Grab more peers if bucket doesn't contain enough. (@whyrusleeping)
- Use CloseNotify in gateway. (@whyrusleeping)
- Flatten multipart file transfers. (@whyrusleeping)
- Send updated DHT record fixes to peers who sent outdated records. (@whyrusleeping)
- Replace go-psutil with go-sysinfo. (@whyrusleeping)
- Use ServeContent for index.html. (@AtnNn)
- Refactor
object patch
API to not store data in URL. (@whyrusleeping) - Use mfs for
ipfs add
. (@whyrusleeping) - Add
Server
header to API responses. (@Kubuxu) - Wire context directly into HTTP requests. (@rht)
- Wire context directly into GetDAG operations within GC. (@rht)
- Vendor libp2p using gx. (@whyrusleeping)
- Use gx vendored packages instead of Godeps. (@whyrusleeping)
- Simplify merkledag package interface to ease IPLD inclusion. (@mildred)
- Add default option value support to commands lib. (@whyrusleeping)
- Refactor merkledag fetching methods. (@whyrusleeping)
- Use net/url to escape paths within Web UI. (@noffle)
- Deprecated key.Pretty(). (@MichealMure)
- Documentation
- Fix and update help text for every
ipfs
command. (@RichardLitt) - Change sample API origin settings from wildcard (
*
) toexample.com
. (@Kubuxu) - Improve documentation of installation process in README. (@whyrusleeping)
- Improve windows.md. (@chriscool)
- Clarify instructions for installing from source. (@noffle)
- Make version checking more robust. (@jedahan)
- Assert the source code is located within GOPATH. (@whyrusleeping)
- Remove mentions of
/dns
fromipfs dns
command docs. (@lgierth)
- Fix and update help text for every
- Testing
- Refactor iptb tests. (@chriscool)
- Improve t0240 sharness test. (@chriscool)
- Make bitswap tests less flaky. (@whyrusleeping)
- Use TCP port zero for ipfs daemon in sharness tests. (@whyrusleeping)
- Improve sharness tests on AppVeyor. (@chriscool)
- Add a pause to fix timing on t0065. (@whyrusleeping)
- Add support for arbitrary TCP ports to t0060-daemon.sh. (@noffle)
- Make t0060 sharness test use TCP port zero. (@whyrusleeping)
- Randomized ipfs stress testing via randor (@dignifiedquire)
- Stress test pinning and migrations (@whyrusleeping)
This is the final ipfs version before the transition to v0.4.0. It introduces a few stability improvements, bugfixes, and increased test coverage.
-
Features
- Add 'get' and 'patch' to the allowed gateway commands (@whyrusleeping)
- Updated webui version (@dignifiedquire)
-
BugFixes
- Fix path parsing for add command (@djdv)
- namesys: Make paths with multiple segments work. Fixes #2059 (@Kubuxu)
- Fix up panic catching in http handler funcs (@whyrusleeping)
- Add correct access control headers to the default api config (@dignifiedquire)
- Fix closenotify by not sending empty file set (@whyrusleeping)
-
Tool Changes
- Have install.sh use the full path to ipfs binary if detected (@jedahan)
- Install daemon system-wide if on El Capitan (@jedahan)
- makefile: add -ldflags to install and nofuse tasks (@lgierth)
-
General Codebase
- Clean up http client code (@whyrusleeping)
- Move api version check to header (@rht)
-
Documentation
- Improved release checklist (@jbenet)
- Added quotes around command in long description (@RichardLitt)
- Added a shutdown note to daemon description (@RichardLitt)
-
Testing
- t0080: improve last tests (@chriscool)
- t0080: improve 'ipfs refs --unique' test (@chriscool)
- Fix t.Fatal usage in goroutines (@chriscool)
- Add docker testing support to sharness (@chriscool)
- sharness: add t0300-docker-image.sh (@chriscool)
- Included more namesys tests. (@Kubuxu)
- Add sharness test to verify requests look good (@whyrusleeping)
- Re-enable ipns sharness test now that iptb is fixed (@whyrusleeping)
- Force use of ipv4 in test (@whyrusleeping)
- Travis-CI: use go 1.5.2 (@jbenet)
This patch update introduces the 'ipfs update' command which will be used for future ipfs updates along with a few other bugfixes and documentation improvements.
-
Features
- support for 'ipfs update' to call external binary (@whyrusleeping)
- cache ipns entries to speed things up a little (@whyrusleeping)
- add option to version command to print repo version (@whyrusleeping)
- Add in some more notifications to help profile queries (@whyrusleeping)
- gateway: add path prefix for directory listings (@lgierth)
- gateway: add CurrentCommit to /version (@lgierth)
-
BugFixes
- set data and links nil if not present (@whyrusleeping)
- fix log hanging issue, and implement close-notify for commands (@whyrusleeping)
- fix dial backoff (@whyrusleeping)
- proper ndjson implementation (@whyrusleeping)
- seccat: fix secio context (@lgierth)
- Add newline to end of the output for a few commands. (@nham)
- Add fixed period repo GC + test (@rht)
-
Tool Changes
- Allow
ipfs cat
on ipns path (@rht)
- Allow
-
General Codebase
- rewrite of backoff mechanism (@whyrusleeping)
- refactor net code to use transports, in rough accordance with libp2p (@whyrusleeping)
- disable building fuse stuff on windows (@whyrusleeping)
- repo: remove Log config (@lgierth)
- commands: fix description of --api (@lgierth)
-
Documentation
- --help: Add a note on using IPFS_PATH to the footer of the helptext. (@sahib)
- Moved email juan to ipfs/contribute (@richardlitt)
- Added commit sign off section (@richardlitt)
- Added a security section (@richardlitt)
- Moved TODO doc to issue #1929 (@richardlitt)
-
Testing
- gateway: add tests for /version (@lgierth)
- Add gc auto test (@rht)
- t0020: cleanup dir with bad perms (@chriscool)
Note: this commit introduces fixed-period repo gc, which will trigger gc
after a fixed period of time. This feature is introduced now, disabled by
default, and can be enabled with ipfs daemon --enable-gc
. If all goes well,
in the future, it will be enabled by default.
This patch update includes a good number of bugfixes, notably, it fixes builds on windows, and puts newlines between streaming json objects for a proper ndjson format.
-
Features
- Writable gateway enabled again (@cryptix)
-
Bugfixes
- fix windows builds (@whyrusleeping)
- content type on command responses default to text (@whyrusleeping)
- add check to makefile to ensure windows builds don't fail silently (@whyrusleeping)
- put newlines between streaming json output objects (@whyrusleeping)
- fix streaming output to flush per write (@whyrusleeping)
- purposely fail builds pre go1.5 (@whyrusleeping)
- fix ipfs id (@whyrusleeping)
- fix a few race conditions in mocknet (@whyrusleeping)
- fix makefile failing when not in a git repo (@whyrusleeping)
- fix cli flag orders (long, short) (@rht)
- fix races in http cors (@miolini)
- small webui update (some bugfixes) (@jbenet)
-
Tool Changes
- make swarm connect return an error when it fails (@whyrusleeping)
- Add short flag for
ipfs ls --headers
(v for verbose) (@rht)
-
General Codebase
- bitswap: clean log printf and humanize dup data count (@cryptix)
- config: update pluto's peerID (@lgierth)
- config: update bootstrap list hostname (@lgierth)
-
Documentation
- Pared down contribute to link to new go guidelines (@richardlitt)
-
Testing
- t0010: add tests for 'ipfs commands --flags' (@chriscool)
- ipns_test: fix namesys.NewNameSystem() call (@chriscool)
- t0060: fail if no nc (@chriscool)
This patch update includes changes to make ipns more consistent and reliable, symlink support in unixfs, mild performance improvements, new tooling features, a plethora of bugfixes, and greatly improved tests.
NOTICE: Version 0.3.8 also requires golang version 1.5.1 or higher.
-
Bugfixes
- refactor ipns to be more consistent and reliable (@whyrusleeping)
- fix 'ipfs refs' json output (@whyrusleeping)
- fix setting null config maps (@rht)
- fix output of dht commands (@whyrusleeping)
- fix NAT spam dialing (@whyrusleeping)
- fix random panics on 32 bit systems (@whyrusleeping)
- limit total number of network fd's (@whyrusleeping)
- fix http api content type (@WeMeetAgain)
- fix writing of api file for port zero daemons (@whyrusleeping)
- windows connection refused fixes (@mjanczyk)
- use go1.5's built in trailers, no more failures (@whyrusleeping)
- fix random bitswap hangs (@whyrusleeping)
- rate limit fd usage (@whyrusleeping)
- fix panic in bitswap ratelimiting (@whyrusleeping)
-
Tool Changes
- --empty-repo option for init (@prusnak)
- implement symlinks (@whyrusleeping)
- improve cmds lib files processing (@rht)
- properly return errors through commands (@whyrusleeping)
- bitswap unwant command (@whyrusleeping)
- tar add/cat commands (@whyrusleeping)
- fix gzip compression in get (@klauspost)
- bitswap stat logs wasted bytes (@whyrusleeping)
- resolve command now uses core.Resolve (@rht)
- add
--local
flag to 'name resolve' (@whyrusleeping) - add
ipfs diag sys
command for debugging help (@whyrusleeping)
-
General Codebase
- improvements to dag editor (@whyrusleeping)
- swarm IPv6 in default config (Baptiste Jonglez)
- improve dir listing css (@rht)
- removed elliptic.P224 usage (@prusnak)
- improve bitswap providing speed (@jbenet)
- print panics that occur in cmds lib (@whyrusleeping)
- ipfs api check test fixes (@rht)
- update peerstream and datastore (@whyrusleeping)
- cleaned up tar-reader code (@jbenet)
- write context into coreunix.Cat (@rht)
- move assets to separate repo (@rht)
- fix proc/ctx wiring in bitswap (@jbenet)
- rabin fingerprinting chunker (@whyrusleeping)
- better notification on daemon ready (@rht)
- coreunix cat cleanup (@rht)
- extract logging into go-log (@whyrusleeping)
- blockservice.New no longer errors (@whyrusleeping)
- refactor ipfs get (@rht)
- readonly api on gateway (@rht)
- cleanup context usage all over (@rht)
- add xml decoding to 'object put' (@ForrestWeston)
- replace nodebuilder with NewNode method (@whyrusleeping)
- add metrics to http handlers (@lgierth)
- rm blockservice workers (@whyrusleeping)
- decompose maybeGzWriter (@rht)
- makefile sets git commit sha on build (@CaioAlonso)
-
Documentation
- add contribute file (@RichardLitt)
- add go devel guide to contribute.md (@whyrusleeping)
-
Testing
- fix mock notifs test (@whyrusleeping)
- test utf8 with object cmd (@chriscool)
- make mocknet conn close idempotent (@jbenet)
- fix fuse tests (@pnelson)
- improve sharness test quoting (@chriscool)
- sharness tests for chunker and add-cat (@rht)
- generalize peerid check in sharness (@chriscool)
- test_cmp argument cleanup (@chriscool)
This patch update fixes a problem we introduced in 0.3.6 and did not catch: the webui failed to work with out-of-the-box CORS configs. This has been fixed and now should work correctly. @jbenet
This patch improves the resource consumption of go-ipfs, introduces a few new options on the CLI, and also fixes (yet again) windows builds.
-
Resource consumption:
- fixed goprocess memory leak @rht
- implement batching on datastore @whyrusleeping
- Fix bitswap memory leak @whyrusleeping
- let bitswap ignore temporary write errors @whyrusleeping
- remove logging to disk in favor of api endpoint @whyrusleeping
- --only-hash option for add to skip writing to disk @whyrusleeping
-
Tool changes
- improved
ipfs daemon
output with all addresses @jbenet - improved
ipfs id -f
output, added<addrs>
and\n \t
support @jbenet ipfs swarm addrs local
now shows the local node's addrs @jbenet- improved config json parsing @rht
- improved Dockerfile to use alpine linux @Luzifer @lgierth
- improved bash completion @MichaelMure
- Improved 404 for gateway @cryptix
- add unixfs ls to list correct filesizes @wking
- ignore hidden files by default @gatesvp
- global --timeout flag @whyrusleeping
- fix random API failures by closing resp bodies @whyrusleeping
- ipfs swarm filters @whyrusleeping
- api returns errors in http trailers @whyrusleeping @jbenet
ipfs patch
learned to create intermediate nodes @whyrusleepingipfs object stat
now shows Hash @whyrusleepingipfs cat
now clears progressbar on exit @rhtipfs add -w -r <dir>
now wraps directories @jbenetipfs add -w <file1> <file2>
now wraps with one dir @jbenet- API + Gateway now support arbitrary HTTP Headers from config @jbenet
- API now supports CORS properly from config @jbenet
- Deprecated:
API_ORIGIN
env var (use config, seeipfs daemon --help
) @jbenet
- improved
-
General Codebase
nofuse
tag for windows @Luzifer- improved
ipfs add
code @gatesvp - started requiring license trailers @chriscool @jbenet
- removed CtxCloser for goprocess @rht
- remove deadcode @lgierth @whyrusleeping
- reduced number of logging libs to 2 (soon to be 1) @rht
- dial address filtering @whyrusleeping
- prometheus metrics @lgierth
- new index page for gateway @krl @cryptix
- move ping to separate protocol @whyrusleeping
- add events to bitswap for a dashboard @whyrusleeping
- add latency and bandwidth options to mocknet @heems
- levenshtein distance cmd autosuggest @sbruce
- refactor/cleanup of cmds http handler @whyrusleeping
- cmds http stream reports errors in trailers @whyrusleeping
-
Bugfixes
- fixed path resolution and validation @rht
- fixed
ipfs get -C
output and progress bar @rht - Fixed install pkg dist bug @jbenet @Luzifer
- Fix
ipfs get
silent failure @whyrusleeping ipfs get
tarx no longer times out @jbenetipfs refs -r -u
is now correct @gatesvp- Fix
ipfs add -w -r <dir>
wrapping bugs @jbenet - Fixed FUSE unmount failures @jbenet
- Fixed
ipfs log tail
command (api + cli) @whyrusleeping
-
Testing
- sharness updates @chriscool
- ability to disable secio for testing @jbenet
- fixed many random test failures, more reliable CI @whyrusleeping
- Fixed racey notifier failures @whyrusleeping
ipfs refs -r -u
test cases @jbenet- Fix failing pinning test @jbenet
- Better CORS + Referer tests @jbenet
- Added reversible gc test @rht
- Fixed bugs in FUSE IPNS tests @whyrusleeping
- Fixed bugs in FUSE IPFS tests @jbenet
- Added
random-files
tool for easier sharness tests @jbenet
-
Documentation
- Add link to init system examples @slang800
- Add CORS documentation to daemon init @carver (Note: this will change soon)
This patch improves overall stability and performance
- added 'object patch' and 'object new' commands @whyrusleeping
- improved symmetric NAT avoidance @jbenet
- move util.Key to blocks.Key @whyrusleeping
- fix memory leak in provider store @whyrusleeping
- updated webui to 0.2.0 @krl
- improved bitswap performance @whyrusleeping
- update fuse lib @cryptix
- fix path resolution @wking
- implement test_seq() in sharness @chriscool
- improve parsing of stdin for commands @chriscool
- fix 'ipfs refs' failing silently @whyrusleeping
- fix serial dialing bug @jbenet
- improved testing @chriscool @rht @jbenet
- fixed domain resolving @luzifer
- fix parsing of unwanted stdin @lgierth
- added CORS handlers to gateway @NodeGuy
- added
ipfs daemon --unrestricted-api
option @krl - general cleanup of dependencies
- fix ipns append bug @whyrusleeping
- fix out of memory panic @whyrusleeping
- add in expvar metrics @tv42
- bitswap improvements @whyrusleeping
- fix write-cache in blockstore @tv42
- vendoring cleanup @cryptix
- added
launchctl
plist for OSX @grncdr - improved Dockerfile, changed root and mount paths @ehd
- improved
pin ls
output to show types @vitorbaptista
This patch update fixes various issues, in particular:
- windows support (0.3.0 had broken it)
- commandline parses spaces correctly.
- much improved commandline parsing by @AtnNn
- improved dockerfile by @luzifer
- add cmd cleanup by @wking
- fix flatfs windows support by @tv42 and @gatesvp
- test case improvements by @chriscool
- ipns resolution timeout bug fix by @whyrusleeping
- new cluster tests with iptb by @whyrusleeping
- fix log callstack printing bug by @whyrusleeping
- document bash completion by @dylanPowers
This patch update implements multicast dns as well as fxing a few test issues.
- implement mdns peer discovery @whyrusleeping
- fix mounting issues in sharness tests @chriscool
This patch update fixes a few bugs:
- harden shutdown logic by @torarnv
- daemon locking fixes by @travisperson
- don't re-add entire dirs by @whyrusleeping
- tests now wait for graceful shutdown by @jbenet
- default key size is now 2048 by @jbenet
We've just released version 0.3.0, which contains many performance improvements, bugfixes, and new features. Perhaps the most noticeable change is moving block storage from leveldb to flat files in the filesystem.
What to expect:
-
much faster performance
-
Repo format 2
- moved default location from ~/.go-ipfs -> ~/.ipfs
- renamed lock filename daemon.lock -> repo.lock
- now using a flat-file datastore for local blocks
-
Fixed lots of bugs
- proper ipfs-path in various commands
- fixed two pinning bugs (recursive pins)
- increased yamux streams window (for speed)
- increased bitswap workers (+ env var)
- fixed memory leaks
- ipfs add error returns
- daemon exit bugfix
- set proper UID and GID on fuse mounts
-
Gateway
- Added support for HEAD requests
-
configuration
- env var to turn off SO_REUSEPORT: IPFS_REUSEPORT=false
- env var to increase bitswap workers: IPFS_BITSWAP_TASK_WORKERS=n
-
other
- bash completion is now available
- ipfs stats bw -- bandwidth meetering
And many more things.
- Alpha Release
-
bootstrap addresses now have .../ipfs/... in format config file Bootstrap field changed accordingly. users can upgrade cleanly with:
ipfs bootstrap >boostrap_peers ipfs bootstrap rm --all <install new ipfs> <manually add .../ipfs/... to addrs in bootstrap_peers> ipfs bootstrap add <bootstrap_peers