v0.30.0
- π¬ Discuss
- π¦ Highlights
- Improved P2P connectivity
- Refactored Bitswap and dag-pb chunker
- WebRTC-Direct Transport enabled by default
- UnixFS 1.5: Mode and Modification Time Support
- AutoNAT V2 Service Introduced Alongside V1
- Automated
ipfs version check
- Version Suffix Configuration
/unix/
socket support inAddresses.API
- Cleaned Up
ipfs daemon
Startup Log - Commands Preserve Specified Hostname
- π Changelog
- π¨βπ©βπ§βπ¦ Contributors
Overview
π¦ Highlights
This release took longer and is more packed with fixes and features than usual.
Important
TLDR: update, it contains many, many fixes.
Improved P2P connectivity
This release comes with significant go-libp2p update from v0.34.1 to v0.36.3 (release notes).
It includes multiple fixes to key protocols: QUIC/Webtransport/WebRTC, Connection Upgrades through Relay (DCUtR), and Secure WebSockets.
Also, peers that are behind certain types of NAT will now be more reachable. For this alone, Kubo users are highly encouraged to upgrade.
Refactored Bitswap and dag-pb chunker
Some workloads may experience improved memory profile thanks to optimizations from Boxo SDK v0.23.0.
Important
Storage providers should upgrade to take advantage of the Bitswap server fix, which resolves the issue of greedy peers depleting available wantlist slots for their PeerID, resulting in stalled downloads.
WebRTC-Direct Transport enabled by default
Kubo now ships with WebRTC Direct listener enabled by default: /udp/4001/webrtc-direct
.
WebRTC Direct complements existing /wss
(Secure WebSockets) and /webtransport
transports. Unlike /wss
, which requires a domain name and a CA-issued TLS certificate, WebRTC Direct works with IPs and can be enabled by default on all Kubo nodes.
Learn more: Swarm.Transports.Network.WebRTCDirect
Note
Kubo 0.30 includes a migration for existing users that adds /webrtc-direct
listener on the same UDP port as /udp/{port}/quic-v1
. This supports the WebRTC-Direct rollout by reusing preexisting UDP firewall settings and port mappings created for QUIC.
UnixFS 1.5: Mode and Modification Time Support
Kubo now allows users to opt-in to store mode and modification time for files, directories, and symbolic links.
By default, if you do not opt-in, the old behavior remains unchanged, and the same CIDs will be generated as before.
The ipfs add
CLI options --preserve-mode
and --preserve-mtime
can be used to store the original mode and last modified time of the file being added, and ipfs files stat /ipfs/CID
can be used for inspecting these optional attributes:
$ touch ./file
$ chmod 654 ./file
$ ipfs add --preserve-mode --preserve-mtime -Q ./file
QmczQr4XS1rRnWVopyg5Chr9EQ7JKpbhgnrjpb5kTQ1DKQ
$ ipfs files stat /ipfs/QmczQr4XS1rRnWVopyg5Chr9EQ7JKpbhgnrjpb5kTQ1DKQ
QmczQr4XS1rRnWVopyg5Chr9EQ7JKpbhgnrjpb5kTQ1DKQ
Size: 0
CumulativeSize: 22
ChildBlocks: 0
Type: file
Mode: -rw-r-xr-- (0654)
Mtime: 13 Aug 2024, 21:15:31 UTC
The CLI and HTTP RPC options --mode
, --mtime
and --mtime-nsecs
can be used to set them to arbitrary values.
Opt-in support for mode
and mtime
was also added to MFS (ipfs files --help
). For more information see --help
text of ipfs files touch|stat|chmod
commands.
Modification time support was also added to the Gateway. If present, value from file's dag-pb is returned in Last-Modified
HTTP header and requests made with If-Modified-Since
can produce HTTP 304 not modified response.
Note
Storing mode
and mtime
requires root block to be dag-pb
and disabled raw-leaves
setting to create envelope for storing the metadata.
AutoNAT V2 Service Introduced Alongside V1
The AutoNAT service enables nodes to determine their public reachability on the internet. AutoNAT V2 enhances this protocol with improved features. In this release, Kubo will offer both V1 and V2 services to other peers, although it will continue to use only V1 when acting as a client. Future releases will phase out V1, transitioning clients to utilize V2 exclusively.
For more details, see the Deployment Plan for AutoNAT V2 and AutoNAT
configuration options.
Automated ipfs version check
Kubo now performs privacy-preserving version checks using the libp2p identify protocol on peers detected by the Amino DHT client.
If more than 5% of Kubo peers seen by your node are running a newer version, you will receive a log message notification.
- For manual checks, refer to
ipfs version check --help
for details. - To disable automated checks, set
Version.SwarmCheckEnabled
tofalse
.
Version Suffix Configuration
Defining the optional agent version suffix is now simpler. The Version.AgentSuffix
value from the Kubo config takes precedence over any value provided via ipfs daemon --agent-version-suffix
(which is still supported).
Note
Setting a custom version suffix helps with ecosystem analysis, such as Amino DHT reports published at https://stats.ipfs.network
/unix/
socket support in Addresses.API
This release fixes a bug which blocked users from using Unix domain sockets for Kubo's RPC (instead of a local HTTP port).
$ ipfs config Addresses.API "/unix/tmp/kubo.socket"
$ ipfs daemon # start with rpc socket
...
RPC API server listening on /unix/tmp/kubo.socket
$ # cli client, in different terminal can find socket via /api file
$ cat $IPFS_PATH/api
/unix/tmp/kubo.socket
$ # or have it pased via --api
$ ipfs --api=/unix/tmp/kubo.socket id
Cleaned Up ipfs daemon
Startup Log
The ipfs daemon
startup output has been streamlined to enhance clarity and usability:
$ ipfs daemon
Initializing daemon...
Kubo version: 0.30.0
Repo version: 16
System version: amd64/linux
Golang version: go1.22.5
PeerID: 12D3KooWQ73s1CQsm4jWwQvdCAtc5w8LatyQt7QLQARk5xdhK9CE
Swarm listening on 127.0.0.1:4001 (TCP+UDP)
Swarm listening on 192.0.2.10:4001 (TCP+UDP)
Swarm listening on [::1]:4001 (TCP+UDP)
Swarm listening on [2001:0db8::10]:4001 (TCP+UDP)
Run 'ipfs id' to inspect announced and discovered multiaddrs of this node.
RPC API server listening on /ip4/127.0.0.1/tcp/5001
WebUI: http://127.0.0.1:5001/webui
Gateway server listening on /ip4/127.0.0.1/tcp/8080
Daemon is ready
The previous lengthy listing of all listener and announced multiaddrs has been removed due to its complexity, especially with modern libp2p nodes sharing multiple transports and long lists of /webtransport
and /webrtc-direct
certhashes.
The output now features a simplified list of swarm listeners, displayed in the format host:port (TCP+UDP)
, which provides essential information for debugging connectivity issues, particularly related to port forwarding.
Announced libp2p addresses are no longer printed on startup, because libp2p may change or augument them based on AutoNAT, relay, and UPnP state. Instead, users are prompted to run ipfs id
to obtain up-to-date list of listeners and announced multiaddrs in libp2p format.
Commands Preserve Specified Hostname
When executing a CLI command over Kubo RPC API, if a hostname is specified by --api=/dns4/<domain>/
the resulting HTTP request now contains the hostname, instead of the the IP address that the hostname resolved to, as was the previous behavior. This makes it easier for those trying to run Kubo behind a reverse proxy using hostname-based rules.
π Changelog
Full Changelog
- github.com/ipfs/kubo:
- chore: set version to 0.30.0
- chore: bump CurrentVersionNumber
- chore: boxo v0.23.0 and go-libp2p v0.36.3 (#10507) (ipfs/kubo#10507)
- fix: switch back to go 1.22 (#10502) (ipfs/kubo#10502)
- chore: update go-unixfsnode, cmds, and boxo (#10494) (ipfs/kubo#10494)
- fix(cli): preserve hostname specified with --api in http request headers (#10497) (ipfs/kubo#10497)
- chore: upgrade to go 1.23 (#10486) (ipfs/kubo#10486)
- fix: error during config when running benchmarks (#10495) (ipfs/kubo#10495)
- chore: update version to rc-2
- chore: update version
- chore: fix function name (#10481) (ipfs/kubo#10481)
- feat: Support storing UnixFS 1.5 Mode and ModTime (#10478) (ipfs/kubo#10478)
- fix(rpc): cross-platform support for /unix/ socket maddrs in Addresses.API (ipfs/kubo#10019)
- chore(daemon): sort listeners (#10480) (ipfs/kubo#10480)
- feat(daemon): improve stdout on startup (#10472) (ipfs/kubo#10472)
- fix(daemon): panic in kubo/daemon.go:595 (#10473) (ipfs/kubo#10473)
- feat: webui v4.3.0 (#10477) (ipfs/kubo#10477)
- docs(readme): add Gentoo Linux (#10474) (ipfs/kubo#10474)
- libp2p: default to prefering TLS (ipfs/kubo#10227)
- docs: document unofficial Ubuntu PPA (ipfs/kubo#10467)
- feat: run AutoNAT V2 service in addition to V1 (#10468) (ipfs/kubo#10468)
- feat: go-libp2p 0.36 and /webrtc-direct listener (#10463) (ipfs/kubo#10463)
- chore: update dependencies (#10462)(#10466) (ipfs/kubo#10466)
- feat: periodic version check and json config (#10438) (ipfs/kubo#10438)
- docs: clarify pnet limitations
- docs: "error mounting: could not resolve name" (#10449) (ipfs/kubo#10449)
- docs: update ipfs-swarm-key-gen example (#10453) (ipfs/kubo#10453)
- chore: update deps incl. boxo v0.21.0 (#10444) (ipfs/kubo#10444)
- chore: go-libp2p 0.35.1 (#10430) (ipfs/kubo#10430)
- docsa: update RELEASE_CHECKLIST.md
- chore: create next changelog (#10443) (ipfs/kubo#10443)
- Merge Release: v0.29.0 [skip changelog] (ipfs/kubo#10442)
- fix(cli): unify --name param in ls and add (#10439) (ipfs/kubo#10439)
- fix(libp2p): streams config validation in resource manager (#10435) (ipfs/kubo#10435)
- chore: fix some typos (#10396) (ipfs/kubo#10396)
- chore: update version
- github.com/ipfs/boxo (v0.20.0 -> v0.23.0):
- Release v0.23.0 (ipfs/boxo#669)
- docs(changelog): move entry to correct release
- Release v0.22.0 (ipfs/boxo#654)
- Release v0.21.0 (ipfs/boxo#622)
- github.com/ipfs/go-ipfs-cmds (v0.11.0 -> v0.13.0):
- chore: release v0.13.0 (#261) (ipfs/go-ipfs-cmds#261)
- chore: release v0.12.0 (#259) (ipfs/go-ipfs-cmds#259)
- github.com/ipfs/go-unixfsnode (v1.9.0 -> v1.9.1):
- Update release version (ipfs/go-unixfsnode#76)
- chore: update dependencies (ipfs/go-unixfsnode#75)
- github.com/libp2p/go-libp2p (v0.34.1 -> v0.36.3):
- Release v0.36.3
- Fix: WebSocket: Clone TLS config before creating a new listener
- fix: enable dctur when interface address is public (#2931) (libp2p/go-libp2p#2931)
- fix: QUIC/Webtransport Transports now will prefer their owned listeners for dialing out (#2936) (libp2p/go-libp2p#2936)
- ci: uci/update-go (#2937) (libp2p/go-libp2p#2937)
- fix: slice append value (#2938) (libp2p/go-libp2p#2938)
- webrtc: wait for listener context before dropping connection (#2932) (libp2p/go-libp2p#2932)
- ci: use go1.23, drop go1.21 (#2933) (libp2p/go-libp2p#2933)
- Fail on any test timeout (#2929) (libp2p/go-libp2p#2929)
- test: Try to fix test timeout (#2930) (libp2p/go-libp2p#2930)
- ci: Out of the tarpit (#2923) (libp2p/go-libp2p#2923)
- Fix proto import paths (#2920) (libp2p/go-libp2p#2920)
- Release v0.36.2
- webrtc: reduce loglevel for pion logs (#2915) (libp2p/go-libp2p#2915)
- webrtc: close connection when remote closes (#2914) (libp2p/go-libp2p#2914)
- basic_host: close swarm on Close (#2916) (libp2p/go-libp2p#2916)
- Revert "Create funding.json" (#2919) (libp2p/go-libp2p#2919)
- Create funding.json
- Release v0.36.1
- Release v0.36.0 (#2905) (libp2p/go-libp2p#2905)
- swarm: add a default timeout to conn.NewStream (#2907) (libp2p/go-libp2p#2907)
- udpmux: Don't log an error if canceled because of shutdown (#2903) (libp2p/go-libp2p#2903)
- ObsAddrManager: Infer external addresses for transports that share the same listening address. (#2892) (libp2p/go-libp2p#2892)
- feat: WebRTC reuse QUIC conn (#2889) (libp2p/go-libp2p#2889)
- examples/chat-with-mdns: default to a random port (#2896) (libp2p/go-libp2p#2896)
- allow findpeers limit to be 0 (#2894) (libp2p/go-libp2p#2894)
- quic: add support for quic-go metrics (#2823) (libp2p/go-libp2p#2823)
- webrtc: remove experimental tag, enable by default (#2887) (libp2p/go-libp2p#2887)
- config: fix AddrFactory for AutoNAT (#2868) (libp2p/go-libp2p#2868)
- chore: /quic β /quic-v1 (#2888) (libp2p/go-libp2p#2888)
- basichost: reset stream if SetProtocol fails (#2875) (libp2p/go-libp2p#2875)
- feat: libp2phttp
/http-path
(#2850) (libp2p/go-libp2p#2850) - readme: update per latest multiversx rename (#2874) (libp2p/go-libp2p#2874)
- websocket: don't return transport.ErrListenerClosed on closing listener (#2867) (libp2p/go-libp2p#2867)
- Added tau to README.md (#2870) (libp2p/go-libp2p#2870)
- basichost: reset new stream if rcmgr blocks (#2869) (libp2p/go-libp2p#2869)
- transport integration tests: test conn attempt is dropped when the rcmgr blocks for WebRTC (#2856) (libp2p/go-libp2p#2856)
- webtransport: close underlying h3 connection (#2862) (libp2p/go-libp2p#2862)
- peerstore: don't intern protocols (#2860) (libp2p/go-libp2p#2860)
- autonatv2: add server metrics for dial requests (#2848) (libp2p/go-libp2p#2848)
- PR Comments
- Add a transport level test to ensure we close conns after rejecting them by the rcmgr
- Close quic conns when wrapping conn fails
- libp2p: use rcmgr for autonat dials (#2842) (libp2p/go-libp2p#2842)
- metricshelper: improve checks for ip and transport (#2849) (libp2p/go-libp2p#2849)
- Don't reuse the URL, make a new one
- Use default transport to make using the Host cheaper
- cleanup
- Add future test
- HTTP Host implements RoundTripper
- swarm: improve dial worker performance for common case
- pstoremanager: fix connectedness check
- autonatv2: implement autonatv2 spec (#2469) (libp2p/go-libp2p#2469)
- webrtc: add a test for establishing many connections (#2801) (libp2p/go-libp2p#2801)
- webrtc: fix ufrag prefix for dialing (#2832) (libp2p/go-libp2p#2832)
- circuitv2: improve voucher validation (#2826) (libp2p/go-libp2p#2826)
- libp2phttp: workaround for ResponseWriter's CloseNotifier (#2821) (libp2p/go-libp2p#2821)
- Update README.md (#2830) (libp2p/go-libp2p#2830)
- identify: add test for observed address handling (#2828) (libp2p/go-libp2p#2828)
- identify: fix bug in observed address handling (#2825) (libp2p/go-libp2p#2825)
- identify: Don't filter addr if remote is neither public nor private (#2820) (libp2p/go-libp2p#2820)
- limit ping duration to 30s (#1358) (libp2p/go-libp2p#1358)
- Remove out-dated code in example readme (#2818) (libp2p/go-libp2p#2818)
- v0.35.0 (#2812) (libp2p/go-libp2p#2812)
- rcmgr: Support specific network prefix in conn limiter (#2807) (libp2p/go-libp2p#2807)
- github.com/libp2p/go-libp2p-kad-dht (v0.25.2 -> v0.26.1):
- Release v0.26.1 (libp2p/go-libp2p-kad-dht#983)
- fix: Unexport hasValidConnectedness to make a patch release (libp2p/go-libp2p-kad-dht#982)
- correctly merging fix from libp2p/go-libp2p-kad-dht#976 (libp2p/go-libp2p-kad-dht#980)
- Release v0.26.0 (libp2p/go-libp2p-kad-dht#979)
- chore: update deps (libp2p/go-libp2p-kad-dht#974)
- Upgrade to go-log v2.5.1 (libp2p/go-libp2p-kad-dht#971)
- Fix: don't perform lookupCheck if not enough peers in routing table (libp2p/go-libp2p-kad-dht#970)
- findnode(self) should return multiple peers (libp2p/go-libp2p-kad-dht#968)
- github.com/libp2p/go-libp2p-routing-helpers (v0.7.3 -> v0.7.4):
- chore: release v0.7.4 (#85) (libp2p/go-libp2p-routing-helpers#85)
- fix: composable parallel router tracing by index (#84) (libp2p/go-libp2p-routing-helpers#84)
- github.com/multiformats/go-multiaddr (v0.12.4 -> v0.13.0):
- Release v0.13.0 (multiformats/go-multiaddr#248)
- Add support for http-path (multiformats/go-multiaddr#246)
- github.com/whyrusleeping/cbor-gen (v0.1.1 -> v0.1.2):
- properly extend strings (#95) (whyrusleeping/cbor-gen#95)
- ioutil to io (#98) (whyrusleeping/cbor-gen#98)
π¨βπ©βπ§βπ¦ Contributors
Contributor | Commits | Lines Β± | Files Changed |
---|---|---|---|
Andrew Gillis | 14 | +4920/-1714 | 145 |
sukun | 26 | +4402/-448 | 79 |
Marco Munizaga | 32 | +2287/-536 | 73 |
Marcin Rataj | 41 | +685/-193 | 86 |
Patryk | 1 | +312/-10 | 8 |
guillaumemichel | 7 | +134/-105 | 14 |
Adin Schmahmann | 5 | +145/-80 | 9 |
Henrique Dias | 2 | +190/-1 | 6 |
Josh Klopfenstein | 1 | +90/-35 | 27 |
gammazero | 5 | +90/-28 | 11 |
Jeromy Johnson | 1 | +116/-0 | 5 |
Daniel N | 3 | +27/-25 | 9 |
Daniel Norman | 2 | +28/-19 | 4 |
Ivan Shvedunov | 2 | +25/-10 | 2 |
Michael MurΓ© | 2 | +22/-9 | 4 |
Dominic Della Valle | 1 | +23/-4 | 1 |
Andrei Vukolov | 1 | +27/-0 | 1 |
chris erway | 1 | +9/-9 | 9 |
Vitaly Zdanevich | 1 | +12/-0 | 1 |
Guillaume Michel | 1 | +4/-7 | 1 |
swedneck | 1 | +10/-0 | 1 |
Jorropo | 2 | +5/-5 | 3 |
omahs | 1 | +4/-4 | 4 |
THAT ONE GUY | 1 | +3/-5 | 2 |
vyzo | 1 | +5/-2 | 1 |
looklose | 1 | +3/-3 | 2 |
web3-bot | 2 | +2/-3 | 4 |
Dave Huseby | 1 | +5/-0 | 1 |
shenpengfeng | 1 | +1/-1 | 1 |
bytetigers | 1 | +1/-1 | 1 |
Sorin Stanculeanu | 1 | +1/-1 | 1 |
LukΓ‘Ε‘ LukΓ‘Δ | 1 | +1/-1 | 1 |
Gabe | 1 | +1/-1 | 1 |
Bryan Stenson | 1 | +1/-1 | 1 |
Samy Fodil | 1 | +1/-0 | 1 |
Lane Rettig | 1 | +1/-0 | 1 |
This release was brought to you by the Shipyard team.