Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: add iroh-sync and integrate into iroh node #1333

Merged
merged 144 commits into from
Aug 24, 2023
Merged

feat: add iroh-sync and integrate into iroh node #1333

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
144 commits
Select commit Hold shift + click to select a range
3340613
feat: initial prototype of integrating iroh-sync
Frando Jul 26, 2023
867d741
sync: start impl of multikey
dignifiedquire Jul 3, 2023
f5c51c0
feat: integrate iroh-sync and iroh-gossip, add example
Frando Jul 6, 2023
230a362
feat: make the live sync handler work with many docs
Frando Jul 7, 2023
350a486
chore: cleanup and clippy
Frando Jul 7, 2023
e8e9158
chore: remove old code and add docs
Frando Jul 12, 2023
9a9266e
feat: WIP integration of sync and bytes
Frando Jul 12, 2023
b1868ad
feat: proper REPL for sync example, and docs store
Frando Jul 13, 2023
607fd81
feat(example-sync): add ticket command
Frando Jul 13, 2023
a0f96db
fix: adapt to changes on main after rebase
Frando Jul 26, 2023
e0e062c
example(sync): add watch command
dignifiedquire Jul 26, 2023
6347541
fixup
dignifiedquire Jul 26, 2023
82d4589
chore: unused variables
Frando Jul 26, 2023
94163c7
fix tests and warnings
dignifiedquire Jul 27, 2023
7240fc5
clippy cleanups
dignifiedquire Jul 27, 2023
069a53b
feat(iroh): metrics for iroh-sync
Frando Jul 27, 2023
ce9d809
fix: remove usage of unbounded channels
dignifiedquire Jul 27, 2023
2c9aa58
add todo
dignifiedquire Jul 27, 2023
5a627b9
sync: implement more extensive fetch methods
dignifiedquire Jul 27, 2023
5899d0e
add prefix methods
dignifiedquire Jul 27, 2023
43eff25
feat: enable metrics server on sync (#1308)
Arqu Jul 27, 2023
33883f8
chore: update deny.toml
dignifiedquire Jul 27, 2023
b487671
fix clippy and feature selection
dignifiedquire Jul 27, 2023
e56e7aa
doc: more docs fixes
dignifiedquire Jul 27, 2023
b4358dd
feat: file system export/import in sync repl
Frando Jul 27, 2023
c700721
feat: hammer sync example
Arqu Jul 27, 2023
6bdfaf6
chore: fmt
Frando Jul 27, 2023
27e0923
allow specifying number of threads and print out some basic stats
Arqu Jul 27, 2023
6745dfa
mad clippy is mad
Arqu Jul 27, 2023
aeda868
extend hammer with get/set modes
Arqu Jul 27, 2023
4de81b6
refactor: use clap::ValueEnum
Frando Jul 28, 2023
494748b
refactor: check results, and clearer variable names
Frando Jul 28, 2023
193a33a
refactor: count actual rows, and make mode an argument
Frando Jul 28, 2023
b0a7ab0
fix: rebase fix
Frando Jul 28, 2023
fb693b1
feat(iroh-sync): implement file system backed for documents (#1315)
dignifiedquire Aug 3, 2023
56fb90c
adapt after rebase on main
Frando Aug 7, 2023
e4fca32
chore: fmt
Frando Aug 7, 2023
b33d3ef
feat: download from peer that informed us about a change
Frando Jul 28, 2023
cd17db8
refactor: move downloader out of sync module
Frando Aug 7, 2023
722df34
fix: rebase
Frando Aug 7, 2023
f0d9ef2
fix imports
Frando Aug 7, 2023
111b117
chore: fmt
Frando Aug 7, 2023
59077b1
fix: metrics
Frando Aug 7, 2023
437c031
fix: feature flags
Frando Aug 7, 2023
481b771
chore: fmt
Frando Aug 7, 2023
8da512f
rework abstractions for integration in iroh node
Frando Aug 10, 2023
c76a1da
wip: integrate iroh sync and gossip
Frando Aug 4, 2023
7784510
add ticket for doc share, and concrete type for node client/controller
Frando Aug 9, 2023
d1caf19
add minimal client example
Frando Aug 9, 2023
f80617a
add util methods to obtain an iroh client
Frando Aug 9, 2023
134477a
fix: return DocTicket from share
Frando Aug 9, 2023
5880f50
feat: expose metrics over rpc
Frando Aug 9, 2023
e911696
expose stats in rpc client
Frando Aug 9, 2023
d021455
fix sync example after rebase
Frando Aug 10, 2023
c78fb5b
feat: reimplement download
Frando Aug 10, 2023
c039f72
feat(cli): support printing document content
Frando Aug 10, 2023
910fd87
remove unneeded todo comment
Frando Aug 10, 2023
f03b061
fix tests
Frando Aug 10, 2023
1f864b5
fix downloader and sync test
Frando Aug 10, 2023
961bd3d
fix: feature flags, and more docs
Frando Aug 10, 2023
67dd342
remove sync feature
Frando Aug 10, 2023
cb24396
chore: fmt & clippy fix
Frando Aug 10, 2023
75679db
fix: feature flags
Frando Aug 10, 2023
69951d2
fix: feature flags
Frando Aug 10, 2023
4d87cd3
docs: fixes
Frando Aug 10, 2023
14ce536
chore: clippy fix
Frando Aug 10, 2023
610d09f
refactor: better modules for client
Frando Aug 10, 2023
a16ec9a
fix: clippy
Frando Aug 10, 2023
ac5240e
fix: clippy
Frando Aug 10, 2023
3bc1483
fix: feature flags
Frando Aug 11, 2023
9d5d06a
fix: cleanup imports
Frando Aug 11, 2023
23d138b
fix: gossip endpoint init
Frando Aug 11, 2023
cc4c5a9
fix: less arguments for clippy
Frando Aug 11, 2023
d05e32c
increase logging in cli tests
Frando Aug 11, 2023
ef0892d
chore: remove obsolete file
Frando Aug 11, 2023
a285c6d
chore: clippy
Frando Aug 11, 2023
96c9a43
feat: implement minimal subscription for sync (#1346)
dignifiedquire Aug 14, 2023
fbfdd27
fix: unused code
Frando Aug 14, 2023
6daef61
test: use events in sync test
Frando Aug 14, 2023
e596d7b
chore: fmt
Frando Aug 14, 2023
ec4e619
refactor: simplify iroh-sync store trait
Frando Aug 14, 2023
35f3218
fix: debug for client
Frando Aug 14, 2023
4429435
fix: sync example
Frando Aug 14, 2023
d15b61d
refactor: improve subscription model for sync events
dignifiedquire Aug 14, 2023
4c649c1
docs and clippy
dignifiedquire Aug 14, 2023
ac2bd41
feat: content ready events
Frando Aug 14, 2023
07653ca
chore: clippy
Frando Aug 14, 2023
925ff83
fix: sync example
Frando Aug 14, 2023
f5c0dd9
fix
Frando Aug 15, 2023
c08fef8
refactor: make from peer id required
Frando Aug 15, 2023
0287d4d
Merge branch 'main' into sync-integration
Frando Aug 17, 2023
a8e8093
fix: content status for partial entries
Frando Aug 17, 2023
839a855
docs: fix
Frando Aug 17, 2023
cde53c3
chore: clippy
Frando Aug 17, 2023
fc91c5e
docs,refactor: add docs in iroh-sync and reduce public API surface
Frando Aug 16, 2023
ff90fe6
refactor: move keys into module
Frando Aug 16, 2023
1fb6f8f
chore: fmt
Frando Aug 16, 2023
b666f87
refactor: align variable names with rust crypto
Frando Aug 16, 2023
4b50b64
docs: improve docs further
Frando Aug 16, 2023
337fc1d
fix: item visibility in iroh-sync
Frando Aug 16, 2023
4df7796
remove obsolete comments
Frando Aug 16, 2023
b103077
refactor: make list_authors and list_namespaces return an interator
Frando Aug 17, 2023
036c168
fix: doc links
Frando Aug 17, 2023
b990a72
chore: clippy
Frando Aug 17, 2023
a3bd92e
doc: fixes
Frando Aug 17, 2023
b2a92f1
Merge branch 'main' into sync-integration
Frando Aug 22, 2023
5bf0e9e
fixes after merging main
Frando Aug 22, 2023
05035e3
chore: clippy
Frando Aug 22, 2023
e655828
more docs clean up
ramfox Aug 18, 2023
6615092
fix: sync example
Frando Aug 22, 2023
6fa839d
deps: be less specific in required versions
Frando Aug 22, 2023
ab2d2db
fix: do not require features for metrics
Frando Aug 22, 2023
629289b
docs(iroh-sync): copy prose from lib.rs to README.md
Frando Aug 22, 2023
3779d27
fix: idbytes macro
Frando Aug 22, 2023
f6f9f9c
Merge branch 'main' into sync-integration
Frando Aug 22, 2023
0968384
refactor: use base32 for Author and Namespace encoding
Frando Aug 23, 2023
452059b
Merge branch 'main' into sync-integration
Frando Aug 23, 2023
bbdf7bf
chore: clippy
Frando Aug 23, 2023
f571631
fix: docs for client, add stop_sync rpc call
Frando Aug 23, 2023
f065781
remove unimplemented PeerAdd and PeerList commands for now
Frando Aug 23, 2023
f00db58
docs and cleanup of RPC interface
Frando Aug 23, 2023
5e12659
cleanup
Frando Aug 23, 2023
2c540be
fix: log errors for incoming connections
Frando Aug 23, 2023
136a994
Merge branch 'main' into sync-integration
Frando Aug 23, 2023
23911fc
chore: remove leftover code
Frando Aug 23, 2023
e44fb83
chore: disable cross tests for armv7 and aarch64
Frando Aug 23, 2023
0d432da
feat: filter by author on
Frando Aug 23, 2023
502da40
cleanup naming
Frando Aug 23, 2023
a63fbf8
chore: fix CI skip statement
Frando Aug 23, 2023
3339add
fix: check if doc exists in client
Frando Aug 23, 2023
b4d2164
cleanup
Frando Aug 23, 2023
fe781be
chore: fmt
Frando Aug 23, 2023
264dadf
fix: last commit was broken
Frando Aug 23, 2023
503ff23
fix: clarify metrics initialization
Frando Aug 23, 2023
0e3f169
fix(sync): properly drop rpc subscriptions, add doc status (#1396)
Frando Aug 24, 2023
c50bf53
Merge branch 'main' into sync-integration
Frando Aug 24, 2023
d206252
refactor(iroh): simplify and cleanup the sync algorithm (#1401)
dignifiedquire Aug 24, 2023
8d803b0
refactor: move sync net code into iroh_sync
Frando Aug 24, 2023
248f6b3
Merge remote-tracking branch 'origin/main' into sync-integration
Frando Aug 24, 2023
3921eac
fix: doc links
Frando Aug 24, 2023
39fda80
fix: imports in tests
Frando Aug 24, 2023
7690287
fix: visibility
Frando Aug 24, 2023
0bc1efb
fix: sync example
Frando Aug 24, 2023
b7c7623
chore: make clippy happy
Frando Aug 24, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions .github/workflows/ci.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -245,6 +245,9 @@ jobs:
run: cross check --all --target ${{ matrix.target }}

- name: test
# cross tests are currently broken vor armv7 and aarch64
# see https://github.com/cross-rs/cross/issues/1311
if: matrix.target == 'i686-unknown-linux-gnu'
run: cross test --all --target ${{ matrix.target }} -- --test-threads=12

check_fmt_and_docs:
Expand Down
Loading
Loading