Roadmap #1

kumavis · 2017-07-04T04:37:59Z

ghost · 2017-07-04T04:53:36Z

Moving up ^^

danfinlay · 2017-07-04T05:53:53Z

I like what I see happening over here. Keep up the good work, gentlemen!

kumavis · 2017-08-17T06:08:53Z

updated rpc->ipfs TODOs

ghost · 2017-09-04T06:13:02Z

@kumavis what is the plan for the smart contract code? Currently, the accounts in the state trie only store the codeHash, which is the keccak256 hash of the EVM Code (as defined in YP 4.1.), leaving open to the implementator how to store it.

Geth at least, just uses this codeHash as key in their levelDB. See here

Are we missing the IPLD codec for this element?

kumavis · 2017-09-05T22:14:43Z

@herman correct, we dont have a codec for it -- we should consider making one

i've been using the raw binary codec, but turns out that was actually not supported in js-ipfs and so I created a PR for it -- for sure about go-ipfs

kumavis · 2017-09-05T22:21:33Z

got stalled, i need to get back on it
ipld/js-ipld#90

ghost · 2017-09-06T00:01:32Z

@kumavis Will do the PR in go-cid as well. What is the link of the PR in js? Which code byte are we going to be using?

kumavis · 2017-09-06T00:19:59Z

@hermanjunge bin (raw binary) 0x55

ghost · 2017-09-07T21:28:20Z

Asked by @diasdavid to make a write up on my status to-date. Did it here ipfs/notes#261

kumavis · 2017-10-04T22:14:11Z

some blockers:

optional:

maybe rename to ipld-bin the correct codec name ipld/js-ipld-raw#2

daviddias · 2017-10-06T12:32:02Z

@kumavis just missing ipld/js-ipld#90, need your input there. All the others have been shipped.

@hermanjunge thank you for the write up! ❤️ ipfs/notes#261

kumavis · 2017-10-06T22:32:16Z

thanks/ here's the remainders

kumavis · 2017-10-10T02:53:22Z

cache cht results!
add cht middleware for block lookups
add all missing middleware (e.g. id mgmt)
debug frequent chrome crashes https://support.google.com/chrome/a/answer/6271282
verify handling of empty code:
0xc5d2460186f7233c927e7db2dcc703c0e500b653ca82273b7bfad8045d85a470
zb34WAxFQD4oNVkG9PRFauGV6cu51KgpQbBXARSbVDD5d9Viw
verify handling of missing account / storage entry
verify handling of empty storageRoot:
0x56e81f171bcc55a6ff8345e692c0f86e5b48e01b996cadc001622fb5e363b421
z46gvXALNuXdCn6ts67LS6JkPUkZb7zNrH6fMayQM7U9HNLDtWt (aka "Honolulu dittwitt")

kumavis · 2017-10-10T04:44:30Z

udapp-ipfs is live!
uses infura for block-by-number lookups and logs, everything else is clientside (vm) or ipfs (state)

kumavis · 2017-10-11T00:31:36Z

published:

kumavis · 2017-10-11T09:09:20Z

@diasdavid

js-multicodec needs a release

kumavis · 2017-10-12T21:06:27Z

exists, but super crashy and not fully QA'd
https://github.com/MetaMask/metamask-extension/tree/ipfs-client

ghost · 2017-10-23T16:33:12Z

Did some editing to the first comment. Divided the goals into CLIENT, BEACONS, BUCKETS and OTHER.

ghost · 2017-10-23T16:59:04Z

ghost · 2017-10-24T11:23:26Z

From ipfs/go-ipld-eth-import#9 (comment)

seems actually rlpx is the transport/peer layer and devp2p is some sort of wire (sub)protocol multiplexer

So, I've reading code starting from here and here, and I agree. Also, I learned about transports here. seemed that I was having all nomenclatures wrong in my head: We didn't want to do a different wire protocol, only a transport.

I may then want to build a transport library called go-libp2p-rlpx. For that, My plan should be:

Write down the golang APIs needed for a peer in libp2p,
Learn how do I send messages to a peer,
Learn how do I handle them (so the devp2p peers don´t cancel our connections for being bad neighbors, protocol-wise)

That should suffice to have an example like this running, getting peers and their ethereum data.

What are your thoughts @jwasinger?

jwasinger · 2017-10-24T18:37:26Z

This looks good @hermanjunge . As we discussed, I will be working on writing the javascript implementation of the rlpx transport js-libp2p-rlpx.

dryajov · 2017-10-24T19:33:39Z

@hermanjunge that's the approach I was suggesting earlier, it seems tho that according to @whyrusleeping, this might end up being more involved than necessary. An alternative seems to be running both devp2p and libp2p stacks in the client and doing the bridging that way, IIUC. Just leaving this here, for future reference:

whyrusleeping [11:39 AM] 
@dryajov you shouldnt mount devp2p on libp2p
[11:39] 
you want to just run both network stacks separately
[11:39] 
and have logic that ties between them
[11:39] 
a bridge, basically

AFDudley · 2017-12-05T02:42:44Z

@hermanjunge you were looking into adding postgres support to go-ethereum via https://github.com/ethereum/go-ethereum/tree/master/ethdb

ethereum/go-ethereum#2690

Why was that strategy abandoned and this one adopted? It seems like support ipfs dag put from within go-ethereum would get the job done as well?

Thanks.

ghost · 2017-12-05T03:47:21Z

Hi @AFDudley

Why was that strategy abandoned and this one adopted? It seems like support ipfs dag put from within go-ethereum would get the job done as well?

The strategy of implementing RedisDB or PostgreSQL as storages in https://github.com/ethereum/go-ethereum/tree/master/ethdb was abandoned for lack of resources at that time. Now we have the capacity to commit in the area of blockchain storage.

There are several ways to skin a cat. The approach you mention is correct: Instead of making a put into levelDB, we just ipfs dag put. It is very likely to happen that when we are able to reach a good health of nodes running eth-ipld data, we should just implement something that talks to libp2p in the ethdb package.

The devp2p<->libp2p bridge being built is importing the github.com/ethereum/go-ethereum/p2p (and log and common). The idea behind this approach is to enable the user of this program to extract the data from the devp2p network without the need of running an ETH node. Generally speaking, from my experience in Chile, even an Ethereum fast synchronization is a huge pain, and it's getting worse. That's the motivation.

kumavis · 2018-02-10T16:08:42Z

break down of rpc methods and node requirements (updated)

client
  eth_protocolVersion
  eth_syncing
  eth_coinbase
  eth_mining
  eth_hashrate
  eth_gasPrice
  eth_accounts
  eth_sign
  eth_sendTransaction
  eth_sendRawTransaction
  eth_newFilter
  eth_newBlockFilter
  eth_newPendingTransactionFilter
  eth_uninstallFilter
  eth_getFilterChanges
  eth_getFilterLogs

client broadcast
  eth_sendRawTransaction

ipfs
  eth_getBlockByHash
  eth_getUncleByBlockHashAndIndex

ipns/block syncing (head tracking)
  eth_blockNumber

ipld:selectors (selectors/transforms)
  eth_getBlockTransactionCountByHash
  eth_getUncleCountByBlockHash

index:txToBlock (coselector)
  eth_getTransactionReceipt
  eth_getTransactionByHash
  eth_getTransactionByBlockHashAndIndex

log query?? / geth bloomFilterTrie / index:logToTx
  eth_getLogs (+index:logToTx)

lazy vm (slow) / remote vm + proofs (faster)
  eth_call
  eth_estimateGas

index:CHT
  eth_call
  eth_estimateGas
  eth_getBalance
  eth_getStorageAt
  eth_getTransactionCount
  eth_getCode
  eth_getBlockByNumber
  eth_getTransactionByBlockNumberAndIndex (+index:txToBlock)
  eth_getBlockTransactionCountByNumber (+ipld:selectors)
  eth_getUncleCountByBlockNumber (+ipld:selectors)
  eth_getUncleByBlockNumberAndIndex
  eth_getLogs (+log query)

ghost · 2018-02-20T00:20:51Z

Yet another writeup, older, but wiser. (they say)

ipld/ipld#28 (comment)

ghost · 2018-02-21T02:22:00Z

A more polished writeup:

Moving to a problem of maintaining a distributed ethereum snapshot database on js-ipfs browser peers

ipld/ipld#29

ghost · 2018-02-22T18:15:10Z

Moving everything here musteka-la/mustekala#2

ghost mentioned this issue Jul 4, 2017

libp2p mesh testing MetaMask/metamask-extension#719

Closed

36 tasks

kumavis mentioned this issue Jul 9, 2017

🦊 MetaMask libp2p/js-libp2p#106

Closed

ghost mentioned this issue Jul 20, 2017

Next steps ipfs/go-ipld-eth#1

Open

ghost mentioned this issue Sep 7, 2017

Ethereum + IPLD: State of the art (go-ipld-eth + importer + next steps) ipfs/notes#261

Closed

This was referenced Oct 23, 2017

Roadmap: Hot Importer ipfs/go-ipld-eth-import#2

Closed

libp2p<->dep2p integration ipfs/go-ipld-eth-import#9

Closed

ghost mentioned this issue Nov 10, 2017

[WIP] PoC: Connect to DevP2P, retrieve trie data ipfs/go-ipld-eth-import#8

Closed

15 tasks

ghost mentioned this issue Feb 22, 2018

The Roadmap musteka-la/mustekala#2

Closed

37 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Roadmap #1

Roadmap #1

kumavis commented Jul 4, 2017 •

edited by ghost

Loading

ghost commented Jul 4, 2017 •

edited by ghost

Loading

danfinlay commented Jul 4, 2017

kumavis commented Aug 17, 2017

ghost commented Sep 4, 2017 •

edited by ghost

Loading

kumavis commented Sep 5, 2017

kumavis commented Sep 5, 2017

ghost commented Sep 6, 2017 •

edited by ghost

Loading

kumavis commented Sep 6, 2017

ghost commented Sep 7, 2017

kumavis commented Oct 4, 2017 •

edited

Loading

daviddias commented Oct 6, 2017

kumavis commented Oct 6, 2017 •

edited

Loading

kumavis commented Oct 10, 2017 •

edited

Loading

kumavis commented Oct 10, 2017 •

edited

Loading

kumavis commented Oct 11, 2017

kumavis commented Oct 11, 2017 •

edited

Loading

kumavis commented Oct 12, 2017

ghost commented Oct 23, 2017

ghost commented Oct 23, 2017 •

edited by ghost

Loading

ghost commented Oct 24, 2017 •

edited by ghost

Loading

jwasinger commented Oct 24, 2017

dryajov commented Oct 24, 2017

AFDudley commented Dec 5, 2017

ghost commented Dec 5, 2017 •

edited by ghost

Loading

kumavis commented Feb 10, 2018

ghost commented Feb 20, 2018

ghost commented Feb 21, 2018

ghost commented Feb 22, 2018

Roadmap #1

Roadmap #1

Comments

kumavis commented Jul 4, 2017 • edited by ghost Loading

CLIENT

BEACONS

BUCKETS

OTHER

indexing / lookup

messaging

testing

monitoring

products and devices

ghost commented Jul 4, 2017 • edited by ghost Loading

danfinlay commented Jul 4, 2017

kumavis commented Aug 17, 2017

ghost commented Sep 4, 2017 • edited by ghost Loading

kumavis commented Sep 5, 2017

kumavis commented Sep 5, 2017

ghost commented Sep 6, 2017 • edited by ghost Loading

kumavis commented Sep 6, 2017

ghost commented Sep 7, 2017

kumavis commented Oct 4, 2017 • edited Loading

daviddias commented Oct 6, 2017

kumavis commented Oct 6, 2017 • edited Loading

kumavis commented Oct 10, 2017 • edited Loading

kumavis commented Oct 10, 2017 • edited Loading

kumavis commented Oct 11, 2017

kumavis commented Oct 11, 2017 • edited Loading

kumavis commented Oct 12, 2017

ghost commented Oct 23, 2017

ghost commented Oct 23, 2017 • edited by ghost Loading

devp2p -> libp2p bridge in Go Language (a.k.a. "Hot Importer")

ghost commented Oct 24, 2017 • edited by ghost Loading

jwasinger commented Oct 24, 2017

dryajov commented Oct 24, 2017

AFDudley commented Dec 5, 2017

ghost commented Dec 5, 2017 • edited by ghost Loading

kumavis commented Feb 10, 2018

ghost commented Feb 20, 2018

ghost commented Feb 21, 2018

ghost commented Feb 22, 2018

kumavis commented Jul 4, 2017 •

edited by ghost

Loading

ghost commented Jul 4, 2017 •

edited by ghost

Loading

ghost commented Sep 4, 2017 •

edited by ghost

Loading

ghost commented Sep 6, 2017 •

edited by ghost

Loading

kumavis commented Oct 4, 2017 •

edited

Loading

kumavis commented Oct 6, 2017 •

edited

Loading

kumavis commented Oct 10, 2017 •

edited

Loading

kumavis commented Oct 10, 2017 •

edited

Loading

kumavis commented Oct 11, 2017 •

edited

Loading

ghost commented Oct 23, 2017 •

edited by ghost

Loading

ghost commented Oct 24, 2017 •

edited by ghost

Loading

ghost commented Dec 5, 2017 •

edited by ghost

Loading