Bug: Output stops (Testnet, Block 3218408)

[gitmachtl]

Hi, please try the following command:

oura watch <path-to-node.socket> --magic testnet --since '47198121,0e896e691265cdd51ccf7d363797bef9c53e6d3a6ec9883ef9e7b362bae97d79'

the output stops at block 3218408, tx 04 ?

also hangs afterwards a few blocks later.

[gitmachtl]

hmm... i retried it and it scrolled thru. strange.

[scarmuega]

@gitmachtl did you update to the latest version by any chance?

We just fixed a bug that crashed the process when encountering a block with protocol update parameters inside. Sounds similar to the symptom you describe.

[gitmachtl]

on 0.3.8 right now, will try with 0.3.9

[gitmachtl]

no difference, i tried another point in the chain:

oura watch /home/cardano/db/node.socket --magic testnet --since '47253117,bf6407ee6e16c83e2a4f836408bd45387726bd7a0ee8d9dda58d3fdbba2a887d'

it hangs on the TX28 of block 3219824. same on node 1.33.0 and node 1.31.x

can you try it yourself?

BLOCK:3219824 █ TX:26 █ UTXO   { to: addr1vzzg0k0t2fam0rkdcu5ka7vjalmnssrjz4r8v6wr0jteaqqyx7xta, amount: 100000000 }
BLOCK:3219824 █ TX:26 █ UTXO   { to: addr1vzzg0k0t2fam0rkdcu5ka7vjalmnssrjz4r8v6wr0jteaqqyx7xta, amount: 100000000 }
BLOCK:3219824 █ TX:26 █ UTXO   { to: addr1vzzg0k0t2fam0rkdcu5ka7vjalmnssrjz4r8v6wr0jteaqqyx7xta, amount: 9429659445 }
BLOCK:3219824 █ TX:27 █ TX     { total_output: 5805133886, fee: 232733, hash: Some("b9ab72ac8e06c96367e426af7460b5e87a044b8ab126a68f0250921c51a86bc5"), ttl: None }
BLOCK:3219824 █ TX:27 █ STXI   { tx_id: 67be1ef881602552ec98d9326b6535451d71466b7eaba309f5bce26815373b60, index: 0 }
BLOCK:3219824 █ TX:27 █ STXI   { tx_id: 67be1ef881602552ec98d9326b6535451d71466b7eaba309f5bce26815373b60, index: 1 }
BLOCK:3219824 █ TX:27 █ STXI   { tx_id: 67be1ef881602552ec98d9326b6535451d71466b7eaba309f5bce26815373b60, index: 2 }
BLOCK:3219824 █ TX:27 █ STXI   { tx_id: 67be1ef881602552ec98d9326b6535451d71466b7eaba309f5bce26815373b60, index: 3 }
BLOCK:3219824 █ TX:27 █ STXI   { tx_id: 67be1ef881602552ec98d9326b6535451d71466b7eaba309f5bce26815373b60, index: 4 }
BLOCK:3219824 █ TX:27 █ STXI   { tx_id: 67be1ef881602552ec98d9326b6535451d71466b7eaba309f5bce26815373b60, index: 5 }
BLOCK:3219824 █ TX:27 █ STXI   { tx_id: 67be1ef881602552ec98d9326b6535451d71466b7eaba309f5bce26815373b60, index: 6 }
BLOCK:3219824 █ TX:27 █ STXI   { tx_id: 67be1ef881602552ec98d9326b6535451d71466b7eaba309f5bce26815373b60, index: 7 }
BLOCK:3219824 █ TX:27 █ STXI   { tx_id: 67be1ef881602552ec98d9326b6535451d71466b7eaba309f5bce26815373b60, index: 8 }
BLOCK:3219824 █ TX:27 █ UTXO   { to: addr1vzvcng0y7slrgcthgzursxzs675fpveqwjjh2wqustm2hjgtn5lmj, amount: 100000000 }
BLOCK:3219824 █ TX:27 █ UTXO   { to: addr1vzvcng0y7slrgcthgzursxzs675fpveqwjjh2wqustm2hjgtn5lmj, amount: 100000000 }
BLOCK:3219824 █ TX:27 █ UTXO   { to: addr1vzvcng0y7slrgcthgzursxzs675fpveqwjjh2wqustm2hjgtn5lmj, amount: 100000000 }
BLOCK:3219824 █ TX:27 █ UTXO   { to: addr1vzvcng0y7slrgcthgzursxzs675fpveqwjjh2wqustm2hjgtn5lmj, amount: 100000000 }
BLOCK:3219824 █ TX:27 █ UTXO   { to: addr1vzvcng0y7slrgcthgzursxzs675fpveqwjjh2wqustm2hjgtn5lmj, amount: 100000000 }
BLOCK:3219824 █ TX:27 █ UTXO   { to: addr1vzvcng0y7slrgcthgzursxzs675fpveqwjjh2wqustm2hjgtn5lmj, amount: 100000000 }
BLOCK:3219824 █ TX:27 █ UTXO   { to: addr1vzvcng0y7slrgcthgzursxzs675fpveqwjjh2wqustm2hjgtn5lmj, amount: 100000000 }
BLOCK:3219824 █ TX:27 █ UTXO   { to: addr1vzvcng0y7slrgcthgzursxzs675fpveqwjjh2wqustm2hjgtn5lmj, amount: 100000000 }
BLOCK:3219824 █ TX:27 █ UTXO   { to: addr1vzvcng0y7slrgcthgzursxzs675fpveqwjjh2wqustm2hjgtn5lmj, amount: 5005133886 }
BLOCK:3219824 █ TX:28 █ TX     { total_output: 162880553442, fee: 1461479, hash: Some("b4494dbcb69cccdee43a81417024c06b266cc95fdf15f2bc5b9796ba05108df0"), ttl: Some(47256789) }
BLOCK:3219824 █ TX:28 █ STXI   { tx_id: 6d87f266f6e6feec0e7a446ad3fe0222ada9708d100bffad31c7eba211a1e960, index: 7 }
BLOCK:3219824 █ TX:28 █ STXI   { tx_id: 9e220e226e6135019e7507d4e70e8837a4ab20f6bb621eb50fd094d76d03d2ef, index: 0 }
BLOCK:3219824 █ TX:28 █ STXI   { tx_id: ce64ed75eee364f86ef8f6c071e8b936ef2301c7945ae588a5a8285710bdd2ba, index: 0 }
BLOCK:3219824 █ TX:28 █ STXI   { tx_id: e29a6c0b14b46513c00b36ddce6a6a4d6f650de29c231a718d3cce7a7266844c, index: 0 }
BLOCK:3219824 █ TX:28 █ STXI   { tx_id: e4500b177ad8b889d3f6368c1a0be5a5b5a15b446fea8548c96266428f747993, index: 0 }
BLOCK:3219824 █ TX:28 █ COLLAT { tx_id: 16bdab3472c5fa09f0093c6b5658a47acb4075e28f7654d3f70370f8cc05ff73, index: 4 }
BLOCK:3219824 █ TX:28 █ UTXO   { to: addr1wp9m8xkpt2tmy7madqldspgzgug8f2p3pwhz589cq75685syrhrxh, amount: 162866514921 }
BLOCK:3219824 █ TX:28 █ ASSET  { policy: 57fca08abbaddee36da742a839f7d83a7e1d2419f1507fcbf3916522, asset: 43484f43, amount: 6088411877 }
BLOCK:3219824 █ TX:28 █ ASSET  { policy: d311d3488cc4fef19d05634adce8534977a3bc6fc18136ad65df1d4f, asset: 7020dd, amount: 1 }
BLOCK:3219824 █ TX:28 █ UTXO   { to: addr1wpfzvzpa046hkfy65mp4ez6vgjunmytzg0ye0ds7mm26v0g9y9l24, amount: 6038521 }
BLOCK:3219824 █ TX:28 █ UTXO   { to: addr1qputcd04j2snz53wa4vpk6fkdlgue5yrf7dtwakmtpyhngk9azkd7qvw06hyja955t5l8g4q4wrsv33kdulelq2nxnaq7jyuea, amount: 2000000 }
BLOCK:3219824 █ TX:28 █ ASSET  { policy: 57fca08abbaddee36da742a839f7d83a7e1d2419f1507fcbf3916522, asset: 43484f43, amount: 277911 }
BLOCK:3219824 █ TX:28 █ ASSET  { policy: d311d3488cc4fef19d05634adce8534977a3bc6fc18136ad65df1d4f, asset: 6c7120dd, amount: 7346507 }
BLOCK:3219824 █ TX:28 █ UTXO   { to: addr1qz73jcfq73r862hvuehetla6hmxzha36jp8qmjkf0vm7pafgs0wd4xrxnhzdzuqqxw9696e6awuzka96aqk379zvcfrqtmjt39, amount: 2000000 }
BLOCK:3219824 █ TX:28 █ ASSET  { policy: 57fca08abbaddee36da742a839f7d83a7e1d2419f1507fcbf3916522, asset: 43484f43, amount: 219403 }
BLOCK:3219824 █ TX:28 █ ASSET  { policy: d311d3488cc4fef19d05634adce8534977a3bc6fc18136ad65df1d4f, asset: 6c7120dd, amount: 5799874 }
BLOCK:3219824 █ TX:28 █ UTXO   { to: addr1qrj4t5c7aw0snts32eaepfcmtja874ycjcs36k303jfs0ztkpxzxjs9ww8el2zq3dmmaf3zzcz4n2g205pyhvwspl3qsj90snx, amount: 2000000 }
BLOCK:3219824 █ TX:28 █ ASSET  { policy: 57fca08abbaddee36da742a839f7d83a7e1d2419f1507fcbf3916522, asset: 43484f43, amount: 182836 }
BLOCK:3219824 █ TX:28 █ ASSET  { policy: d311d3488cc4fef19d05634adce8534977a3bc6fc18136ad65df1d4f, asset: 6c7120dd, amount: 4833228 }
BLOCK:3219824 █ TX:28 █ UTXO   { to: addr1qp9swf7hvkm0ph368syhy3rymd0crkfppysj2hwlv8uyjcw83ttze2xw5hux8nx64s4xktxtwdtpwu0sp9tcdxs2cw3stnlyxp, amount: 2000000 }
BLOCK:3219824 █ TX:28 █ ASSET  { policy: 4fc16c94d066e949e771c5581235f8090ad6aaffaf373a426445ca51, asset: 73636f6f70209a0a, amount: 1 }
BLOCK:3219824 █ TX:28 █ MINT   { policy: d311d3488cc4fef19d05634adce8534977a3bc6fc18136ad65df1d4f, asset: 6c7120dd, quantity: 17979609 }

[gitmachtl]

thats the last transaction https://testnet.cardanoscan.io/transaction/b4494dbcb69cccdee43a81417024c06b266cc95fdf15f2bc5b9796ba05108df0?tab=utxo

[scarmuega]

I had to restart my testnet node, I will attempt to reproduce your exact scenario once it finishes syncing.

In the meantime, I tried using Oura against a testnet relay and I managed to pass the troublesome block. Could you try the following command on your side?

oura watch relays-new.cardano-testnet.iohkdev.io:3001 \
  --magic testnet \
  --bearer tcp \
  --since 47253117,bf6407ee6e16c83e2a4f836408bd45387726bd7a0ee8d9dda58d3fdbba2a887d

[gitmachtl]

yes, scrolled thru. hmm... maybe unix vs. tcp bearer issue. will try with another node.

[gitmachtl]

BUT, there is no block 3219825!?
It jumps from 3219824 to 3219826

[scarmuega]

Very weird, but that narrows down the issue. I'll run a debug session to check the decoding of that block.

[gitmachtl]

ok, i think it has to do with the unix bearer. when i try the following on my local node:

./oura watch 127.0.0.1:4001 --magic testnet --bearer tcp --since 47253117,bf6407ee6e16c83e2a4f836408bd45387726bd7a0ee8d9dda58d3fdbba2a887d

it scrolls thru but jumps from block 3219824 to 3219826.

when i try the same using the node.socket like:

./oura watch /home/cardano/db/node.socket --magic testnet --bearer unix --since 47253117,bf6407ee6e16c83e2a4f836408bd45387726bd7a0ee8d9dda58d3fdbba2a887d

it hangs on the last tx of block 3219824 and never jumps to 3219826.

so there are two things:

• why is it jumping block 3219825 ?
• why isn't it proceeding with the unix bearer ?

[scarmuega]

I've managed to confirm that there a crash when trying to decode that particular block. I'll look into fixing that first.

[scarmuega]

for posterity, seems that block 3219825 includes a Plutus script encoded as a cbor array rather than the usual cbor bytes structure. Can't find a reference in the CDDL of that being allowed.

[gitmachtl]

oh thats interesting

[scarmuega]

@gitmachtl this should be fixed on the recently released version 0.3.10. Feel free to re-open the issue if you encounter any trouble.

[gitmachtl]

yes, just tested it. it works!