Skip to content

Instantly share code, notes, and snippets.

@jcstein

jcstein/light-node_quicknode-test-14-feb

Created February 14, 2025 21:29
Show Gist options
  • Save jcstein/cd0adf22c0bc6e14de88638c96209884 to your computer and use it in GitHub Desktop.
Save jcstein/cd0adf22c0bc6e14de88638c96209884 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
light-node_quicknode-test-14-feb
2025-02-14T16:27:19.517-0500 INFO header/store store/store.go:367 new head {"height": 4692139, "hash": "1EB2B23ADD5542D71FA9FECDEABCB8C88020403A667342CD9BF5544F3272AEAE"}
2025-02-14T16:27:19.517-0500 INFO header/store store/store.go:367 new head {"height": 4692140, "hash": "57742216E6A368FD021E65C23EE475BAECACB65EE990C80C208C6DA1922AFF68"}
2025-02-14T16:27:19.517-0500 INFO header/sync sync/sync.go:234 finished syncing headers {"from": 4692134, "to": 4692140, "elapsed time": 0.394386}
2025-02-14T16:27:20.554-0500 INFO canonical-log swarm/swarm_dial.go:620 CANONICAL_PEER_STATUS: peer=12D3KooWK5GcxBuPLSiRLgzUr2a6SXgW3tC85SU5b52JhxwD3yr3 addr=/ip4/217.28.49.93/udp/2121/quic-v1 sample_rate=100 connection_status="established" dir="outbound"
2025-02-14T16:27:23.094-0500 INFO basichost basic/natmgr.go:112 DiscoverNAT error:no NAT found
2025-02-14T16:27:24.106-0500 INFO header/store store/store.go:367 new head {"height": 4692141, "hash": "F3E06DF128B523C3765BC37117891558B6303FDE955505AA30EC078C2F8AB98B"}
2025-02-14T16:27:24.161-0500 INFO das das/worker.go:164 sampled header {"type": "recent", "height": 4692141, "hash": "F3E06DF128B523C3765BC37117891558B6303FDE955505AA30EC078C2F8AB98B", "EDS square width": 64, "data root": "4CBAF3FCA7E9A9B855671F0CEE6FBF7AA7109B6B10A7B5734B617133C5944EAC", "finished (s)": 0.054278833}
2025-02-14T16:27:24.359-0500 INFO das das/worker.go:95 finished sampling headers "type": "catchup", "from": 4692134, "to": 4692141, "errors": 0, "# of headers skipped as outside of sampling window": 0, "finished (s)": 0.252405459}
2025-02-14T16:27:29.078-0500 INFO header/store store/store.go:367 new head {"height": 4692142, "hash": "424B5433A8BA43D995EF1A548884232050BDA90291496980998031808111268F"}
2025-02-14T16:27:29.448-0500 INFO das das/worker.go:164 sampled header {"type": "recent", "height": 4692142, "hash": "424B5433A8BA43D995EF1A548884232050BDA90291496980998031808111268F", "EDS square width": 8, "data root": "7E628A94F662EC6BBCF41CC66DB468EA041619C51B9BF1BC0BD21BEAAC7330BF", "finished (s)": 0.370082667}
2025-02-14T16:27:34.504-0500 INFO header/store store/store.go:367 new head {"height": 4692143, "hash": "9F048925E5516D8CB8853389CC016BB2ED9E76E30BE5EE5E425346B7E62AFCF3"}
2025-02-14T16:27:35.573-0500 INFO das das/worker.go:164 sampled header {"type": "recent", "height": 4692143, "hash": "9F048925E5516D8CB8853389CC016BB2ED9E76E30BE5EE5E425346B7E62AFCF3", "EDS square width": 128, "data root": "413FE213DB4ECE21F1300247B2B531E5410B528E551C6EFA45D8258FA7E1D5EF", "finished (s)": 1.069038875}
2025-02-14T16:27:39.597-0500 INFO header/store store/store.go:367 new head {"height": 4692144, "hash": "511AF0ED8018F023EFDB8818F3324569531A89B029B56D87C53113DE53EA30CD"}
2025-02-14T16:27:40.110-0500 INFO das das/worker.go:164 sampled header {"type": "recent", "height": 4692144, "hash": "511AF0ED8018F023EFDB8818F3324569531A89B029B56D87C53113DE53EA30CD", "EDS square width": 8, "data root": "6F172564FA0F55091A529FB160B7ACCEC71439115C4E3D761A9B05D4F99411C9", "finished (s)": 0.512269125}
2025-02-14T16:27:40.493-0500 INFO blob blob/service.go:340 requesting blob {"height": 4692143, "namespace": "0000000000000000000000000000000000000000717569636b6e6f6465"}
2025-02-14T16:27:41.387-0500 INFO blob blob/service.go:283 retrieved blobs {"height": 4692143, "total": 9}
2025-02-14T16:27:44.330-0500 INFO header/store store/store.go:367 new head {"height": 4692145, "hash": "794F432DB300EA1F1D5F8FFE7AE0BC28715070CA4F979B946937FEB605FAF3CF"}
2025-02-14T16:27:45.277-0500 WARN rpc [email protected]/handler.go:474 error in RPC call to 'blob.Submit': transaction with hash EE87D4EDC3A8C5074FB73F857D9ABC4F058B419978414AF398EAC3BA5F064226 not found; it was likely rejected
2025-02-14T16:27:45.500-0500 INFO das das/worker.go:164 sampled header {"type": "recent", "height": 4692145, "hash": "794F432DB300EA1F1D5F8FFE7AE0BC28715070CA4F979B946937FEB605FAF3CF", "EDS square width": 64, "data root": "AAAA536ADD5D5A36E9DDF4FF535AE958D8E89F6BC9510B6B076B58734E8F357E", "finished (s)": 1.170158291}
2025-02-14T16:27:50.030-0500 INFO header/store store/store.go:367 new head {"height": 4692146, "hash": "3705C754FF0EFD4007CCE7F18180995821604DE722A1EAB2F4782FA36CA0E10D"}
2025-02-14T16:27:51.290-0500 INFO das das/worker.go:164 sampled header {"type": "recent", "height": 4692146, "hash": "3705C754FF0EFD4007CCE7F18180995821604DE722A1EAB2F4782FA36CA0E10D", "EDS square width": 128, "data root": "197478A521F7AC5DD94B456A9015089A26D7D644C3A0C33C8DDEEEF11BC9EE0D", "finished (s)": 1.260379958}
2025-02-14T16:27:52.015-0500 WARN rpc [email protected]/handler.go:474 error in RPC call to 'blob.Submit': transaction with hash 8A29F8937DED5B2CC93AD56A88DB9B5A618A8CE61D6B618E8AB6892AA3645B9B not found; it was likely rejected
2025-02-14T16:27:55.692-0500 INFO header/store store/store.go:367 new head {"height": 4692147, "hash": "D04F847C1144DE505D78D6DB085EE3E995EB19B367D0752CFAE07B8B3BF50676"}
2025-02-14T16:27:57.557-0500 INFO das das/worker.go:164 sampled header {"type": "recent", "height": 4692147, "hash": "D04F847C1144DE505D78D6DB085EE3E995EB19B367D0752CFAE07B8B3BF50676", "EDS square width": 128, "data root": "7613521BDA72F8CB56087FEEB469E33459B37446B814ADD8C3BBEF0C48D90B1B", "finished (s)": 1.864837583}
2025-02-14T16:27:58.776-0500 WARN rpc [email protected]/handler.go:474 error in RPC call to 'blob.Submit': transaction with hash B734ECF9A2608658A5663229083DDC8385CFD0151F48401DD2EC1A135E33E8AC not found; it was likely rejected
2025-02-14T16:28:01.448-0500 INFO header/store store/store.go:367 new head {"height": 4692148, "hash": "9E36B50DD5C2497AB047022946BB41A0FBE4D8054EF57C88726736456196A5B9"}
2025-02-14T16:28:03.095-0500 INFO das das/worker.go:164 sampled header {"type": "recent", "height": 4692148, "hash": "9E36B50DD5C2497AB047022946BB41A0FBE4D8054EF57C88726736456196A5B9", "EDS square width": 128, "data root": "B84A12FE01603B512418A83BC92751F9186B2F7872584FD07DD084E7F7CC9164", "finished (s)": 1.647572417}
@jcstein
Copy link
Author

jcstein commented Feb 14, 2025

logs from dummy_rollup which match light node logs

cargo run -- quicknode 9 197278
    Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.30s
     Running `target/debug/dummy_rollup quicknode 9 197278`
Note: CELESTIA_NODE_AUTH_TOKEN not set. Make sure to either:
  1. Set CELESTIA_NODE_AUTH_TOKEN environment variable, or
  2. Use --rpc.skip-auth when starting your Celestia node
Starting continuous blob submission. Press Ctrl+C to stop.
Submitting batches of 9 blobs, each 197278 bytes, with namespace 'quicknode'
Batch submitted successfully!
Result height: 4692143
Checking height 4692143...
Found 9 blobs at height 4692143
✅ Blob 0 verified successfully
✅ Blob 1 verified successfully
✅ Blob 2 verified successfully
✅ Blob 3 verified successfully
✅ Blob 4 verified successfully
✅ Blob 5 verified successfully
✅ Blob 6 verified successfully
✅ Blob 7 verified successfully
✅ Blob 8 verified successfully
Error submitting batch: Call(ErrorObject { code: ServerError(1), message: "transaction with hash EE87D4EDC3A8C5074FB73F857D9ABC4F058B419978414AF398EAC3BA5F064226 not found; it was likely rejected", data: None })
Error submitting batch: Call(ErrorObject { code: ServerError(1), message: "transaction with hash 8A29F8937DED5B2CC93AD56A88DB9B5A618A8CE61D6B618E8AB6892AA3645B9B not found; it was likely rejected", data: None })
Error submitting batch: Call(ErrorObject { code: ServerError(1), message: "transaction with hash B734ECF9A2608658A5663229083DDC8385CFD0151F48401DD2EC1A135E33E8AC not found; it was likely rejected", data: None })
^C

@jcstein
Copy link
Author

jcstein commented Feb 14, 2025

These transactions all exist:
https://mocha.celenium.io/tx/EE87D4EDC3A8C5074FB73F857D9ABC4F058B419978414AF398EAC3BA5F064226
https://mocha.celenium.io/tx/B734ECF9A2608658A5663229083DDC8385CFD0151F48401DD2EC1A135E33E8AC
https://mocha.celenium.io/tx/8A29F8937DED5B2CC93AD56A88DB9B5A618A8CE61D6B618E8AB6892AA3645B9B

@jcstein
Copy link
Author

jcstein commented Feb 14, 2025 •
edited
Loading

How to reproduce:

  1. run a (synced) light node with v0.21.5 using a quicknode endpoint
celestia light start \
    --core.ip <your-quicknode-endpoint>.quiknode.pro \
    --core.tls \
    --core.xtoken.path /Users/js/ \
    --core.port 9090 --p2p.network mocha --rpc.skip-auth
  1. use this version of dummy rollup (https://github.com/jcstein/dummy_rollup/releases/tag/v0.3.0_v0.10.0-celestia-types_v0.9.0-celestia-rpc) and run this command which will send batches of 9 blobs at a time in a PFB each of 197278 bytes
cargo run -- quicknode 9 197278

1a. running light node to test with POPS rpc:

celestia light start \
    --core.ip rpc-mocha.pops.one \
    --core.port 9090 --p2p.network mocha --rpc.skip-auth

@jcstein
Copy link
Author

jcstein commented Feb 14, 2025

Trying to reproduce the error with POPS is unsuccessful, because all blobs are correctly found after submission:

  1. see logs for which indicate successful retrieval:
2025-02-14T16:36:01.256-0500	INFO	blob	blob/service.go:340	requesting blob	{"height": 4692242, "namespace": "0000000000000000000000000000000000000000717569636b6e6f6465"}
2025-02-14T16:36:02.646-0500	INFO	blob	blob/service.go:283	retrieved blobs	{"height": 4692242, "total": 9}

2025-02-14T16:35:43.544-0500	INFO	header/store	store/store.go:367	new head	{"height": 4692240, "hash": "5E3F04C89A11608E8462B72139A7CDBF272605D02E94DA1419E1A1A9C936704D"}
2025-02-14T16:35:43.721-0500	INFO	blob	blob/service.go:283	retrieved blobs	{"height": 4692238, "total": 9}
2025-02-14T16:35:44.670-0500	INFO	das	das/worker.go:164	sampled header	{"type": "recent", "height": 4692240, "hash": "5E3F04C89A11608E8462B72139A7CDBF272605D02E94DA1419E1A1A9C936704D", "EDS square width": 64, "data root": "8A32835F6D6768BAD41F09E10C71A54B445669CD51D62BD079B8C1B5717B4E7C", "finished (s)": 1.125929}
2025-02-14T16:35:46.263-0500	INFO	badger4	[email protected]/value.go:1035	Found value log max discard fid: 1 discard: 3299457

2025-02-14T16:35:46.263-0500	INFO	badger4	[email protected]/value.go:184	Rewriting fid: 1
2025-02-14T16:35:46.291-0500	INFO	badger4	[email protected]/value.go:336	Processed 296 entries in 1 loops
2025-02-14T16:35:46.291-0500	INFO	badger4	[email protected]/value.go:337	Total entries: 3402. Moved: 296
2025-02-14T16:35:46.291-0500	INFO	badger4	[email protected]/value.go:338	Removing fid: 1
2025-02-14T16:35:48.791-0500	INFO	header/store	store/store.go:367	new head	{"height": 4692241, "hash": "91C3B77DBB4AB770C1A7BCCEBE0B315350434CD83687D5BED357D9AC610F2C56"}
2025-02-14T16:35:49.912-0500	INFO	das	das/worker.go:164	sampled header	{"type": "recent", "height": 4692241, "hash": "91C3B77DBB4AB770C1A7BCCEBE0B315350434CD83687D5BED357D9AC610F2C56", "EDS square width": 8, "data root": "468DA68748D5E452AB12B0A8188C7D094AAB7A7FEC955B568141B6290F824905", "finished (s)": 1.120843042}
2025-02-14T16:35:54.088-0500	INFO	header/store	store/store.go:367	new head	{"height": 4692242, "hash": "2D17746095D2108B9FBD8564A6A1636D955BD873D287AB449DA0EF01449CA772"}
2025-02-14T16:35:55.101-0500	INFO	share/discovery	discovery/discovery.go:333	discovered wanted peers	{"topic": "/archival/v0.1.0", "amount": 5}
2025-02-14T16:35:55.959-0500	INFO	das	das/worker.go:164	sampled header	{"type": "recent", "height": 4692242, "hash": "2D17746095D2108B9FBD8564A6A1636D955BD873D287AB449DA0EF01449CA772", "EDS square width": 128, "data root": "966314905C7741F3CFD1C1F63A8F14B138C9F1F23F693C467D74BF96224CBDCB", "finished (s)": 1.870992084}
2025-02-14T16:35:58.884-0500	INFO	header/store	store/store.go:367	new head	{"height": 4692243, "hash": "1FB9DC521672D6426292045AB987E756A41FACAC7B49026E489E2A5C4519D015"}
2025-02-14T16:35:59.628-0500	INFO	das	das/worker.go:164	sampled header	{"type": "recent", "height": 4692243, "hash": "1FB9DC521672D6426292045AB987E756A41FACAC7B49026E489E2A5C4519D015", "EDS square width": 64, "data root": "23B2098078DC7BFE3FEC8265583554BEC19868548EEC8223CAA256DA35D2E02F", "finished (s)": 0.743110833}
2025-02-14T16:36:01.256-0500	INFO	blob	blob/service.go:340	requesting blob	{"height": 4692242, "namespace": "0000000000000000000000000000000000000000717569636b6e6f6465"}
2025-02-14T16:36:02.646-0500	INFO	blob	blob/service.go:283	retrieved blobs	{"height": 4692242, "total": 9}
2025-02-14T16:36:04.093-0500	INFO	header/store	store/store.go:367	new head	{"height": 4692244, "hash": "767C48C562C9CEB2FBAE0C049C5B2051F550360048B7DC657685F0660B320A2C"}
2025-02-14T16:36:04.559-0500	INFO	das	das/worker.go:164	sampled header	{"type": "recent", "height": 4692244, "hash": "767C48C562C9CEB2FBAE0C049C5B2051F550360048B7DC657685F0660B320A2C", "EDS square width": 8, "data root": "8D695B71774473E1956D41C523BEBC9FFD90BD5129A20C8FC7B77C89F03DBCD1", "finished (s)": 0.466788083}
2025-02-14T16:36:05.983-0500	INFO	share/discovery	discovery/discovery.go:333	discovered wanted peers	{"topic": "/full/v0.1.0", "amount": 5}
2025-02-14T16:36:08.992-0500	INFO	header/store	store/store.go:367	new head	{"height": 4692245, "hash": "101F06091CFE6A0DCACCA4E0D6468629201574C19FCF785CF3EAE31146FB5B1C"}
2025-02-14T16:36:10.647-0500	INFO	das	das/worker.go:164	sampled header	{"type": "recent", "height": 4692245, "hash": "101F06091CFE6A0DCACCA4E0D6468629201574C19FCF785CF3EAE31146FB5B1C", "EDS square width": 16, "data root": "F654DF762EEF8B52D8C0927380B19172326B9E069C6464FCB476CB8583E4AA59", "finished (s)": 1.65460675}
2025-02-14T16:36:14.613-0500	INFO	header/store	store/store.go:367	new head	{"height": 4692246, "hash": "575A9ABFE04C3C05CE9C31AA2CFC56A33F434A48904F6964E8D903698FC7EC3B"}
2025-02-14T16:36:16.768-0500	INFO	das	das/worker.go:164	sampled header	{"type": "recent", "height": 4692246, "hash": "575A9ABFE04C3C05CE9C31AA2CFC56A33F434A48904F6964E8D903698FC7EC3B", "EDS square width": 128, "data root": "EF270EBC3C453F0BB81102E2E76A9626CCD051486520B725C9CB9A61FBF85C8E", "finished (s)": 2.154233958}
2025-02-14T16:36:19.807-0500	INFO	header/store	store/store.go:367	new head	{"height": 4692247, "hash": "39E119787B2C38D4A2B3937C23F4FD76B87E6D8CFC7B13BCCDACE86B95653E0E"}
2025-02-14T16:36:20.407-0500	INFO	blob	blob/service.go:340	requesting blob	{"height": 4692246, "namespace": "0000000000000000000000000000000000000000717569636b6e6f6465"}
2025-02-14T16:36:21.041-0500	INFO	das	das/worker.go:164	sampled header	{"type": "recent", "height": 4692247, "hash": "39E119787B2C38D4A2B3937C23F4FD76B87E6D8CFC7B13BCCDACE86B95653E0E", "EDS square width": 16, "data root": "9F2A1705FE9BD44B71D0E4F20FE9090E4A6E208906BB1594D8C78C5258EB5096", "finished (s)": 1.234179667}
2025-02-14T16:36:22.058-0500	INFO	blob	blob/service.go:283	retrieved blobs	{"height": 4692246, "total": 9}
2025-02-14T16:36:24.883-0500	INFO	header/store	store/store.go:367	new head	{"height": 4692248, "hash": "319D79108B8537DA26D401F40EA6AC3CEEEAA8C4F8F9AA23D71F4CA243E9BF1C"}
2025-02-14T16:36:26.029-0500	INFO	das	das/worker.go:164	sampled header	{"type": "recent", "height": 4692248, "hash": "319D79108B8537DA26D401F40EA6AC3CEEEAA8C4F8F9AA23D71F4CA243E9BF1C", "EDS square width": 16, "data root": "792C9077BC6308FC909D813767B47919657870A495C63D9EB1E4E784D1966873", "finished (s)": 1.145924333}

and same logs in dummy_rollup

cargo run -- quicknode 9 197278
    Finished `dev` profile [unoptimized + debuginfo] target(s) in 0.30s
     Running `target/debug/dummy_rollup quicknode 9 197278`
Note: CELESTIA_NODE_AUTH_TOKEN not set. Make sure to either:
  1. Set CELESTIA_NODE_AUTH_TOKEN environment variable, or
  2. Use --rpc.skip-auth when starting your Celestia node
Starting continuous blob submission. Press Ctrl+C to stop.
Submitting batches of 9 blobs, each 197278 bytes, with namespace 'quicknode'
Batch submitted successfully!
Result height: 4692238
Checking height 4692238...
Found 9 blobs at height 4692238
✅ Blob 0 verified successfully
✅ Blob 1 verified successfully
✅ Blob 2 verified successfully
✅ Blob 3 verified successfully
✅ Blob 4 verified successfully
✅ Blob 5 verified successfully
✅ Blob 6 verified successfully
✅ Blob 7 verified successfully
✅ Blob 8 verified successfully
Batch submitted successfully!
Result height: 4692242
Checking height 4692242...
Found 9 blobs at height 4692242
✅ Blob 0 verified successfully
✅ Blob 1 verified successfully
✅ Blob 2 verified successfully
✅ Blob 3 verified successfully
✅ Blob 4 verified successfully
✅ Blob 5 verified successfully
✅ Blob 6 verified successfully
✅ Blob 7 verified successfully
✅ Blob 8 verified successfully
Batch submitted successfully!
Result height: 4692246
Checking height 4692246...
Found 9 blobs at height 4692246
✅ Blob 0 verified successfully
✅ Blob 1 verified successfully
✅ Blob 2 verified successfully
✅ Blob 3 verified successfully
✅ Blob 4 verified successfully
✅ Blob 5 verified successfully
✅ Blob 6 verified successfully
✅ Blob 7 verified successfully
✅ Blob 8 verified successfully
Batch submitted successfully!
Result height: 4692249

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment