Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Oasis Node not working after upgrade to v2.7.0 #534

Open
mayank-daga opened this issue Jul 30, 2024 · 17 comments
Open

Oasis Node not working after upgrade to v2.7.0 #534

mayank-daga opened this issue Jul 30, 2024 · 17 comments

Comments

@mayank-daga
Copy link

Hi i am getting following logs after upgrading to v2.7.0:

oasis-rosetta | ok: run: node: (pid 10) 0s
oasis-rosetta | {"caller":"node.go:451","level":"info","mode":"client","module":"oasis-node","msg":"Starting oasis-node","ts":"2024-07-29T13:14:23.665671707Z","version":"23.0.7-git510099930"}
oasis-rosetta | level=debug ts=2024-07-29T13:14:23.800124334Z caller=oasis.go:136 module=oasis msg="Establishing connection" grpc_addr=unix:/data/internal.sock
oasis-rosetta | level=error ts=2024-07-29T13:14:23.80118495Z caller=grpc.go:242 module=grpc/client msg="request failed" method=/oasis-core.NodeController/GetStatus req_seq=1 rsp="unsupported value type" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused""
oasis-rosetta | level=debug ts=2024-07-29T13:14:23.801251651Z caller=oasis.go:149 module=oasis msg="Failed to get status from node" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused""
oasis-rosetta | level=error ts=2024-07-29T13:14:23.801263652Z caller=main.go:210 module=oasis-rosetta-gateway msg="failed to obtain chain ID from Oasis node" err="failed to get status from node: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused""
oasis-rosetta | ok: run: node: (pid 10) 1s
oasis-rosetta | level=debug ts=2024-07-29T13:14:24.808221535Z caller=oasis.go:136 module=oasis msg="Establishing connection" grpc_addr=unix:/data/internal.sock
oasis-rosetta | level=error ts=2024-07-29T13:14:24.808822745Z caller=grpc.go:242 module=grpc/client msg="request failed" method=/oasis-core.NodeController/GetStatus req_seq=1 rsp="unsupported value type" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused""
oasis-rosetta | level=debug ts=2024-07-29T13:14:24.808864345Z caller=oasis.go:149 module=oasis msg="Failed to get status from node" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused""
oasis-rosetta | level=error ts=2024-07-29T13:14:24.808874145Z caller=main.go:210 module=oasis-rosetta-gateway msg="failed to obtain chain ID from Oasis node" err="failed to get status from node: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused""
oasis-rosetta | ok: run: node: (pid 10) 2s
oasis-rosetta | level=debug ts=2024-07-29T13:14:25.815408523Z caller=oasis.go:136 module=oasis msg="Establishing connection" grpc_addr=unix:/data/internal.sock
oasis-rosetta | level=error ts=2024-07-29T13:14:25.816005832Z caller=grpc.go:242 module=grpc/client msg="request failed" method=/oasis-core.NodeController/GetStatus req_seq=1 rsp="unsupported value type" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused""
oasis-rosetta | level=debug ts=2024-07-29T13:14:25.816046732Z caller=oasis.go:149 module=oasis msg="Failed to get status from node" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused""
@peternose
Copy link

Based on the error message, it seems that decoding the Status response from the GetStatus gRPC function failed because your node is running on version 23.0.7-git510099930.

Recently, we did a breaking upgrade to 24.0 and latter to 24.1. Did you upgrade your oasis node to the latest version 24.1?

@mayank-daga
Copy link
Author

Hi @peternose

we are getting same logs with newest image as well:

ok: run: node: (pid 9) 0s,
level=debug ts=2024-08-01T09:24:29.323551788Z caller=oasis.go:136 module=oasis msg="Establishing connection" grpc_addr=unix:/data/internal.sock,
level=error ts=2024-08-01T09:24:29.324201196Z caller=grpc.go:242 module=grpc/client msg="request failed" method=/oasis-core.NodeController/GetStatus req_seq=1 rsp="unsupported value type" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
level=debug ts=2024-08-01T09:24:29.324231096Z caller=oasis.go:149 module=oasis msg="Failed to get status from node" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
level=error ts=2024-08-01T09:24:29.324239896Z caller=main.go:210 module=oasis-rosetta-gateway msg="failed to obtain chain ID from Oasis node" err="failed to get status from node: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
{"caller":"node.go:457","level":"info","mode":"client","module":"oasis-node","msg":"Starting oasis-node","ts":"2024-08-01T09:24:29.329123054Z","version":"24.0-gitfb49717f3"},
ok: run: node: (pid 9) 1s,
level=debug ts=2024-08-01T09:24:30.331955078Z caller=oasis.go:136 module=oasis msg="Establishing connection" grpc_addr=unix:/data/internal.sock,
level=error ts=2024-08-01T09:24:30.332491184Z caller=grpc.go:242 module=grpc/client msg="request failed" method=/oasis-core.NodeController/GetStatus req_seq=1 rsp="unsupported value type" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
level=debug ts=2024-08-01T09:24:30.332526285Z caller=oasis.go:149 module=oasis msg="Failed to get status from node" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
level=error ts=2024-08-01T09:24:30.332536185Z caller=main.go:210 module=oasis-rosetta-gateway msg="failed to obtain chain ID from Oasis node" err="failed to get status from node: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
ok: run: node: (pid 9) 2s,
level=debug ts=2024-08-01T09:24:31.340739473Z caller=oasis.go:136 module=oasis msg="Establishing connection" grpc_addr=unix:/data/internal.sock,
level=error ts=2024-08-01T09:24:31.34131288Z caller=grpc.go:242 module=grpc/client msg="request failed" method=/oasis-core.NodeController/GetStatus req_seq=1 rsp="unsupported value type" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
level=debug ts=2024-08-01T09:24:31.34134428Z caller=oasis.go:149 module=oasis msg="Failed to get status from node" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
level=error ts=2024-08-01T09:24:31.34136648Z caller=main.go:210 module=oasis-rosetta-gateway msg="failed to obtain chain ID from Oasis node" err="failed to get status from node: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
ok: run: node: (pid 9) 3s,
level=debug ts=2024-08-01T09:24:32.349094963Z caller=oasis.go:136 module=oasis msg="Establishing connection" grpc_addr=unix:/data/internal.sock,
level=error ts=2024-08-01T09:24:32.349858772Z caller=grpc.go:242 module=grpc/client msg="request failed" method=/oasis-core.NodeController/GetStatus req_seq=1 rsp="unsupported value type" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
level=debug ts=2024-08-01T09:24:32.349913173Z caller=oasis.go:149 module=oasis msg="Failed to get status from node" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
level=error ts=2024-08-01T09:24:32.349927673Z caller=main.go:210 module=oasis-rosetta-gateway msg="failed to obtain chain ID from Oasis node" err="failed to get status from node: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
{"caller":"init.go:91","err":"signature/signer/file: invalid PEM file permissions 700 on /data/identity.pem","level":"error","module":"oasis-node","msg":"failed to load/generate identity","ts":"2024-08-01T09:24:32.845111013Z"},
{"caller":"node.go:457","level":"info","mode":"client","module":"oasis-node","msg":"Starting oasis-node","ts":"2024-08-01T09:24:32.87375195Z","version":"24.0-gitfb49717f3"},
ok: run: node: (pid 53) 1s,
level=debug ts=2024-08-01T09:24:33.358322565Z caller=oasis.go:136 module=oasis msg="Establishing connection" grpc_addr=unix:/data/internal.sock,
level=error ts=2024-08-01T09:24:33.358836871Z caller=grpc.go:242 module=grpc/client msg="request failed" method=/oasis-core.NodeController/GetStatus req_seq=1 rsp="unsupported value type" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
level=debug ts=2024-08-01T09:24:33.358870971Z caller=oasis.go:149 module=oasis msg="Failed to get status from node" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
level=error ts=2024-08-01T09:24:33.358892071Z caller=main.go:210 module=oasis-rosetta-gateway msg="failed to obtain chain ID from Oasis node" err="failed to get status from node: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
ok: run: node: (pid 53) 2s,
level=debug ts=2024-08-01T09:24:34.366351252Z caller=oasis.go:136 module=oasis msg="Establishing connection" grpc_addr=unix:/data/internal.sock,
level=error ts=2024-08-01T09:24:34.366936959Z caller=grpc.go:242 module=grpc/client msg="request failed" method=/oasis-core.NodeController/GetStatus req_seq=1 rsp="unsupported value type" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
level=debug ts=2024-08-01T09:24:34.36697356Z caller=oasis.go:149 module=oasis msg="Failed to get status from node" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
level=error ts=2024-08-01T09:24:34.36698286Z caller=main.go:210 module=oasis-rosetta-gateway msg="failed to obtain chain ID from Oasis node" err="failed to get status from node: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
ok: run: node: (pid 53) 3s,
level=debug ts=2024-08-01T09:24:35.409274252Z caller=oasis.go:136 module=oasis msg="Establishing connection" grpc_addr=unix:/data/internal.sock,
level=error ts=2024-08-01T09:24:35.409847159Z caller=grpc.go:242 module=grpc/client msg="request failed" method=/oasis-core.NodeController/GetStatus req_seq=1 rsp="unsupported value type" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
level=debug ts=2024-08-01T09:24:35.410018861Z caller=oasis.go:149 module=oasis msg="Failed to get status from node" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
level=error ts=2024-08-01T09:24:35.410067761Z caller=main.go:210 module=oasis-rosetta-gateway msg="failed to obtain chain ID from Oasis node" err="failed to get status from node: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
ok: run: node: (pid 53) 4s,
level=debug ts=2024-08-01T09:24:36.46132456Z caller=oasis.go:136 module=oasis msg="Establishing connection" grpc_addr=unix:/data/internal.sock,
level=error ts=2024-08-01T09:24:36.461889466Z caller=grpc.go:242 module=grpc/client msg="request failed" method=/oasis-core.NodeController/GetStatus req_seq=1 rsp="unsupported value type" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
level=debug ts=2024-08-01T09:24:36.461924767Z caller=oasis.go:149 module=oasis msg="Failed to get status from node" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
level=error ts=2024-08-01T09:24:36.461935667Z caller=main.go:210 module=oasis-rosetta-gateway msg="failed to obtain chain ID from Oasis node" err="failed to get status from node: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
{"caller":"init.go:91","err":"signature/signer/file: invalid PEM file permissions 700 on /data/identity.pem","level":"error","module":"oasis-node","msg":"failed to load/generate identity","ts":"2024-08-01T09:24:37.163036136Z"},

@peternose
Copy link

This will probably not solve the problem, but you should change file permissions on /data/identity.pem from 700 to 600.

@mayank-daga
Copy link
Author

ok @peternose please let us know if you have any solution

@matevz
Copy link
Member

matevz commented Aug 21, 2024

I don't think this is related to the upgraded rosetta gateway, but the oasis-node. Can you check/attach the oasis-node logs too? Make sure you are running the latest version (see here https://docs.oasis.io/node/mainnet/)?

@mayank-daga
Copy link
Author

Hi @matevz the above logs are from node only and we running latest version only

@mayank-daga
Copy link
Author

Hi @matevz just following up

@matevz
Copy link
Member

matevz commented Sep 17, 2024

Did you change the permission of the data folder?

This will probably not solve the problem, but you should change file permissions on /data/identity.pem from 700 to 600.

@mayank-daga
Copy link
Author

Hi @matevz yes i have done that

@pro-wh
Copy link
Collaborator

pro-wh commented Sep 18, 2024

does the oasis node crash?

@mayank-daga
Copy link
Author

Hi @pro-wh node is up but since not syncing and curl queries not working also

@mayank-daga
Copy link
Author

HI @pro-wh we are getting following type of logs :

level=error ts=2024-09-19T09:37:32.787336593Z caller=main.go:210 module=oasis-rosetta-gateway msg="failed to obtain chain ID from Oasis node" err="failed to get status from node: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused"",
level=error ts=2024-09-19T09:37:33.796742044Z caller=grpc.go:242 module=grpc/client msg="request failed" method=/oasis-core.NodeController/GetStatus req_seq=1 rsp="unsupported value type" err="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing: dial unix /data/internal.sock: connect: connection refused""

@pro-wh
Copy link
Collaborator

pro-wh commented Sep 19, 2024

these are logs from the gateway, can you check on the oasis node?

https://github.com/oasisprotocol/oasis-rosetta-gateway?tab=readme-ov-file#running-the-gateway

@mayank-daga
Copy link
Author

mayank-daga commented Sep 25, 2024 •
edited
Loading

Hi @pro-wh we are not running oasis node / cli. We are simple running oasis rosetta gateway using docker.
These were steps we followed that were suggested by you only over the issue #494

Steps:

mkdir -p /tmp/rosetta-data/etc
chmod 700 /tmp/rosetta-data
cp config.yml /tmp/rosetta-data/etc
wget -O /tmp/rosetta-data/etc/genesis.json https://github.com/oasisprotocol/mainnet-artifacts/releases/download/2023-11-29/genesis.json
sudo chown -R www-data:www-data /tmp/rosetta-data
docker run -it -v /tmp/rosetta-data:/data oasis-rosetta-gateway:v2.7.0

then

sudo ls -al /tmp/rosetta-data
shows files

Also, the logs that i have shared are the only logs from docker we are getting

Can you help me with tcp and udp ports to be opened for firewall?

@pro-wh
Copy link
Collaborator

pro-wh commented Sep 26, 2024

but the docker image does run oasis-node, and it should be logging things if it has any trouble

https://github.com/oasisprotocol/oasis-rosetta-gateway/blob/v2.7.0/docker/service/node/run

can you investigate why there's no output?

firewall

I think the oasis-node program needs to connect to peers over the publicly routable internet in general

@mayank-daga
Copy link
Author

Hi @pro-wh i have restarted the node with image v2.6.0 from scratch and its syncing properly but when I tried with new image v2.7.0 i was getting following error logs :

level=info ts=2024-10-23T05:20:38.091246797Z caller=main.go:192 module=oasis-rosetta-gateway msg="waiting for node socket to appear..." socket_path=/data/internal.sock
{"caller":"node.go:457","level":"info","mode":"client","module":"oasis-node","msg":"Starting oasis-node","ts":"2024-10-23T05:20:38.09780281Z","version":"24.0-gitfb49717f3"}
level=info ts=2024-10-23T05:20:39.091387662Z caller=main.go:192 module=oasis-rosetta-gateway msg="waiting for node socket to appear..." socket_path=/data/internal.sock
level=info ts=2024-10-23T05:20:40.091526919Z caller=main.go:192 module=oasis-rosetta-gateway msg="waiting for node socket to appear..." socket_path=/data/internal.sock
level=info ts=2024-10-23T05:20:41.091658513Z caller=main.go:192 module=oasis-rosetta-gateway msg="waiting for node socket to appear..." socket_path=/data/internal.sock
{"caller":"init.go:97","consensus_pk":"oNp71c2Voq3c+IygQ0AzaXcaEmS2V/ss96TpaAa4Vp8=","level":"info","module":"oasis-node","msg":"loaded/generated node identity","node_pk":"iuJZ+kRyqdz/3vUCcXyWoMrvbLqqKI4RedvV1j6jyYg=","p2p_pk":"UBpOyvXUrh8EOsQhv7XatlDNxmrfn9hCHp8eeTS4hRk=","tls_pk":"CgZ34iRn7009qb985qiYm/KIf8miZ2YbHJkxPZtWj+Y=","ts":"2024-10-23T05:20:41.468440238Z"}
{"caller":"component.go:36","level":"info","module":"grpc","msg":"[core] [Server #1] Server created\n","ts":"2024-10-23T05:20:41.471276222Z"}
{"caller":"helpers.go:40","level":"info","module":"common/persistent","msg":"All 0 tables opened in 0s","ts":"2024-10-23T05:20:41.48573404Z"}
{"caller":"helpers.go:40","level":"info","module":"common/persistent","msg":"Discard stats nextEmptySlot: 0","ts":"2024-10-23T05:20:41.488591003Z"}
{"caller":"helpers.go:40","level":"info","module":"common/persistent","msg":"Set nextTxnTs to 0","ts":"2024-10-23T05:20:41.488621481Z"}
{"caller":"full.go:945","level":"info","module":"cometbft","msg":"starting a full consensus node","ts":"2024-10-23T05:20:41.497661198Z"}
{"caller":"helpers.go:40","level":"info","module":"mkvs/db/badger","msg":"All 0 tables opened in 0s","ts":"2024-10-23T05:20:41.511728217Z"}
{"caller":"helpers.go:40","level":"info","module":"mkvs/db/badger","msg":"Discard stats nextEmptySlot: 0","ts":"2024-10-23T05:20:41.515642872Z"}
{"caller":"helpers.go:40","level":"info","module":"mkvs/db/badger","msg":"Set nextTxnTs to 0","ts":"2024-10-23T05:20:41.515785649Z"}
level=info ts=2024-10-23T05:20:42.092034989Z caller=main.go:192 module=oasis-rosetta-gateway msg="waiting for node socket to appear..." socket_path=/data/internal.sock
{"address":"[/ip4/127.0.0.1/tcp/9200 /ip4/172.19.0.2/tcp/9200]","caller":"p2p.go:437","level":"info","module":"p2p","msg":"p2p host initialized","ts":"2024-10-23T05:20:42.466861284Z"}
{"caller":"helpers.go:40","level":"info","module":"cometbft/db/badger","msg":"All 0 tables opened in 0s","path":"/data/consensus/light.badger.db","ts":"2024-10-23T05:20:42.483781453Z"}
{"caller":"helpers.go:40","level":"info","module":"cometbft/db/badger","msg":"Discard stats nextEmptySlot: 0","path":"/data/consensus/light.badger.db","ts":"2024-10-23T05:20:42.487359967Z"}
{"caller":"helpers.go:40","level":"info","module":"cometbft/db/badger","msg":"Set nextTxnTs to 0","path":"/data/consensus/light.badger.db","ts":"2024-10-23T05:20:42.487394923Z"}
{"caller":"p2p.go:344","level":"info","module":"p2p","msg":"registered protocol server","protocol_id":"/oasis/bb3d748def55bdfb797a2ac53ee6ee141e54cd2ab2dc2375f4a0703a178e6e55/light/1.0.0","ts":"2024-10-23T05:20:42.487609354Z"}
{"caller":"discovery.go:181","level":"info","module":"p2p/peer-manager/discovery","msg":"started advertising","namespace":"/oasis/bb3d748def55bdfb797a2ac53ee6ee141e54cd2ab2dc2375f4a0703a178e6e55/light/1.0.0","ts":"2024-10-23T05:20:42.487683178Z"}
{"caller":"client.go:89","level":"warn","module":"ias/proxyclient","msg":"IAS proxy is not configured, all reports will be mocked","ts":"2024-10-23T05:20:42.48790078Z"}
{"caller":"worker.go:79","level":"info","module":"worker/beacon","msg":"registration worker disabled, also disabling beacon worker","ts":"2024-10-23T05:20:42.488310228Z"}
{"caller":"worker.go:134","level":"info","module":"worker/storage","msg":"not starting storage worker as it is disabled","ts":"2024-10-23T05:20:42.488350423Z"}
{"caller":"worker.go:87","level":"info","module":"worker/keymanager","msg":"not starting key manager worker as it is disabled","ts":"2024-10-23T05:20:42.488369429Z"}
{"caller":"worker.go:1111","level":"info","module":"worker/registration","msg":"starting node registration service","ts":"2024-10-23T05:20:42.488382363Z"}
{"caller":"worker.go:1115","level":"warn","module":"worker/registration","msg":"no entity/signer for this node, registration will NEVER succeed","ts":"2024-10-23T05:20:42.488406488Z"}
{"caller":"worker.go:42","level":"info","module":"worker/sentry","msg":"not starting sentry worker as it is disabled","ts":"2024-10-23T05:20:42.488420785Z"}
{"caller":"grpc.go:463","level":"info","module":"grpc/internal","msg":"starting gRPC server","ts":"2024-10-23T05:20:42.488618175Z"}
{"address":"/data/internal.sock","caller":"grpc.go:479","level":"info","module":"grpc/internal","msg":"gRPC server started","network":"unix","ts":"2024-10-23T05:20:42.488686964Z"}
{"caller":"component.go:36","level":"info","module":"grpc","msg":"[core] [Server #1 ListenSocket #2] ListenSocket created\n","ts":"2024-10-23T05:20:42.488738806Z"}
{"caller":"helpers.go:40","level":"info","module":"cometbft/db/badger","msg":"All 0 tables opened in 0s","path":"/data/consensus/data/blockstore.badger.db","ts":"2024-10-23T05:20:42.501860005Z"}
{"caller":"helpers.go:40","level":"info","module":"cometbft/db/badger","msg":"Discard stats nextEmptySlot: 0","path":"/data/consensus/data/blockstore.badger.db","ts":"2024-10-23T05:20:42.505504413Z"}
{"caller":"helpers.go:40","level":"info","module":"cometbft/db/badger","msg":"Set nextTxnTs to 0","path":"/data/consensus/data/blockstore.badger.db","ts":"2024-10-23T05:20:42.505532155Z"}
{"caller":"helpers.go:40","level":"info","module":"cometbft/db/badger","msg":"All 0 tables opened in 0s","path":"/data/consensus/data/state.badger.db","ts":"2024-10-23T05:20:42.518041461Z"}
{"caller":"helpers.go:40","level":"info","module":"cometbft/db/badger","msg":"Discard stats nextEmptySlot: 0","path":"/data/consensus/data/state.badger.db","ts":"2024-10-23T05:20:42.520368102Z"}
{"caller":"helpers.go:40","level":"info","module":"cometbft/db/badger","msg":"Set nextTxnTs to 0","path":"/data/consensus/data/state.badger.db","ts":"2024-10-23T05:20:42.520397898Z"}
level=debug ts=2024-10-23T05:20:43.092176647Z caller=oasis.go:136 module=oasis msg="Establishing connection" grpc_addr=unix:/data/internal.sock
level=info ts=2024-10-23T05:20:43.095012421Z caller=main.go:226 module=oasis-rosetta-gateway msg="connected to Oasis node" chain_context=bb3d748def55bdfb797a2ac53ee6ee141e54cd2ab2dc2375f4a0703a178e6e55
level=info ts=2024-10-23T05:20:43.095248984Z caller=main.go:235 module=oasis-rosetta-gateway msg="Oasis Rosetta Gateway listening" port=8080
{"caller":"service.go:139","impl":"multiAppConn","level":"info","module":"cometbft:proxy","msg":"Starting multiAppConn service","ts":"2024-10-23T05:20:43.742019404Z"}
{"caller":"service.go:139","connection":"query","impl":"localClient","level":"info","module":"cometbft:proxy/abci-client","msg":"Starting localClient service","ts":"2024-10-23T05:20:43.742069367Z"}
{"caller":"service.go:139","connection":"snapshot","impl":"localClient","level":"info","module":"cometbft:proxy/abci-client","msg":"Starting localClient service","ts":"2024-10-23T05:20:43.742082272Z"}
{"caller":"service.go:139","connection":"mempool","impl":"localClient","level":"info","module":"cometbft:proxy/abci-client","msg":"Starting localClient service","ts":"2024-10-23T05:20:43.74209207Z"}
{"caller":"service.go:139","connection":"consensus","impl":"localClient","level":"info","module":"cometbft:proxy/abci-client","msg":"Starting localClient service","ts":"2024-10-23T05:20:43.742101798Z"}
{"caller":"service.go:139","impl":"EventBus","level":"info","module":"cometbft:events","msg":"Starting EventBus service","ts":"2024-10-23T05:20:43.742126194Z"}
{"caller":"service.go:139","impl":"PubSub","level":"info","module":"cometbft:events/pubsub","msg":"Starting PubSub service","ts":"2024-10-23T05:20:43.742135882Z"}
{"caller":"service.go:139","impl":"IndexerService","level":"info","module":"cometbft:txindex","msg":"Starting IndexerService service","ts":"2024-10-23T05:20:43.742153996Z"}
{"caller":"replay.go:266","hash":null,"height":0,"level":"info","module":"cometbft:consensus","msg":"ABCI Handshake App Info","protocol-version":30064771072,"software-version":"","ts":"2024-10-23T05:20:43.742188511Z"}
{"appHeight":0,"caller":"replay.go:315","level":"info","module":"cometbft:consensus","msg":"ABCI Replay Blocks","stateHeight":0,"storeHeight":0,"ts":"2024-10-23T05:20:43.742219378Z"}
{"caller":"beacon.go:110","epoch":28018,"is_check_only":false,"level":"info","mode":"init chain","module":"consensus/cometbft/abci","msg":"scheduling epoch transition block","next_height":16818556,"ts":"2024-10-23T05:20:46.425963368Z"}
{"caller":"genesis.go:55","common_pool":"754215189568198393","last_block_fees":"0","level":"warn","mode":"init chain","module":"consensus/cometbft/abci","msg":"InitChain: moving last block fees into common pool","ts":"2024-10-23T05:20:46.426460389Z"}
{"caller":"api.go:835","err":"node: invalid TEE attestation signature","level":"error","mode":"init chain","module":"consensus/cometbft/abci","msg":"VerifyNodeRuntimeEnclaveIDs: failed to validate attestation","node_id":"PsfFUQrXqGoFtowWZcoc8ilh8xHP94LvNYHvqQHpw1E=","runtime_id":"000000000000000000000000000000000000000000000000e199119c992377cb","ts":"2023-11-29T10:02:19.889882912Z"}
{"caller":"api.go:835","err":"node: invalid TEE attestation signature","level":"error","mode":"init chain","module":"consensus/cometbft/abci","msg":"VerifyNodeRuntimeEnclaveIDs: failed to validate attestation","node_id":"PsfFUQrXqGoFtowWZcoc8ilh8xHP94LvNYHvqQHpw1E=","runtime_id":"000000000000000000000000000000000000000000000000f80306c9858e7279","ts":"2023-11-29T10:02:19.889882912Z"}
{"caller":"api.go:835","err":"node: invalid TEE attestation signature","level":"error","mode":"init chain","module":"consensus/cometbft/abci","msg":"VerifyNodeRuntimeEnclaveIDs: failed to validate attestation","node_id":"+zVbgQqOdY90Z2NQKXFByNT0OwLxj/Ho4j4qT5u2yKM=","runtime_id":"000000000000000000000000000000000000000000000000e199119c992377cb","ts":"2023-11-29T10:02:19.889882912Z"}
{"caller":"api.go:835","err":"node: invalid TEE attestation signature","level":"error","mode":"init chain","module":"consensus/cometbft/abci","msg":"VerifyNodeRuntimeEnclaveIDs: failed to validate attestation","node_id":"aJFHeID4Q7qUfMa42dRwaa9PQrZ/cVDiE3WNt4bQjo0=","runtime_id":"000000000000000000000000000000000000000000000000e199119c992377cb","ts":"2023-11-29T10:02:19.889882912Z"}
{"caller":"api.go:835","err":"node: invalid TEE attestation signature","level":"error","mode":"init chain","module":"consensus/cometbft/abci","msg":"VerifyNodeRuntimeEnclaveIDs: failed to validate attestation","node_id":"YojWrKWRRiPmKkHqMESHFz9iTFbeCpd7GL4CGpEAxkw=","runtime_id":"000000000000000000000000000000000000000000000000e199119c992377cb","ts":"2023-11-29T10:02:19.889882912Z"}
{"caller":"api.go:835","err":"node: invalid TEE attestation signature","level":"error","mode":"init chain","module":"consensus/cometbft/abci","msg":"VerifyNodeRuntimeEnclaveIDs: failed to validate attestation","node_id":"XCiPWblWT3n1aN2NI0vslmlfV9GOkxE2Ih2SI66ZR38=","runtime_id":"000000000000000000000000000000000000000000000000e199119c992377cb","ts":"2023-11-29T10:02:19.889882912Z"}
{"caller":"api.go:835","err":"node: invalid TEE attestation signature","level":"error","mode":"init chain","module":"consensus/cometbft/abci","msg":"VerifyNodeRuntimeEnclaveIDs: failed to validate attestation","node_id":"XCiPWblWT3n1aN2NI0vslmlfV9GOkxE2Ih2SI66ZR38=","runtime_id":"000000000000000000000000000000000000000000000000f80306c9858e7279","ts":"2023-11-29T10:02:19.889882912Z"}
{"caller":"api.go:835","err":"node: invalid TEE attestation signature","level":"error","mode":"init chain","module":"consensus/cometbft/abci","msg":"VerifyNodeRuntimeEnclaveIDs: failed to validate attestation","node_id":"ITrwEekdZNqXrEzvw3GT6Q3AtHDd51f19nD2nVU/f0c=","runtime_id":"000000000000000000000000000000000000000000000000e199119c992377cb","ts":"2023-11-29T10:02:19.889882912Z"}
{"caller":"api.go:835","err":"node: invalid TEE attestation signature","level":"error","mode":"init chain","module":"consensus/cometbft/abci","msg":"VerifyNodeRuntimeEnclaveIDs: failed to validate attestation","node_id":"ITrwEekdZNqXrEzvw3GT6Q3AtHDd51f19nD2nVU/f0c=","runtime_id":"000000000000000000000000000000000000000000000000f80306c9858e7279","ts":"2023-11-29T10:02:19.889882912Z"}
{"caller":"genesis.go:36","level":"info","mode":"init chain","module":"consensus/cometbft/abci","msg":"InitChain: allocating per-runtime state","runtime":"4000000000000000000000000000000000000000000000008c5ea5e49b4bc9ac","ts":"2024-10-23T05:20:47.911820654Z"}
{"caller":"genesis.go:36","level":"info","mode":"init chain","module":"consensus/cometbft/abci","msg":"InitChain: allocating per-runtime state","runtime":"000000000000000000000000000000000000000000000000f80306c9858e7279","ts":"2024-10-23T05:20:47.911846792Z"}
{"caller":"genesis.go:36","level":"info","mode":"init chain","module":"consensus/cometbft/abci","msg":"InitChain: allocating per-runtime state","runtime":"000000000000000000000000000000000000000000000000e2eaa99fc008f87f","ts":"2024-10-23T05:20:47.911974322Z"}
{"caller":"genesis.go:36","level":"info","mode":"init chain","module":"consensus/cometbft/abci","msg":"InitChain: allocating per-runtime state","runtime":"000000000000000000000000000000000000000000000000e199119c992377cb","ts":"2024-10-23T05:20:47.91203241Z"}
{"caller":"genesis.go:45","level":"info","mode":"init chain","module":"consensus/cometbft/abci","msg":"InitChain: allocating per-runtime state","runtime":"000000000000000000000000000000000000000000000000000000000000ff03","ts":"2024-10-23T05:20:47.912210164Z"}
{"caller":"genesis.go:45","level":"info","mode":"init chain","module":"consensus/cometbft/abci","msg":"InitChain: allocating per-runtime state","runtime":"000000000000000000000000000000000000000000000000000000000000ff04","ts":"2024-10-23T05:20:47.9122563Z"}
{"caller":"genesis.go:45","level":"info","mode":"init chain","module":"consensus/cometbft/abci","msg":"InitChain: allocating per-runtime state","runtime":"000000000000000000000000000000000000000000000000000000000000ff01","ts":"2024-10-23T05:20:47.912316062Z"}
{"caller":"genesis.go:45","level":"info","mode":"init chain","module":"consensus/cometbft/abci","msg":"InitChain: allocating per-runtime state","runtime":"000000000000000000000000000000000000000000000000000000000000ff00","ts":"2024-10-23T05:20:47.912366016Z"}
{"caller":"genesis.go:45","level":"info","mode":"init chain","module":"consensus/cometbft/abci","msg":"InitChain: allocating per-runtime state","runtime":"00000000000000000000000000000000000070617263656c70726f6400000000","ts":"2024-10-23T05:20:47.912423233Z"}
{"caller":"genesis.go:45","level":"info","mode":"init chain","module":"consensus/cometbft/abci","msg":"InitChain: allocating per-runtime state","runtime":"000000000000000000000000000000000000000000000000000000000000ff02","ts":"2024-10-23T05:20:47.912461665Z"}
{"appHash":"8m9CkxGy9woIa1j4Cho39GiSakhknmedbYfT35j6y8E=","appHeight":0,"caller":"replay.go:284","level":"info","module":"cometbft:consensus","msg":"Completed ABCI Handshake - CometBFT and App are synced","ts":"2024-10-23T05:20:49.553833616Z"}
{"abci":"1.0.0","block":11,"caller":"node.go:457","commit_hash":"","level":"info","module":"cometbft:base","msg":"Version info","p2p":8,"tendermint_version":"0.37.6","ts":"2024-10-23T05:20:49.554008924Z"}
{"addr":"B0F5EF6737B3CC71F86F72E3C01C3869A0D8286A","caller":"node.go:478","level":"info","module":"cometbft:consensus","msg":"This node is not a validator","pubKey":"oNp71c2Voq3c+IygQ0AzaXcaEmS2V/ss96TpaAa4Vp8=","ts":"2024-10-23T05:20:49.554035153Z"}
{"caller":"helpers.go:40","level":"info","module":"cometbft/db/badger","msg":"All 0 tables opened in 0s","path":"/data/consensus/data/evidence.badger.db","ts":"2024-10-23T05:20:49.56707238Z"}
{"caller":"helpers.go:40","level":"info","module":"cometbft/db/badger","msg":"Discard stats nextEmptySlot: 0","path":"/data/consensus/data/evidence.badger.db","ts":"2024-10-23T05:20:49.571872484Z"}
{"caller":"helpers.go:40","level":"info","module":"cometbft/db/badger","msg":"Set nextTxnTs to 0","path":"/data/consensus/data/evidence.badger.db","ts":"2024-10-23T05:20:49.571911156Z"}
{"ID":"ca212b4fafc98c0b0f29d6a77d434f5e936a271e","caller":"node.go:729","file":"/data/consensus/config/node_key.json","level":"info","module":"cometbft:p2p","msg":"P2P Node ID","ts":"2024-10-23T05:20:49.57398919Z"}
{"addrs":[],"caller":"switch.go:578","level":"info","module":"cometbft:p2p","msg":"Adding persistent peers","ts":"2024-10-23T05:20:49.574014677Z"}
{"caller":"switch.go:596","ids":[],"level":"info","module":"cometbft:p2p","msg":"Adding unconditional peer ids","ts":"2024-10-23T05:20:49.574025468Z"}
{"addr":"ca212b4fafc98c0b0f29d6a77d434f5e936a271e@0.0.0.0:26656","book":"/data/consensus/config/addrbook.json","caller":"addrbook.go:187","level":"info","module":"cometbft:p2p","msg":"Add our address to book","ts":"2024-10-23T05:20:49.574065483Z"}
{"caller":"service.go:139","impl":"Node","level":"info","module":"cometbft:base","msg":"Starting Node service","ts":"2024-10-23T05:20:50.143442248Z"}
{"caller":"service.go:139","impl":"P2P Switch","level":"info","module":"cometbft:p2p","msg":"Starting P2P Switch service","ts":"2024-10-23T05:20:50.143693258Z"}
{"caller":"service.go:139","impl":"Reactor","level":"info","module":"cometbft:blockchain","msg":"Starting Reactor service","ts":"2024-10-23T05:20:50.143715039Z"}
{"caller":"service.go:139","impl":"BlockPool","level":"info","module":"cometbft:blockchain","msg":"Starting BlockPool service","ts":"2024-10-23T05:20:50.143727593Z"}
{"caller":"service.go:139","impl":"ConsensusReactor","level":"info","module":"cometbft:consensus","msg":"Starting Consensus service","ts":"2024-10-23T05:20:50.143752108Z"}
{"caller":"reactor.go:75","level":"info","module":"cometbft:consensus","msg":"Reactor ","ts":"2024-10-23T05:20:50.143781774Z","waitSync":true}
{"caller":"service.go:139","impl":"Evidence","level":"info","module":"cometbft:evidence","msg":"Starting Evidence service","ts":"2024-10-23T05:20:50.143801251Z"}
{"caller":"service.go:139","impl":"StateSync","level":"info","module":"cometbft:statesync","msg":"Starting StateSync service","ts":"2024-10-23T05:20:50.143823562Z"}
{"caller":"service.go:139","impl":"PEX","level":"info","module":"cometbft:pex","msg":"Starting PEX service","ts":"2024-10-23T05:20:50.14384884Z"}
{"book":"/data/consensus/config/addrbook.json","caller":"service.go:139","impl":"AddrBook","level":"info","module":"cometbft:p2p","msg":"Starting AddrBook service","ts":"2024-10-23T05:20:50.143871372Z"}
{"book":"/data/consensus/config/addrbook.json","caller":"file.go:22","level":"info","module":"cometbft:p2p","msg":"Saving AddrBook to file","size":0,"ts":"2024-10-23T05:20:50.143929371Z"}
{"caller":"pex_reactor.go:458","level":"info","module":"cometbft:pex","msg":"Ensure peers","numDialing":0,"numInPeers":0,"numOutPeers":0,"numToDial":20,"ts":"2024-10-23T05:20:50.143966717Z"}
{"caller":"node.go:637","level":"info","module":"oasis-node","msg":"initialization complete: ready to serve","ts":"2024-10-23T05:20:50.148077683Z"}
{"caller":"services.go:27","level":"info","module":"cometbft","msg":"starting event dispatcher","service":"staking","ts":"2024-10-23T05:20:50.14808864Z"}
{"caller":"services.go:27","level":"info","module":"cometbft","msg":"starting event dispatcher","service":"beacon","ts":"2024-10-23T05:20:50.14811238Z"}
{"caller":"services.go:27","level":"info","module":"cometbft","msg":"starting event dispatcher","service":"registry","ts":"2024-10-23T05:20:50.148137592Z"}
{"caller":"services.go:27","level":"info","module":"cometbft","msg":"starting event dispatcher","service":"keymanager","ts":"2024-10-23T05:20:50.148130803Z"}
{"caller":"pex_reactor.go:531","level":"info","module":"cometbft:pex","msg":"No addresses to dial. Falling back to seeds","ts":"2024-10-23T05:20:50.148153377Z"}
{"caller":"services.go:27","level":"info","module":"cometbft","msg":"starting event dispatcher","service":"scheduler","ts":"2024-10-23T05:20:50.148192894Z"}
{"caller":"services.go:27","level":"info","module":"cometbft","msg":"starting event dispatcher","service":"roothash","ts":"2024-10-23T05:20:50.148215403Z"}
{"caller":"services.go:27","level":"info","module":"cometbft","msg":"starting event dispatcher","service":"vault","ts":"2024-10-23T05:20:50.148156275Z"}
{"caller":"services.go:27","level":"info","module":"cometbft","msg":"starting event dispatcher","service":"governance","ts":"2024-10-23T05:20:50.148229537Z"}
{"caller":"pex_reactor.go:632","err":"auth failure: secret conn failed: proto: illegal wireType 7","level":"error","module":"cometbft:p2p","msg":"Error dialing seed","seed":"e27f6b7a350b4cc2b48a6cbe94b0a02b0dcb0bf3@35.199.49.168:9200","ts":"2024-10-23T05:20:50.210267803Z"}
{"caller":"service.go:139","impl":"Peer{MConn{35.199.49.168:26656} e27f6b7a350b4cc2b48a6cbe94b0a02b0dcb0bf3 out}","level":"info","module":"cometbft:p2p","msg":"Starting Peer service","peer":"e27f6b7a350b4cc2b48a6cbe94b0a02b0dcb0bf3@35.199.49.168:26656","ts":"2024-10-23T05:20:50.282710554Z"}
{"caller":"service.go:139","impl":"MConn{35.199.49.168:26656}","level":"info","module":"cometbft:p2p","msg":"Starting MConnection service","peer":"e27f6b7a350b4cc2b48a6cbe94b0a02b0dcb0bf3@35.199.49.168:26656","ts":"2024-10-23T05:20:50.282738506Z"}
{"caller":"connection.go:600","conn":"MConn{35.199.49.168:26656}","level":"info","module":"cometbft:p2p","msg":"Connection is closed @ recvRoutine (likely by the other side)","peer":"e27f6b7a350b4cc2b48a6cbe94b0a02b0dcb0bf3@35.199.49.168:26656","ts":"2024-10-23T05:20:50.408084113Z"}
{"caller":"service.go:176","impl":"MConn{35.199.49.168:26656}","level":"info","module":"cometbft:p2p","msg":"Stopping MConnection service","peer":"e27f6b7a350b4cc2b48a6cbe94b0a02b0dcb0bf3@35.199.49.168:26656","ts":"2024-10-23T05:20:50.408111104Z"}
{"caller":"switch.go:338","err":"EOF","level":"error","module":"cometbft:p2p","msg":"Stopping peer for error","peer":"Peer{MConn{35.199.49.168:26656} e27f6b7a350b4cc2b48a6cbe94b0a02b0dcb0bf3 out}","ts":"2024-10-23T05:20:50.408179381Z"}
{"caller":"service.go:176","impl":"Peer{MConn{35.199.49.168:26656} e27f6b7a350b4cc2b48a6cbe94b0a02b0dcb0bf3 out}","level":"info","module":"cometbft:p2p","msg":"Stopping Peer service","peer":"e27f6b7a350b4cc2b48a6cbe94b0a02b0dcb0bf3@35.199.49.168:26656","ts":"2024-10-23T05:20:50.408227712Z"}

seems peer issue is happening with this 2.7.0 image

@pro-wh
Copy link
Collaborator

pro-wh commented Oct 23, 2024

https://docs.oasis.io/node/mainnet/#network-parameters you can try these seeds from Oasis

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@matevz @peternose @pro-wh @mayank-daga