Skip to content

GitLab

Open
Created by Mark Brooker@walkjiveflyMaintainer

SNs don't stay ENABLED

Running Crown Core version v0.21.0.0-3b900b87 (release build)

  1. SN once activated does not stay ENABLED in the v0.14 systemnode list
  2. Shortly after EXPIRING from the list it stopped responding to RPC calls
  3. 20 minutes later it timed out all it's active connections
  4. Only thing left to do is kill it.

Uploaded first 10k and last 10k lines of debug.log and the core to https://storage.crownplatform.com/f/23062

Sneak preview, gdb shows

(gdb) bt
#0  0x00007f91df722c1d in nanosleep () at ../sysdeps/unix/syscall-template.S:84
#1  0x00005556ff73d8ce in UninterruptibleSleep(std::chrono::duration<long, std::ratio<1l, 1000000l> > const&) ()
#2  0x00005556ff170a23 in AppInit(int, char**) ()
#3  0x00005556ff161acf in main ()
(gdb) info thread
  Id   Target Id         Frame 
* 1    Thread 0x7f91dfb44740 (LWP 2652) "crownd" 0x00007f91df722c1d in nanosleep () at ../sysdeps/unix/syscall-template.S:84
  2    Thread 0x7f91dc5c4700 (LWP 2653) "b-scriptch.0" pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
  3    Thread 0x7f91dbdc3700 (LWP 2654) "b-scriptch.1" pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
  4    Thread 0x7f91db5c2700 (LWP 2655) "b-scriptch.2" pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
  5    Thread 0x7f91dadc1700 (LWP 2656) "b-crown-mnodesy" __lll_lock_wait ()
    at ../sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135
  6    Thread 0x7f91da5c0700 (LWP 2657) "b-http" 0x00007f91de9a6ad3 in epoll_wait () at ../sysdeps/unix/syscall-template.S:84
  7    Thread 0x7f91d9dbf700 (LWP 2658) "b-httpworker.0" pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
  8    Thread 0x7f91d95be700 (LWP 2659) "b-httpworker.1" __lll_lock_wait ()
    at ../sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135
  9    Thread 0x7f91d8dbd700 (LWP 2660) "b-httpworker.2" pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
  10   Thread 0x7f91bffff700 (LWP 2661) "b-httpworker.3" pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185
  11   Thread 0x7f91be05a700 (LWP 2666) "b-torcontrol" 0x00007f91de9a6ad3 in epoll_wait () at ../sysdeps/unix/syscall-template.S:84
  12   Thread 0x7f91bd859700 (LWP 2667) "b-net" 0x00007f91de99a80d in poll ()
    at ../sysdeps/unix/syscall-template.S:84
  13   Thread 0x7f91bc857700 (LWP 2669) "b-addcon" pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:225
  14   Thread 0x7f919ffff700 (LWP 2670) "b-mncon" pthread_cond_timedwait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:225
  15   Thread 0x7f919f7fe700 (LWP 2671) "b-opencon" __lll_lock_wait ()
    at ../sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135
  16   Thread 0x7f919effd700 (LWP 2672) "b-msghand" __lll_lock_wait ()
    at ../sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135
  17   Thread 0x7f919dfec700 (LWP 2708) "b-crown-snodesy" pthread_cond_wait@@GLIBC_2.3.2 () at ../sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185

Upon restarting it said

...
2021-06-23T14:14:36Z Opened LevelDB successfully
2021-06-23T14:14:36Z Using obfuscation key for /home/crown/.crown/indexes/txindex: 0000000000000000
2021-06-23T14:14:36Z txindex thread start
2021-06-23T14:14:36Z Syncing txindex with block chain from height 2407504
2021-06-23T14:14:36Z txindex is enabled at height 2407504
...
2021-06-23T14:14:37Z block tree size = 3429579
2021-06-23T14:14:37Z nBestHeight = 2407504
...
2021-06-23T14:14:37Z mncon thread start
2021-06-23T14:14:37Z UpdateTip: new best=133fd0886856ec3aa9ef4681427960942156e37496036bf95cff087535993415 height=2407505 version=0x00160202 log2_work=86.425817 tx=2728221 date='2019-06-09T07:27:36Z' progress=0.004951 cache=0.0MiB(4txo)
2021-06-23T14:14:37Z UpdateTip: new best=7d02fb3892d5eb9ceceeb966bc89078d30d02b89091a4e30eead67208eee5f5b height=2407506 version=0x00160202 log2_work=86.425817 tx=2728223 date='2019-06-09T07:27:37Z' progress=0.004951 cache=0.0MiB(8txo)
....

and is still rescanning. Presumably killing it corrupted the indexes.

Edited by Mark Brooker