Bitcoin Forum
February 18, 2019, 08:42:59 PM *
News: Latest Bitcoin Core release: 0.17.1 [Torrent]
 
   Home   Help Search Login Register More  
Pages: [1]
  Print  
Author Topic: Bitcoind stops while syncing - "Failed to open mempool file from disk"  (Read 165 times)
merc1er
Newbie
*
Offline Offline

Activity: 11
Merit: 3


View Profile WWW
February 10, 2019, 06:14:41 AM
Merited by LoyceV (1)
 #1

I installed Bitcoin Core on a Raspberry Pi and tried to sync the block chain using bitcoind.
The data is written on an external hard drive (1TB) mounted on the machine.

After I run the `bitcoind -daemon` command, the block chain starts syncing, but after a few hours it stops.
This is what I have at the end of the debug.log file:

----
2019-02-10T05:41:04Z UpdateTip: new best=00000000727339b1f121c82ad73e522d8e83d7ed4b1b3473aa10f26029f2b046 height=12774 version=0x00000001 log2_work=45.641058 tx=12882 date='2009-04-30T12:58:37Z' progress=0.000035 cache=2.4MiB(12863txo)
2019-02-10T05:41:04Z Failed to open mempool file from disk. Continuing anyway.
2019-02-10T05:41:04Z tor: Thread interrupt
2019-02-10T05:41:04Z Shutdown: In progress...
2019-02-10T05:41:04Z addcon thread exit
2019-02-10T05:41:04Z opencon thread exit
2019-02-10T05:41:04Z torcontrol thread exit
2019-02-10T05:41:04Z net thread exit
2019-02-10T05:41:04Z msghand thread exit
2019-02-10T05:41:04Z scheduler thread interrupt
2019-02-10T05:41:06Z [default wallet] Releasing wallet
2019-02-10T05:41:06Z Shutdown: done
----

Does anyone have an idea? Thank you!
1550522579
Hero Member
*
Offline Offline

Posts: 1550522579

View Profile Personal Message (Offline)

Ignore
1550522579
Reply with quote  #2

1550522579
Report to moderator
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
1550522579
Hero Member
*
Offline Offline

Posts: 1550522579

View Profile Personal Message (Offline)

Ignore
1550522579
Reply with quote  #2

1550522579
Report to moderator
Pmalek
Hero Member
*****
Offline Offline

Activity: 854
Merit: 856



View Profile
February 10, 2019, 08:18:40 AM
 #2

It could be that you have a corrupted block. Have you tried deleting the entire blockchain and letting Bitcoin Core download it again from the beginning?
Just make sure you have a backup of your wallet.dat file to be on the safe side.

.FORTUNE.JACK.
      ▄▄███████▄▄
   ▄████▀▀ ▄ ██████▄
  ████ ▄▄███ ████████
 █████▌▐███▌ ▀▄ ▀█████
███████▄██▀▀▀▀▄████████
█████▀▄▄▄▄█████████████
████▄▄▄▄ █████████████
 ██████▌ ███▀████████
  ███████▄▀▄████████
   ▀█████▀▀███████▀
      ▀▀██████▀▀
         
         █
...FortuneJack.com                                             
...THE BIGGEST BITCOIN GAMBLING SITE
       ▄▄█████████▄▄
    ▄█████████████████▄
  ▄█████████████████████▄
 ▄██
█████████▀███████████▄
██████████▀   ▀██████████
█████████▀       ▀█████████
████████           ████████
████████▄   ▄ ▄   ▄████████
██████████▀   ▀██████████
 ▀██
█████████████████████▀
  ▀██
███████████████████▀
    ▀█████████████████▀
       ▀▀█████████▀▀
#JACKMATE
WIN 1 BTC
▄█████████████████████████▄
███████████████████████████
███████████████████████████
██████████▀█████▀██████████
███████▀░░▀░░░░░▀░░▀███████
██████▌░░░░░░░░░░░░░▐██████
██████░░░░██░░░██░░░░██████
█████▌░░░░▀▀░░░▀▀░░░░▐█████
██████▄░░▄▄▄░░░▄▄▄░░▄██████
████████▄▄███████▄▄████████

███████████████████████████
███████████████████████████
▀█████████████████████████▀
KingZee
Sr. Member
****
Offline Offline

Activity: 518
Merit: 387


Check your coin privilege


View Profile
February 10, 2019, 10:46:02 AM
 #3

Since it's just starting to sync there's no harm in resyncing.

It does look like it's corrupt, delete the blocks and chainstate folders and restart bitcoind.

███████████
██
██
██
██
██
██
██
██
██
██
██
███████████
#1
███████████
██
██
██
██
██
██
██
██
██
██
██
███████████
BTC 
  ●
   BTC
  BTC  
.
    ▄▄▄▀▀▀▀
 ▄██▀
███        ▄▄▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▄▄▄
▀███▄▄▄▄▀▀▀                 ▀▀▄▄
  ▀▀▀██████████████████████████▀
   ▄█▄     ▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄
    ▀▀██▄▄█▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▀▀
      ▄  ▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
      ▀██▄  ▄▀▀▀▀▀▀▀▀▀▀▀▀▄
        ▀█▀██████████████▀▀
         ▀█▄▄ ▄▄▄▄▄▄▄▄▄▄
            █▀▄▄▄▄▄▄▄▄▄▄▀
             ▀▀▄▄▄▄▄▄▄
.
     BTC
  BTC   
  ●
  BTC  
███████████
██
██
██
██
██
██
██
██
██
██
██
███████████
███████████
██
██
██
██
██
██
██
██
██
██
██
███████████
aliashraf
Hero Member
*****
Offline Offline

Activity: 728
Merit: 586


View Profile
February 10, 2019, 11:55:10 AM
 #4

OP, It looks to me as a hardware failure, you need to check your hardware anyway:



darosior
Member
**
Online Online

Activity: 112
Merit: 119


View Profile WWW
February 10, 2019, 12:11:30 PM
 #5

I installed Bitcoin Core on a Raspberry Pi and tried to sync the block chain using bitcoind.
The data is written on an external hard drive (1TB) mounted on the machine.

After I run the `bitcoind -daemon` command, the block chain starts syncing, but after a few hours it stops.
This is what I have at the end of the debug.log file:

----
2019-02-10T05:41:04Z UpdateTip: new best=00000000727339b1f121c82ad73e522d8e83d7ed4b1b3473aa10f26029f2b046 height=12774 version=0x00000001 log2_work=45.641058 tx=12882 date='2009-04-30T12:58:37Z' progress=0.000035 cache=2.4MiB(12863txo)
2019-02-10T05:41:04Z Failed to open mempool file from disk. Continuing anyway.
2019-02-10T05:41:04Z tor: Thread interrupt
2019-02-10T05:41:04Z Shutdown: In progress...
2019-02-10T05:41:04Z addcon thread exit
2019-02-10T05:41:04Z opencon thread exit
2019-02-10T05:41:04Z torcontrol thread exit
2019-02-10T05:41:04Z net thread exit
2019-02-10T05:41:04Z msghand thread exit
2019-02-10T05:41:04Z scheduler thread interrupt
2019-02-10T05:41:06Z [default wallet] Releasing wallet
2019-02-10T05:41:06Z Shutdown: done
----

Does anyone have an idea? Thank you!

Hi,

Have you touched you external drive ? It mights just be a partition problem. Try to shutdown, remount your drive (specifying the right path to bitcoind). Don't forget to check the permissions, you'll surely mount the drive as root while bitcoind runs as another user. If it works then you should consider using fstab so the drive is always mounted in the same dir with the same permissions.

merc1er
Newbie
*
Offline Offline

Activity: 11
Merit: 3


View Profile WWW
February 10, 2019, 01:44:57 PM
 #6

delete the blocks and chainstate folders and restart bitcoind.

It restarted from the first block already, but i'm trying this one more time.

@darosior I changed ownership to `pi` and chmod-ed the hard drive mount. Does bitcoind use a specific user that I need to change to?

Also, note that I didn't specify a path to save the block chain to bitcoind - instead, the folder .bitcoin links to my drive.
darosior
Member
**
Online Online

Activity: 112
Merit: 119


View Profile WWW
February 10, 2019, 02:15:21 PM
 #7

delete the blocks and chainstate folders and restart bitcoind.

It restarted from the first block already, but i'm trying this one more time.

@darosior I changed ownership to `pi` and chmod-ed the hard drive mount. Does bitcoind use a specific user that I need to change to?

Also, note that I didn't specify a path to save the block chain to bitcoind - instead, the folder .bitcoin links to my drive.

`bitcoind` uses a specific user only if you specify it (for instance in a systemd service).

merc1er
Newbie
*
Offline Offline

Activity: 11
Merit: 3


View Profile WWW
February 10, 2019, 02:31:41 PM
 #8

Thank you! I didn't specify such thing.

It's now re-syncing (about 2%). Let's see if it goes through.
merc1er
Newbie
*
Offline Offline

Activity: 11
Merit: 3


View Profile WWW
February 10, 2019, 06:48:30 PM
 #9

It stopped with the following at the end of `debug.log`:

---
2019-02-10T15:18:11Z UpdateTip: new best=00000000000000249597632a2fe08578cd1d2c0f620342ca91c3611786fe464f height=232591 version=0x00000002 log2_work=69.838772 tx=16550595 date='2013-04-22T14:31:02Z' progress=0.044502 cache=597.4MiB(5216340txo)
2019-02-10T15:18:12Z Error: Out of memory. Terminating.
---

I rebooted the raspi and it went straight to recovery mode... I will start from scratch again and do the hardware checks mentioned above.
aliashraf
Hero Member
*****
Offline Offline

Activity: 728
Merit: 586


View Profile
February 10, 2019, 08:09:40 PM
 #10

It stopped with the following at the end of `debug.log`:

---
2019-02-10T15:18:11Z UpdateTip: new best=00000000000000249597632a2fe08578cd1d2c0f620342ca91c3611786fe464f height=232591 version=0x00000002 log2_work=69.838772 tx=16550595 date='2013-04-22T14:31:02Z' progress=0.044502 cache=597.4MiB(5216340txo)
2019-02-10T15:18:12Z Error: Out of memory. Terminating.
---

I rebooted the raspi and it went straight to recovery mode... I will start from scratch again and do the hardware checks mentioned above.

And please keep us informed, as mentioned above  Wink
darosior
Member
**
Online Online

Activity: 112
Merit: 119


View Profile WWW
February 10, 2019, 08:22:33 PM
 #11

It stopped with the following at the end of `debug.log`:

---
2019-02-10T15:18:11Z UpdateTip: new best=00000000000000249597632a2fe08578cd1d2c0f620342ca91c3611786fe464f height=232591 version=0x00000002 log2_work=69.838772 tx=16550595 date='2013-04-22T14:31:02Z' progress=0.044502 cache=597.4MiB(5216340txo)
2019-02-10T15:18:12Z Error: Out of memory. Terminating.
---

I rebooted the raspi and it went straight to recovery mode... I will start from scratch again and do the hardware checks mentioned above.

The synchronization seems to be too resource-incentive for a rpi. You might want to take a look to http://bitcoin.org/en/full-node#reduce-storage (there are options to reduce traffic too).

merc1er
Newbie
*
Offline Offline

Activity: 11
Merit: 3


View Profile WWW
February 10, 2019, 08:51:48 PM
 #12

You might want to take a look to http://bitcoin.org/en/full-node#reduce-storage (there are options to reduce traffic too).

I do need to run an unpruned node as my goal is to run a lightning node  Lips sealed
darosior
Member
**
Online Online

Activity: 112
Merit: 119


View Profile WWW
February 10, 2019, 09:46:28 PM
Merited by nc50lc (1)
 #13

You might want to take a look to http://bitcoin.org/en/full-node#reduce-storage (there are options to reduce traffic too).

I do need to run an unpruned node as my goal is to run a lightning node  Lips sealed
Since v0.6, C-Lightning does support running on top of pruned nodes, and the doc I provided is not only for pruned nodes (for instance just lower the `dbcache` would reduce the RAM usage).

merc1er
Newbie
*
Offline Offline

Activity: 11
Merit: 3


View Profile WWW
February 11, 2019, 04:57:54 AM
Last edit: February 11, 2019, 07:25:49 PM by merc1er
 #14

Since v0.6, C-Lightning does support running on top of pruned nodes, and the doc I provided is not only for pruned nodes (for instance just lower the `dbcache` would reduce the RAM usage).

Oh that’s interesting! I will look into it, thank you.
Lauda
Legendary
*
Offline Offline

Activity: 2128
Merit: 1833


GUNBOT Licenses up to 50% OFF - 'GrumpyKitty'.


View Profile WWW
February 11, 2019, 08:45:57 AM
 #15

It stopped with the following at the end of `debug.log`:

---
2019-02-10T15:18:11Z UpdateTip: new best=00000000000000249597632a2fe08578cd1d2c0f620342ca91c3611786fe464f height=232591 version=0x00000002 log2_work=69.838772 tx=16550595 date='2013-04-22T14:31:02Z' progress=0.044502 cache=597.4MiB(5216340txo)
2019-02-10T15:18:12Z Error: Out of memory. Terminating.
---
I rebooted the raspi and it went straight to recovery mode... I will start from scratch again and do the hardware checks mentioned above.
Have you tried reducing the size of the cache?

.FORTUNE.JACK.
      ▄▄███████▄▄
   ▄████▀▀ ▄ ██████▄
  ████ ▄▄███ ████████
 █████▌▐███▌ ▀▄ ▀█████
███████▄██▀▀▀▀▄████████
█████▀▄▄▄▄█████████████
████▄▄▄▄ █████████████
 ██████▌ ███▀████████
  ███████▄▀▄████████
   ▀█████▀▀███████▀
      ▀▀██████▀▀
         
         █
...FortuneJack.com                                             
...THE BIGGEST BITCOIN GAMBLING SITE
       ▄▄█████████▄▄
    ▄█████████████████▄
  ▄█████████████████████▄
 ▄██
█████████▀███████████▄
██████████▀   ▀██████████
█████████▀       ▀█████████
████████           ████████
████████▄   ▄ ▄   ▄████████
██████████▀   ▀██████████
 ▀██
█████████████████████▀
  ▀██
███████████████████▀
    ▀█████████████████▀
       ▀▀█████████▀▀
#JACKMATE
WIN 1 BTC
▄█████████████████████████▄
███████████████████████████
███████████████████████████
██████████▀█████▀██████████
███████▀░░▀░░░░░▀░░▀███████
██████▌░░░░░░░░░░░░░▐██████
██████░░░░██░░░██░░░░██████
█████▌░░░░▀▀░░░▀▀░░░░▐█████
██████▄░░▄▄▄░░░▄▄▄░░▄██████
████████▄▄███████▄▄████████

███████████████████████████
███████████████████████████
▀█████████████████████████▀
ETFbitcoin
Legendary
*
Offline Offline

Activity: 1596
Merit: 1553

Use SegWit and enjoy lower fees.


View Profile WWW
February 11, 2019, 04:17:34 PM
 #16

It stopped with the following at the end of `debug.log`:

---
2019-02-10T15:18:11Z UpdateTip: new best=00000000000000249597632a2fe08578cd1d2c0f620342ca91c3611786fe464f height=232591 version=0x00000002 log2_work=69.838772 tx=16550595 date='2013-04-22T14:31:02Z' progress=0.044502 cache=597.4MiB(5216340txo)
2019-02-10T15:18:12Z Error: Out of memory. Terminating.
---

I rebooted the raspi and it went straight to recovery mode... I will start from scratch again and do the hardware checks mentioned above.


Try follow Pieter Wuille advice at http://bitcoin.stackexchange.com/a/50743, the one who ask the question also use Pi, so it should able to fix lack of memory problem

If it's still doesn't fix your problem, you could try using pagefile/file-swap as last solution

merc1er
Newbie
*
Offline Offline

Activity: 11
Merit: 3


View Profile WWW
February 13, 2019, 07:38:27 PM
Last edit: February 13, 2019, 08:24:25 PM by merc1er
Merited by Jet Cash (2)
 #17

Okay so I am giving it another try with the following parameters:

Code:
bitcoind -daemon -maxmempool=100 -dbcache=200 -maxsigcachesize=4

I tried with -dbcache set to 50 but the verification progress (syncing) was way too slow!

It seems to be syncing a bit slower than before with the current parameters but let's hope it keeps the RAM usage below 80%.
merc1er
Newbie
*
Offline Offline

Activity: 11
Merit: 3


View Profile WWW
February 14, 2019, 07:18:32 AM
 #18

So it has been syncing overnight and I am now at 11%.

Bitcoind RAM usage remains at about 50% (500MB). Looks like it's working! Thank you for the support.  Wink
ETFbitcoin
Legendary
*
Offline Offline

Activity: 1596
Merit: 1553

Use SegWit and enjoy lower fees.


View Profile WWW
February 14, 2019, 05:20:31 PM
 #19

It's very slow IMO, but i guess it's better than can't sync properly.

Depending on percentage free RAM, you could increase dbcache or/and maxsigcachesize number slightly (between 5-25%) if you want faster sync and prepare to take risks. If you have PC/notebook, you could sync from it and on Pi you just need to wait for block verification.

merc1er
Newbie
*
Offline Offline

Activity: 11
Merit: 3


View Profile WWW
February 15, 2019, 07:12:13 AM
 #20

It's very slow IMO, but i guess it's better than can't sync properly.

Depending on percentage free RAM, you could increase dbcache or/and maxsigcachesize number slightly (between 5-25%) if you want faster sync and prepare to take risks. If you have PC/notebook, you could sync from it and on Pi you just need to wait for block verification.


Indeed, 17% after 2 days. I increased -dbcache by 25% but RAM went over 95%.
I will be playing with the arguments to reach a faster stable syncing.
Pages: [1]
  Print  
 
Jump to:  

Bitcointalk.org is not available or authorized for sale. Do not believe any fake listings.
Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!