core, eth/downloader: commit block data using batches (#15115)
* ethdb: add Putter interface and Has method * ethdb: improve docs and add IdealBatchSize * ethdb: remove memory batch lock Batches are not safe for concurrent use. * core: use ethdb.Putter for Write* functions This covers the easy cases. * core/state: simplify StateSync * trie: optimize local node check * ethdb: add ValueSize to Batch * core: optimize HasHeader check This avoids one random database read get the block number. For many uses of HasHeader, the expectation is that it's actually there. Using Has avoids a load + decode of the value. * core: write fast sync block data in batches Collect writes into batches up to the ideal size instead of issuing many small, concurrent writes. * eth/downloader: commit larger state batches Collect nodes into a batch up to the ideal size instead of committing whenever a node is received. * core: optimize HasBlock check This avoids a random database read to get the number. * core: use numberCache in HasHeader numberCache has higher capacity, increasing the odds of finding the header without a database lookup. * core: write imported block data using a batch Restore batch writes of state and add blocks, tx entries, receipts to the same batch. The change also simplifies the miner. This commit also removes posting of logs when a forked block is imported. * core: fix DB write error handling * ethdb: use RLock for Has * core: fix HasBlock comment
Showing
- cmd/utils/cmd.go 1 addition, 1 deletioncmd/utils/cmd.go
- core/blockchain.go 97 additions, 127 deletionscore/blockchain.go
- core/database_util.go 25 additions, 28 deletionscore/database_util.go
- core/headerchain.go 8 additions, 5 deletionscore/headerchain.go
- core/state/sync.go 3 additions, 39 deletionscore/state/sync.go
- eth/api.go 1 addition, 1 deletioneth/api.go
- eth/downloader/downloader.go 4 additions, 4 deletionseth/downloader/downloader.go
- eth/downloader/downloader_test.go 1 addition, 1 deletioneth/downloader/downloader_test.go
- eth/downloader/statesync.go 40 additions, 37 deletionseth/downloader/statesync.go
- eth/handler.go 2 additions, 2 deletionseth/handler.go
- ethdb/database.go 20 additions, 4 deletionsethdb/database.go
- ethdb/interface.go 16 additions, 2 deletionsethdb/interface.go
- ethdb/memory_database.go 14 additions, 7 deletionsethdb/memory_database.go
- les/handler.go 1 addition, 1 deletionles/handler.go
- light/lightchain.go 4 additions, 4 deletionslight/lightchain.go
- miner/worker.go 7 additions, 14 deletionsminer/worker.go
- trie/sync.go 2 additions, 3 deletionstrie/sync.go
- trie/trie.go 1 addition, 0 deletionstrie/trie.go
Loading
Please register or sign in to comment