Raúl Kripalani
c123410c64
Merge pull request #47 from raulk/feat/pstore-ds-gc
...
pstoreds: migrate from strict TTL to GC-based expiry.
2019-02-22 14:43:47 +00:00
Raúl Kripalani
8db09c59cf
pstore.Close(): return errors from children.
2019-02-22 14:39:51 +00:00
Raúl Kripalani
4806c742b5
pstoreds: remove dirty flag when deleting from db.
2019-02-21 19:31:19 +00:00
Raúl Kripalani
87fab3950d
pstoreds: switch protobuf compilation to gogofaster.
2019-02-19 17:41:14 +00:00
Raúl Kripalani
c5e3e4d647
Merge branch 'master' into feat/pstore-ds-gc
2019-02-19 11:51:28 +00:00
Raúl Kripalani
135471f291
add io.Closer interface and implementation to Peerstore.
2019-02-19 11:45:32 +00:00
Jakub Sztandera
985bc5953b
gx publish 2.0.17
2019-02-18 18:45:40 +01:00
Raúl Kripalani
4e7d772db3
pstoreds: remove async flushing on read: now sync.
2019-02-18 16:35:48 +00:00
Jakub Sztandera
7e45a1ab22
gx publish 2.0.16
2019-02-18 15:13:52 +01:00
Jakub Sztandera
7bb755535b
gx publish 2.0.15
2019-02-18 15:03:04 +01:00
Raúl Kripalani
25f53120b8
gc: drain async flush queue with grace period before closing.
2019-02-15 18:44:05 +00:00
Raúl Kripalani
d7e9f78273
increment WaitGroups before spawning goroutines.
2019-02-15 18:43:34 +00:00
Steven Allen
904d93c0f5
gx publish 2.0.14
2019-02-07 15:27:51 -08:00
Raúl Kripalani
86f1626c51
fix tests; run lookahead after initial delay.
2019-02-06 16:05:02 +00:00
Raúl Kripalani
5d5a55baa5
update go-datastore, go-ds-leveldb, go-ds-badger.
2019-02-06 16:05:02 +00:00
Raúl Kripalani
25e4df45aa
change default purge interval to 2 hours.
2019-02-06 14:43:10 +00:00
Raúl Kripalani
e16cac9f5e
make addrsRecord.Clean() private.
2019-02-06 14:40:51 +00:00
Raúl Kripalani
3966498df4
improve docs; cyclic batch arg; validations.
2019-02-06 14:36:51 +00:00
Raúl Kripalani
fec786e9ef
pstore ds: make gc lookahead window optional.
2019-02-06 09:35:10 +00:00
Raúl Kripalani
9da98d7fcf
factor out cyclic batch into file; and gc into type.
2019-02-05 17:53:50 +00:00
Raúl Kripalani
20a0dc649d
adopt new ds.Write interface.
2019-02-05 16:53:23 +00:00
Raúl Kripalani
d88042c422
improve code readability.
2019-02-05 16:52:27 +00:00
Raúl Kripalani
0baddf577e
Merge branch 'master' into feat/pstore-ds-gc
2019-02-05 16:15:11 +00:00
Raúl Kripalani
1e2fd43772
Merge pull request #52 from raulk/master
...
Add unit test to verify AddAddr doesn't shorten TTL
2019-02-05 15:09:02 +00:00
Raúl Kripalani
f0eb25b3c5
pstore ds: enforce order in gc queries.
2019-02-05 15:07:30 +00:00
Raúl Kripalani
6959c64874
add unit test to verify AddAddr doesn't shorten TTL.
2019-01-23 13:13:11 +00:00
Hector Sanjuan
99108065a0
Merge pull request #50 from libp2p/update/manet
...
gx publish 2.0.13
2018-12-18 18:34:47 +01:00
Hector Sanjuan
23d213ec8c
gx publish 2.0.13
2018-12-18 18:22:44 +01:00
Steven Allen
0ef521ea9d
gx publish 2.0.12
2018-12-07 14:34:08 -08:00
Steven Allen
3bee9fde6a
Merge pull request #49 from libp2p/fix/disable-inline-pid-test
...
disable inline-peer id test
2018-12-07 13:51:25 -08:00
Steven Allen
f32bc1c26d
disable inline-peer id test
2018-12-07 13:47:26 -08:00
Raúl Kripalani
fd9c9287e2
return error when committing a closed cyclic batch.
2018-12-04 11:47:44 +00:00
Raúl Kripalani
53d45e9406
make gc operations run on cyclic batches.
2018-12-03 17:40:01 +00:00
Raúl Kripalani
a306a6eadb
add a benchmark for lookahead cycles.
2018-12-03 15:54:41 +00:00
Raúl Kripalani
e43a2fc519
drop the need for a transactional datastore; introduce buffer pool.
2018-12-03 15:43:37 +00:00
Raúl Kripalani
8fa350be35
fix raciness in init logic; dedicated goroutines for GC and flushing.
2018-11-30 17:32:51 +00:00
Raúl Kripalani
19eea773fa
rename addrsRecord.Refresh() => addrsRecord.Clean().
2018-11-30 16:56:37 +00:00
Raúl Kripalani
943429ff4b
Revert "use a Pool for address record objects."
2018-11-30 16:19:57 +00:00
Raúl Kripalani
dd2a07ea4a
Revert "gx: update golang-lru dependency."
...
This reverts commit c7107ffb52
2018-11-30 16:19:57 +00:00
Raúl Kripalani
fd57c55d87
document custom gogo types; reorg code.
2018-11-30 16:19:57 +00:00
Raúl Kripalani
c3c24b227a
rename GCPruneInterval to GCPurgeInterval for consistency.
2018-11-28 01:29:09 +00:00
Raúl Kripalani
bbff6b7522
improve test coverage of new GC routine.
2018-11-28 01:08:25 +00:00
Raúl Kripalani
ffe9586203
codecov: ignore protobuf go sources.
2018-11-28 00:57:08 +00:00
Raúl Kripalani
03a40a855a
minor cleanup.
2018-11-28 00:56:51 +00:00
Raúl Kripalani
3a85498ae8
add tests for new GC routines.
2018-11-28 00:13:13 +00:00
Raúl Kripalani
35444fbc6a
implement two-tiered lookahead-based GC procedure.
...
The GC procedure consists of two tiers: lookahead and purge. The
lookahead tier runs less frequently (default 12 hours) than the purge
tier (default 5 minutes).
A lookahead round traverses the entire store and picks entries that
need to be visited in the current lookahead window, pinning those
entries in a separate region in the KV store, indexed by the next visit
timestamp.
A purge round iterates over the lookahead window only, and refreshes
the entries that require a visit. It removes them from the lookahead
region unless the entry requires another visit within the current
window.
2018-11-28 00:13:02 +00:00
Raúl Kripalani
87b51603b1
Merge pull request #48 from anshukla/master
...
README: Update contributing guideline linkrot.
2018-11-26 12:11:22 +00:00
Ansh Shukla
eb26a53a64
README: Update contributing guideline linkrot.
2018-11-25 12:45:28 -08:00
Raúl Kripalani
c7107ffb52
gx: update golang-lru dependency.
2018-11-16 11:11:00 +00:00
Raúl Kripalani
ef8e8ff359
use a Pool for address record objects.
2018-11-15 18:48:40 +00:00
