Commit Graph

1586 Commits

Author SHA1 Message Date
Mike Dilger
b08fedf8b8 Update for nostr-types change 2023-08-01 09:17:31 +12:00
Mike Dilger
13dba14744 update nostr-types 2023-08-01 09:16:26 +12:00
Mike Dilger
b3fa700ebf Implement indices, first pass 2023-07-31 19:56:19 +12:00
Mike Dilger
817ad52dd4 cargo fmt & clippy 2023-07-31 17:52:31 +12:00
Mike Dilger
3f89799630 Describe how to shrink the LMDB files in the prune help. 2023-07-31 17:49:26 +12:00
Mike Dilger
53130bb83b Fix prune 2023-07-31 17:46:44 +12:00
Mike Dilger
b74f9c1178 Sync LMDB when shutting down, just in case 2023-07-31 17:46:44 +12:00
Mike Dilger
86356ccccf Be more consistent about how LMDB keys/values are handled 2023-07-31 17:46:44 +12:00
Mike Dilger
31e4ce8108 storage.prune(from_when) 2023-07-31 17:46:44 +12:00
Mike Dilger
ced0c6b46d Disable sync during import and migration 1 2023-07-31 17:46:44 +12:00
Mike Dilger
1b77897376 Depend on lmdb-rkv-sys 2023-07-31 17:46:44 +12:00
Mike Dilger
3c07cc3d96 lmdb: turn sync back on, will sync on each commit 2023-07-31 17:42:41 +12:00
Mike Dilger
cc0c646a9f Mark migration as done after importing 2023-07-31 17:37:53 +12:00
Mike Dilger
c6428f02fc Log progress during LMDB import 2023-07-31 17:37:53 +12:00
Mike Dilger
7b2045113b Strip out the database connection 2023-07-31 17:37:53 +12:00
Mike Dilger
ddfc75a238 Strip back SQLite startup - don't upgrade anymore, just create the connection 2023-07-31 17:37:53 +12:00
Mike Dilger
161d9ddbce lmdb: switch to LMDB for person_relay 2023-07-31 17:37:53 +12:00
Mike Dilger
cdc4405da9 lmdb: person_relay: Create Database and Import from SQLite 2023-07-31 17:37:53 +12:00
Mike Dilger
cacd405db4 Change types/names of fields in PersonRelay 2023-07-31 17:37:53 +12:00
Mike Dilger
05ed0ce430 move PersonRelay out of db/ module 2023-07-31 17:37:53 +12:00
Mike Dilger
b72cf26049 fix pubkey rendering 2023-07-31 17:37:53 +12:00
Mike Dilger
a0f6c19125 Move relay.rs from /db to / 2023-07-31 17:37:53 +12:00
Mike Dilger
4b8316de4d Rename DbRelay -> Relay 2023-07-31 17:37:53 +12:00
Mike Dilger
add7c99303 Load last contact list data at startup so we have data on the people-followed page 2023-07-31 17:37:53 +12:00
Mike Dilger
162c1e0727 When importing settings, force setting for feed refresh interval to at least 5 seconds while LMDB is slow 2023-07-31 17:37:53 +12:00
Mike Dilger
93fddc6cf0 lmdb: switch to LMDB for person 2023-07-31 17:37:53 +12:00
Mike Dilger
a0e28fbcfc lmdb: person: Create Database and Import from SQLite 2023-07-31 17:37:53 +12:00
Mike Dilger
7cd7c2362a Dispense with Person.loaded 2023-07-31 17:37:53 +12:00
Mike Dilger
69d0f98d7d Fix bool data types in struct Person 2023-07-31 17:37:53 +12:00
Mike Dilger
6b43ae7558 Major rework away from PublicKeyHex towards using PublicKey instead. NOTES:
We plan to switch to a different secp256k1 library soon, at which point this PublicKey will
become interoperable again, e.g. in gossip-relay-picker
2023-07-31 17:37:53 +12:00
Mike Dilger
f5538f4476 update gossip-relay-picker (operate on PublicKey instead of PublicKeyHex) 2023-07-31 17:37:53 +12:00
Mike Dilger
344ef0d041 Renames: DbPerson->Person, DbPersonRelay->PersonRelay 2023-07-31 17:37:53 +12:00
Mike Dilger
3d0ec5af81 lmdb: retire EventRelay 2023-07-31 17:37:53 +12:00
Mike Dilger
4e6dab17aa Stop trying to load events from the database at startup - we access it directly now 2023-07-31 17:37:53 +12:00
Mike Dilger
edc2ef490f lmdb: Switch to lmdb relationships map [plus code adjustments to make migration work] 2023-07-31 17:37:53 +12:00
Mike Dilger
4209062517 lmdb: event_relationships: Create Database, Migration to process all event relationships 2023-07-31 17:37:53 +12:00
Mike Dilger
0d3483bf29 lmdb: Finish switching to lmdb for events 2023-07-31 17:37:53 +12:00
Mike Dilger
02984ae1ef storage.find_events() performs more efficient scanning of lmdb events 2023-07-31 17:37:53 +12:00
Mike Dilger
3ef5f7a49e lmdb: Partial switching to lmdb for events 2023-07-31 17:37:53 +12:00
Mike Dilger
5b587c9803 Finish replacing DbEvent 2023-07-31 17:37:53 +12:00
Mike Dilger
6d4269b4ca Speed up search with less deserialization 2023-07-31 17:37:53 +12:00
Mike Dilger
49e7942f0b lmdb: search_event() 2023-07-31 17:37:53 +12:00
Mike Dilger
6b537dc431 Settings::feed_displayable_event_kinds() 2023-07-31 17:37:53 +12:00
Mike Dilger
c3ae6b6775 Error: handle regex::Error 2023-07-31 17:37:53 +12:00
Mike Dilger
36148316ea lmdb: temporary fetch_reply_related_events() and fetch_relay_lists() 2023-07-31 17:37:53 +12:00
Mike Dilger
692fc72425 Partial retiring of DbEvent to use nostr_types::Event with LMDB 2023-07-31 17:37:53 +12:00
Mike Dilger
c40f381971 lmdb: event: Create Database and Import from SQLite 2023-07-31 17:37:53 +12:00
Mike Dilger
4bc1918f75 lmdb: event_tags: Switch to LMDB 2023-07-31 17:37:53 +12:00
Mike Dilger
98dda51c97 lmdb: event_tags: Create Database and Import from SQLite 2023-07-31 17:37:53 +12:00
Mike Dilger
33d0315e87 lmdb: relay: Switch to LMDB [Large with additional changes] 2023-07-31 17:37:53 +12:00