Commit Graph

1603 Commits

Author SHA1 Message Date
Mike Dilger
4e6dab17aa Stop trying to load events from the database at startup - we access it directly now 2023-07-31 17:37:53 +12:00
Mike Dilger
edc2ef490f lmdb: Switch to lmdb relationships map [plus code adjustments to make migration work] 2023-07-31 17:37:53 +12:00
Mike Dilger
4209062517 lmdb: event_relationships: Create Database, Migration to process all event relationships 2023-07-31 17:37:53 +12:00
Mike Dilger
0d3483bf29 lmdb: Finish switching to lmdb for events 2023-07-31 17:37:53 +12:00
Mike Dilger
02984ae1ef storage.find_events() performs more efficient scanning of lmdb events 2023-07-31 17:37:53 +12:00
Mike Dilger
3ef5f7a49e lmdb: Partial switching to lmdb for events 2023-07-31 17:37:53 +12:00
Mike Dilger
5b587c9803 Finish replacing DbEvent 2023-07-31 17:37:53 +12:00
Mike Dilger
6d4269b4ca Speed up search with less deserialization 2023-07-31 17:37:53 +12:00
Mike Dilger
49e7942f0b lmdb: search_event() 2023-07-31 17:37:53 +12:00
Mike Dilger
6b537dc431 Settings::feed_displayable_event_kinds() 2023-07-31 17:37:53 +12:00
Mike Dilger
c3ae6b6775 Error: handle regex::Error 2023-07-31 17:37:53 +12:00
Mike Dilger
36148316ea lmdb: temporary fetch_reply_related_events() and fetch_relay_lists() 2023-07-31 17:37:53 +12:00
Mike Dilger
692fc72425 Partial retiring of DbEvent to use nostr_types::Event with LMDB 2023-07-31 17:37:53 +12:00
Mike Dilger
c40f381971 lmdb: event: Create Database and Import from SQLite 2023-07-31 17:37:53 +12:00
Mike Dilger
4bc1918f75 lmdb: event_tags: Switch to LMDB 2023-07-31 17:37:53 +12:00
Mike Dilger
98dda51c97 lmdb: event_tags: Create Database and Import from SQLite 2023-07-31 17:37:53 +12:00
Mike Dilger
33d0315e87 lmdb: relay: Switch to LMDB [Large with additional changes] 2023-07-31 17:37:53 +12:00
Mike Dilger
7bb0d9a703 lmdb: relay: Create Database and Import from SQLite 2023-07-31 17:37:53 +12:00
Mike Dilger
dc5d5783a4 lmdb: event_hashtags: Switch to LMDB 2023-07-31 17:37:53 +12:00
Mike Dilger
ce99b47835 lmdb: event_hashtags: Create Database and Import from SQLite 2023-07-31 17:37:53 +12:00
Mike Dilger
72b60f8a19 lmdb: event_flags: Switch to LMDB 2023-07-31 17:37:53 +12:00
Mike Dilger
06326ac91e lmdb: event_flags: Create Database and Import from SQLite 2023-07-31 17:37:53 +12:00
Mike Dilger
3c5ef55fd9 lmdb: key! macro (to avoid LMDB errors with keys longer than 511 bytes) 2023-07-31 17:37:53 +12:00
Mike Dilger
0663477f3a lmdb: event_relay: Switch to LMDB 2023-07-31 17:37:53 +12:00
Mike Dilger
ff8db47f7c lmdb: event_relay: Create Database and Import from SQLite 2023-07-31 17:37:53 +12:00
Mike Dilger
3adab6531e lmdb: MAX_LMDB_KEY = 511 2023-07-31 17:37:53 +12:00
Mike Dilger
b613f92486 lmdb: settings: Switch to LMDB 2023-07-31 17:37:53 +12:00
Mike Dilger
803060b091 lmdb: settings: Create Database and Import from SQLite 2023-07-31 17:37:53 +12:00
Mike Dilger
2fdba6c362 lmdb: local settings: last_contact_list_edit: Switch to LMDB 2023-07-31 17:37:53 +12:00
Mike Dilger
6927584cae lmdb: local settings: EncyptedPrivateKey: Switch to LMDB 2023-07-31 17:37:53 +12:00
Mike Dilger
da0d254c74 lmdb: local settings: Create Database and Import from SQLite 2023-07-31 17:37:53 +12:00
Mike Dilger
54b1d9e19e lmdb: Setup for importing into LMDB 2023-07-31 17:37:53 +12:00
Mike Dilger
972c4d4506 lmdb: Setup LMDB when creating Storage 2023-07-31 17:37:53 +12:00
Mike Dilger
a917b5cde5 lmdb: Add lmdb dir to profile 2023-07-31 17:37:53 +12:00
Mike Dilger
2a30c38b85 lmdb: storage module 2023-07-31 17:37:53 +12:00
Mike Dilger
db8d123349 Handle several stdlib errors we will soon encounter 2023-07-31 17:37:53 +12:00
Mike Dilger
f1953063ea Handle errors from lmdb and speedy 2023-07-31 17:37:53 +12:00
Mike Dilger
955d25d61a Derive speedy serialization traits where we can (and serde where we missed) for stored data 2023-07-31 17:37:53 +12:00
Mike Dilger
675d19b5f3 Depend on speedy 2023-07-31 17:37:53 +12:00
Mike Dilger
e1cdd2c602 depend on lmdb-rkv 2023-07-31 17:37:53 +12:00
Mike Dilger
768022a1c2 Allow data_dir/gossip to be a symlink 2023-07-31 10:57:05 +12:00
Mike Dilger
9740c0bcbf Fetcher loop honors shutdown flag; shorter timeouts to keep moving 2023-07-29 13:22:24 +12:00
Mike Dilger
8adbcf6623 fetcher: cleanup some, and use stale cached data if the fetch for refreshing fails, fetch in parallel 2023-07-28 13:29:14 +12:00
Mike Dilger
accc0ab6b8 Use async-friendly tokio::fs in async code 2023-07-28 07:28:04 +12:00
Mike Dilger
aafe115c92 fetcher: Maintain a per-host load count, don't allow more than 3 in-flight to any single host 2023-07-27 19:41:57 +12:00
Mike Dilger
c19e88507b Fetcher reworked 2023-07-27 16:12:35 +12:00
Mike Dilger
11760790c1 depend on filetime 2023-07-27 16:12:35 +12:00
Mike Dilger
f532b75d40 Don't echo the "Done picking relays" results as info (do as debug) 2023-07-27 16:12:35 +12:00
Michael Dilger
0758eb7c1f
Merge pull request #435 from dtonon/fix/cut-nip11-output-on-parse
Keep only the first 10 output lines when unable to parse NIP-11
2023-07-27 13:52:00 +12:00
Mike Dilger
c880465665 Consider relay disconnection errors significant enough to penalty-box them
related to #433, improves that situation
2023-07-27 08:14:08 +12:00