14 Commits

Author	SHA1	Message	Date
Doug Hoyte	391f632b73	don't store receivedAt and source metadata	2024-09-04 23:12:00 -04:00
Doug Hoyte	058c97f856	use custom packing for indexable data: PackedEvent	2024-09-04 23:12:00 -04:00
Doug Hoyte	b3e59566c6	switch import to use WriterPipeline ... - This makes it do the verification and writing in parallel - Also, it will now flush periodically (default 1s) even if it has read fewer than N (default 10k) records from stdin. This lets import be used as a general-purpose non-relay event ingester. To do so, users must ensure that the stdout of their process they pipe into import is line buffered.	2023-09-26 16:03:09 -04:00
Doug Hoyte	aec8dbc33a	WriterPipeline clean shutdown	2023-08-16 13:31:25 -04:00
Doug Hoyte	ab03a57b18	stop WriterPipeline threads on shutdown	2023-07-27 17:50:07 -04:00
Doug Hoyte	89fe196242	backpressure for WriterPipeline	2023-06-05 11:39:21 -04:00
Doug Hoyte	799da2c016	bugfixes in sync	2023-06-05 11:37:55 -04:00
Doug Hoyte	09893b89c8	make sync command use negentropy	2023-05-04 14:32:21 -04:00
Doug Hoyte	0cbc937bf0	remove quadrable and yesstr	2023-04-29 15:20:04 -04:00
Doug Hoyte	67331a6e6f	simplify quadrable instance creation	2023-02-07 11:59:02 -05:00
Doug Hoyte	376d7cbf1f	track sources of events	2023-02-07 08:08:29 -05:00
Doug Hoyte	cf7f92451f	log connection compression status, bugfix	2023-01-20 14:17:00 -05:00
Doug Hoyte	8102cd6a00	sort batches of writes to reduce fragmentation	2023-01-20 12:33:28 -05:00
Doug Hoyte	c47d07e985	initial commit	2023-01-09 15:33:52 -05:00