2065 Commits

Author	SHA1	Message	Date
Jackson Harper	ed7ac6c1b4	Fix typo in lifecycle endpoint path	2024-02-01 20:25:52 +08:00
Jackson Harper	7f4f7c6a80	Merge pull request #3479 from omnivore-app/fix/queue-processor-lifecycle-hook ... Implement a lifecycle hook for queue processor so it can shut down gracefully	2024-02-01 17:01:11 +08:00
Hongbo Wu	8ac696e87d	Merge pull request #3480 from omnivore-app/fix/mark-read-action ... fix: update reading progress in cache when mark as read action was triggered by a rule	2024-02-01 16:56:21 +08:00
Hongbo Wu	252443f1e4	fix: update reading progress in cache when mark as read action was triggered in a rule	2024-02-01 16:45:08 +08:00
Jackson Harper	0e9e331e18	Implement a lifecycle hook for queue processor so it can shut down gracefully	2024-02-01 16:43:57 +08:00
Jackson Harper	3feef7ca66	Use the DB stored reading progress when calculating maxes	2024-02-01 16:23:21 +08:00
Jackson Harper	f03b7182b3	Merge pull request #3460 from omnivore-app/feat/reading-progress-write-behind ... Write behind cache for reading progress	2024-02-01 14:43:45 +08:00
Hongbo Wu	abaf726044	revert the change of priority	2024-02-01 13:22:06 +08:00
Hongbo Wu	19fe60d27a	change the update-db job priority to 5 and use exponential backoff strategy for retrying	2024-02-01 13:14:01 +08:00
Hongbo Wu	e13c418389	remove the inner join with highlights table in the sql of update-label job	2024-02-01 13:09:50 +08:00
Jackson Harper	02c28be403	reduce unction is no longer async	2024-02-01 11:24:13 +08:00
Jackson Harper	792f13edfc	Remove async from non-async function	2024-02-01 10:49:48 +08:00
Jackson Harper	1b44cb860b	Function for cron jobs dont include queue in the read position metrics since its not part of that queue	2024-02-01 10:33:51 +08:00
Jackson Harper	7d6645b87a	Rebase	2024-02-01 10:02:38 +08:00
Jackson Harper	570b7a4b78	Use a set in redis and push items to the set ... This lets us grab all available items, apply them, and then remove them from the set. Once completed the items that were applied can be removed from the set, if any new items were added during that time they wont be effected.	2024-02-01 09:59:42 +08:00
Jackson Harper	3ecbd3f434	Need to force this test to overwrite the cached value	2024-02-01 09:59:42 +08:00
Jackson Harper	0e37bfa03d	We need to update readAt because that isnt resolved from the cache	2024-02-01 09:59:42 +08:00
Jackson Harper	c47a720fe4	Do not cache on write, so the most updated item is always available on read ... This is mostly an issue on tests where all the queries can be run in a single process, but if we cache on write, it means the next read will just have the cached value, instead of the calculated maximum value.	2024-02-01 09:59:42 +08:00
Jackson Harper	bdf01ddaab	Clear cache on force, return updated read position values	2024-02-01 09:59:42 +08:00
Jackson Harper	a060aaf496	Make reading position parsing safer	2024-02-01 09:59:42 +08:00
Jackson Harper	9dc070243a	Revert temp	2024-02-01 09:59:41 +08:00
Jackson Harper	d8ea4ff1c5	Add reading position messages to exported metrics for queue processor	2024-02-01 09:59:41 +08:00
Jackson Harper	7bb3718a8f	Add job to sync read position data	2024-02-01 09:59:41 +08:00
Jackson Harper	a40f5bed55	Create a service for interacting with cached read positions	2024-02-01 09:59:41 +08:00
Jackson Harper	fbfa934479	Write behind reading progress as a list that can be reduced at commit or read time	2024-02-01 09:59:39 +08:00
Jackson Harper	c2327781e1	Remove empty ctor	2024-02-01 09:57:11 +08:00
Jackson Harper	86c80d991f	Write behing cache for reading progress	2024-02-01 09:57:11 +08:00
Hongbo Wu	c3276fdaf1	Merge pull request #3466 from omnivore-app/fix/rewrite-trigger-functions-in-db ... create a job for db trigger	2024-01-31 19:47:45 +08:00
Hongbo Wu	6d5ce451ac	fix bulk action	2024-01-31 19:24:18 +08:00
Hongbo Wu	1b8111b907	wait until all jobs are done in test	2024-01-31 19:10:57 +08:00
Hongbo Wu	5e883cb2ba	running worker in the test	2024-01-31 17:45:49 +08:00
Hongbo Wu	cf898299e4	some lint	2024-01-31 14:18:34 +08:00
Hongbo Wu	5646413b59	add a job for updating highlight annotations in library_item	2024-01-31 14:15:33 +08:00
Hongbo Wu	43855247b8	update bulk action to add labels	2024-01-31 13:56:56 +08:00
Hongbo Wu	5ed35bbeff	create a job for update labels in library item	2024-01-31 13:32:37 +08:00
Hongbo Wu	ddddf8234e	create a job for db trigger	2024-01-30 23:53:05 +08:00
Hongbo Wu	36d2c21466	remove thumbnail job on complete or failure	2024-01-30 18:24:48 +08:00
Hongbo Wu	2eedba1522	fix: assign the rule job with priority 1 and do not retry	2024-01-30 18:14:34 +08:00
Hongbo Wu	e724bbd465	fallback to worker redis client if fetched content not found in cache	2024-01-30 12:27:45 +08:00
Hongbo Wu	8d8309d3bb	fix: empty client request id in save-page job data when saving pdf in rss item	2024-01-29 21:22:26 +08:00
Hongbo Wu	5faa24556e	fix: string interpolation in logs	2024-01-29 19:11:26 +08:00
Hongbo Wu	809c572ca7	reduce the size of the log entry by truncating any string values to 500 characters	2024-01-29 14:32:45 +08:00
Hongbo Wu	d5d581fc54	remove redundant logs	2024-01-29 14:32:43 +08:00
Hongbo Wu	0181a2bfcd	Merge pull request #3446 from omnivore-app/fix/refresh-feed ... fix: add rss label and feed url to the pdf in rss feed item	2024-01-29 14:21:08 +08:00
Hongbo Wu	58d384f4f6	fix pdf saving	2024-01-29 14:11:07 +08:00
Hongbo Wu	4f061546bf	remove api call to upload file request	2024-01-29 12:55:19 +08:00
Hongbo Wu	a2bdddf8c9	fix tests	2024-01-29 12:30:31 +08:00
Hongbo Wu	738f85923c	Merge pull request #3442 from omnivore-app/fix/rule-handler ... move trigger rule into a job	2024-01-29 12:20:21 +08:00
Hongbo Wu	ac5acf7f21	fix: add rss label and feed url to the pdf in rss feed item	2024-01-26 22:34:55 +08:00
Hongbo Wu	fd80724d79	fallback to guid if link of rss item is not available	2024-01-26 22:09:53 +08:00