Commit Graph

85 Commits

Author SHA1 Message Date
88e3d648c8 add a REST API to trigger the expire folder job 2024-06-13 18:36:33 +08:00
6f496b9336 add folder expiration jobs 2024-06-13 18:30:27 +08:00
9ef91ff1ca add an REST API to trigger the prune trash job 2024-06-13 14:48:14 +08:00
71d07caf94 run prune trash job at 3am UTC daily 2024-06-12 19:27:42 +08:00
f29592d671 worker can concurrently process 10 jobs 2024-06-12 18:40:08 +08:00
57695c370c monitor each job latency in prometheus 2024-06-12 13:35:04 +08:00
f052ab55a0 monitor home feed job latency in prometheus 2024-06-12 13:01:36 +08:00
76383d8a33 feat: generate preview content if excerpt less than 180 chars 2024-06-06 19:08:41 +08:00
efb7160373 rename just read feed to home 2024-05-27 21:11:08 +08:00
41b9fef316 score library item after saved 2024-05-27 11:45:51 +08:00
a48a614676 save just read feed in redis sorted set 2024-05-24 14:52:21 +08:00
01ebcbb16b add bulk upload original content job 2024-05-10 14:37:05 +08:00
14e91d338d do not create user profile and topics 2024-04-30 12:48:19 +08:00
2f7c18b363 add more logs 2024-04-23 15:50:15 +08:00
1b6f4976d3 remove timeout 2024-04-23 15:50:15 +08:00
de258ae0bf timeout if job takes more than 10 minutes 2024-04-23 15:50:15 +08:00
71477b1712 implement create digest job 2024-04-16 21:00:51 +08:00
03e497b489 use a separate queue for digest job 2024-04-16 21:00:26 +08:00
12aa7d4447 create digest job api 2024-04-16 21:00:10 +08:00
b4911639c7 stub create digest job 2024-04-16 21:00:09 +08:00
f66d3fa36c migrate inbound-email tasks from pubsub to bullmq 2024-04-11 11:08:22 +08:00
5f239d2dcb update graceful shutdown 2024-04-11 11:08:22 +08:00
8af2bb076c rename send mail functions 2024-04-05 16:59:20 +08:00
10dcb922f2 Enqueue confirmation email 2024-04-05 16:57:02 +08:00
b5bea17ffe Export the age of the oldest job in the queue 2024-03-28 10:25:44 +08:00
92abfed2df replace logger.warn with warning 2024-03-27 15:41:13 +08:00
390d12eea1 add export to integration and get task api 2024-03-21 11:14:23 +08:00
629c044273 Queue the transcript processing as a separate job
Handle YouTube in two steps, first get metadata then
get the transcript.
2024-03-14 15:09:53 +08:00
2dbd16a61e Pull duration and description from YouTube metadata 2024-03-14 12:48:56 +08:00
f7225b298a Rebase 2024-03-14 12:48:56 +08:00
d41459a5cd log unhandled error 2024-03-06 12:04:16 +08:00
bbe6204b91 summaries 2024-02-28 15:12:09 +08:00
fb576a58a0 initial export 2024-02-22 15:20:24 +08:00
f94267ee1a enqueue export job 2024-02-22 13:38:51 +08:00
ce19218e15 get queue priority from a table 2024-02-21 22:01:04 +08:00
cd311d6454 do not update db options in queue-processor 2024-02-20 19:09:33 +08:00
59d4d78f78 connection idle timeout in 10 seconds 2024-02-20 18:33:21 +08:00
485caec803 append job version to the job id 2024-02-07 18:42:10 +08:00
8c23cff17b remove limit on the sync reading progress job 2024-02-07 11:09:30 +08:00
95fabe1dbf keep completed jobs for up to 24 hours and failed jobs for 7 days 2024-02-06 14:21:00 +08:00
53f63b90d7 increase the seed valud of backoff delay to 2 seconds 2024-02-05 16:26:05 +08:00
25e374f6ff fix: replace webhook endpoint with a bullmq job 2024-02-02 16:18:40 +08:00
5e49131fc2 Merge pull request #3470 from omnivore-app/fix/async-bulk-action
async bulk action on item count > 100 and create batch jobs
2024-02-02 16:00:12 +08:00
26b7103f0b improve batch update 2024-02-02 13:13:18 +08:00
1bccf33320 add job_id and parent for tracking 2024-02-02 10:50:07 +08:00
ed7ac6c1b4 Fix typo in lifecycle endpoint path 2024-02-01 20:25:52 +08:00
702bd6c3c6 async bulk action on item count > 100 and create batch jobs 2024-02-01 17:44:30 +08:00
0e9e331e18 Implement a lifecycle hook for queue processor so it can shut down gracefully 2024-02-01 16:43:57 +08:00
1b44cb860b Function for cron jobs dont include queue in the read position metrics since its not part of that queue 2024-02-01 10:33:51 +08:00
7d6645b87a Rebase 2024-02-01 10:02:38 +08:00