Commit Graph

1950 Commits

Author SHA1 Message Date
1898e32607 Use service instead of API to update subscription 2024-01-20 13:27:54 +08:00
e5dec228f3 Remove some debug 2024-01-20 12:46:22 +08:00
4eeb012b78 Pass lits of fetchContentTasks into rss handlers
This prevents the list from growing on each run
2024-01-20 11:36:14 +08:00
2b536c6086 Add more debug 2024-01-20 10:48:57 +08:00
52050728ba Add more debugging logs 2024-01-20 10:29:07 +08:00
f4af4593c2 Fix debug line 2024-01-20 10:04:54 +08:00
4c1a182c7f Add a refresh context to make debugging refresh runs easier 2024-01-20 09:50:21 +08:00
2961f69f02 Add a refresh context to make debugging rss jobs easier 2024-01-20 09:47:46 +08:00
a9eeda9369 Remove non-useful logging line 2024-01-20 09:23:45 +08:00
e9f22bba43 Some debug 2024-01-20 09:09:25 +08:00
780cda6e4b use worker redis client when connect to the queue in queue-processor 2024-01-19 20:44:54 +08:00
338733829f Merge pull request #3394 from omnivore-app/fix/cache-content-fetched
fix/cache content fetched
2024-01-19 18:16:05 +08:00
356ad38678 reduce logs 2024-01-19 18:01:09 +08:00
4340286b89 add retry on failure in jobs 2024-01-19 17:38:25 +08:00
defb79d8c8 Use let instead of var 2024-01-19 17:12:34 +08:00
51d5166321 get cached content from redis when saving pages 2024-01-19 17:06:37 +08:00
8ba1242ffb Back off refresh-all-feeds if queue is very deep 2024-01-19 16:59:41 +08:00
d2491d3eb7 Reduce refresh-all-feeds priority 2024-01-19 16:59:15 +08:00
e06ff24cea Fix logging 2024-01-19 16:44:20 +08:00
02818d94a2 Adjust priorities 2024-01-19 16:37:57 +08:00
35805e6e8f use user provided url for feed added 2024-01-19 16:28:37 +08:00
84375b7c36 Add validation before refreshing feed URLs 2024-01-19 16:25:05 +08:00
2dbff6a6ab Add some more debug output 2024-01-19 16:12:44 +08:00
0e590e53a6 Improve RSS priorities for refreshing feeds 2024-01-19 16:12:22 +08:00
d135a7fe6a Merge pull request #3391 from omnivore-app/fix/content-fetch-dockerfile
fix: build content-fetch in dockerfile
2024-01-19 12:45:19 +08:00
3d42973c5f fix api endpint 2024-01-19 12:36:15 +08:00
f03766d05b Fix construction of service endpoint
NEed to fix how we construct all these
2024-01-19 12:29:50 +08:00
c2a084803a validate feed url before adding 2024-01-18 21:56:19 +08:00
d2c17f7539 graceful shutdown redis 2024-01-18 21:52:33 +08:00
3e291d1019 fix tests 2024-01-18 21:13:32 +08:00
d4f49dceb6 remove job id 2024-01-18 18:48:46 +08:00
a6f0e2f2d9 add save page job processor 2024-01-18 18:48:46 +08:00
8a3b50f07f do not create thumbnail task if the item already has a thumbnail 2024-01-18 18:48:46 +08:00
d9feb740cb convert content-fetch to typescript 2024-01-18 18:48:46 +08:00
3f707c06f2 Fix checks for env vars 2024-01-18 16:59:53 +08:00
3b0338967d Fix endpoint for internal refresh feed API call
This should eventually be replaced.
2024-01-18 16:48:45 +08:00
6193c78288 Fix typo 2024-01-18 15:37:38 +08:00
7754139207 Remove debug 2024-01-18 15:33:51 +08:00
fb28d7b3d1 Enqueue new feeds at front 2024-01-18 14:34:07 +08:00
ee142d3d7c Handle SIGINT in server better by moving DB call to after redis shutdown 2024-01-18 12:00:13 +08:00
bb55137bb4 Disconnect one client while quitting the other 2024-01-18 11:39:41 +08:00
fa685d4a29 Tear down redis with disconnect instead of quit 2024-01-18 11:28:09 +08:00
d558fe2b17 fix tests 2024-01-18 11:24:26 +08:00
5a7056b7ec Dont fail whole job if we cant update a subscription group 2024-01-18 10:18:45 +08:00
65347a1996 Use quit when shutting down redis 2024-01-17 17:30:16 +08:00
fd81f65e53 Remove server.close call 2024-01-17 16:37:51 +08:00
9e6b749604 Update error message 2024-01-17 16:21:42 +08:00
e1e2f86219 Remove duplicated error 2024-01-17 16:20:42 +08:00
dc4126d52c REvert some unneeded env changes 2024-01-17 16:15:00 +08:00
361d57ac1d Remove secrets loading as this is handled by k8s now. Fix redis init 2024-01-17 13:33:20 +08:00