Commit Graph

9228 Commits

Author SHA1 Message Date
a03eee5ef7 fix dependecies 2024-01-18 18:48:46 +08:00
d9feb740cb convert content-fetch to typescript 2024-01-18 18:48:46 +08:00
cd3402b98a rewrite puppeteer in typescript 2024-01-18 18:48:46 +08:00
51e586ed3d separate content-fetch in puppeteer packages from saving page content 2024-01-18 18:48:46 +08:00
c297a8dd4e feat: group fetch content tasks by url 2024-01-18 18:48:46 +08:00
8a91a3c629 fix importer tests 2024-01-18 18:48:46 +08:00
3f163a99c7 Merge pull request #3389 from omnivore-app/fix/refresh-feed-api-url
Fix endpoint for internal refresh feed API call
2024-01-18 17:13:05 +08:00
3f707c06f2 Fix checks for env vars 2024-01-18 16:59:53 +08:00
3b0338967d Fix endpoint for internal refresh feed API call
This should eventually be replaced.
2024-01-18 16:48:45 +08:00
bffe31bcc7 Merge pull request #3359 from omnivore-app/feat/backend-bull-job-processor
Use bullmq to process jobs
2024-01-18 15:38:30 +08:00
6193c78288 Fix typo 2024-01-18 15:37:38 +08:00
7754139207 Remove debug 2024-01-18 15:33:51 +08:00
881a98eb86 Create new environment variables for tts redis 2024-01-18 14:57:35 +08:00
fb28d7b3d1 Enqueue new feeds at front 2024-01-18 14:34:07 +08:00
ee142d3d7c Handle SIGINT in server better by moving DB call to after redis shutdown 2024-01-18 12:00:13 +08:00
bb55137bb4 Disconnect one client while quitting the other 2024-01-18 11:39:41 +08:00
c800114045 Merge pull request #3385 from se-jaeger/main
Helm Chart for self-hosting
2024-01-18 11:29:50 +08:00
fa685d4a29 Tear down redis with disconnect instead of quit 2024-01-18 11:28:09 +08:00
d558fe2b17 fix tests 2024-01-18 11:24:26 +08:00
5a7056b7ec Dont fail whole job if we cant update a subscription group 2024-01-18 10:18:45 +08:00
97c1db6e42 minor improvements 2024-01-17 17:16:49 +01:00
1d4ebb5132 minor changes and docs 2024-01-17 17:15:56 +01:00
bce26b9e54 Merge branch 'omnivore-app:main' into main 2024-01-17 15:35:22 +01:00
65347a1996 Use quit when shutting down redis 2024-01-17 17:30:16 +08:00
fd81f65e53 Remove server.close call 2024-01-17 16:37:51 +08:00
9e6b749604 Update error message 2024-01-17 16:21:42 +08:00
e1e2f86219 Remove duplicated error 2024-01-17 16:20:42 +08:00
dc4126d52c REvert some unneeded env changes 2024-01-17 16:15:00 +08:00
361d57ac1d Remove secrets loading as this is handled by k8s now. Fix redis init 2024-01-17 13:33:20 +08:00
d1438fe800 Remove old code, clean up redis logging 2024-01-17 11:47:31 +08:00
4f23271f29 Remove some debug 2024-01-17 11:45:05 +08:00
7a925f3fdc Clean up redis code, remove connection close in job 2024-01-17 11:14:59 +08:00
d92ee4bcfe Clean up redis instantiation 2024-01-17 11:03:52 +08:00
68b7b93586 More logging 2024-01-17 10:42:38 +08:00
ec765c0f5c Some more logging 2024-01-17 10:21:19 +08:00
0936942378 Remove connect call 2024-01-16 23:32:53 +08:00
50b48a4225 Separate worker and client code for redis connections 2024-01-16 23:21:48 +08:00
c5e4e2216b Simplify connection options 2024-01-16 23:02:46 +08:00
49734efec7 Add logging 2024-01-16 22:43:06 +08:00
7c8304ac15 Fix client imports 2024-01-16 22:08:30 +08:00
7ee3866f34 Pull in the newer connection and retry strategy code 2024-01-16 22:04:19 +08:00
90a0455c36 Update job to use ioredis 2024-01-16 22:00:25 +08:00
fcf2d07c99 Update redis data source 2024-01-16 21:58:34 +08:00
8580398d6f Clean up post rebase 2024-01-16 21:35:46 +08:00
ba3e5b053d Cleanup after rebase 2024-01-16 21:31:44 +08:00
f184c8baff Fix path 2024-01-16 21:30:17 +08:00
84195f10c2 Fix endpoint 2024-01-16 21:30:17 +08:00
4df9b70c95 Fix for detecting environment 2024-01-16 21:30:17 +08:00
e050864a91 Add more debugging 2024-01-16 21:30:17 +08:00
9633e7df79 Update envar name 2024-01-16 21:30:17 +08:00