Commit Graph

9208 Commits

Author SHA1 Message Date
3b0338967d Fix endpoint for internal refresh feed API call
This should eventually be replaced.
2024-01-18 16:48:45 +08:00
6193c78288 Fix typo 2024-01-18 15:37:38 +08:00
7754139207 Remove debug 2024-01-18 15:33:51 +08:00
881a98eb86 Create new environment variables for tts redis 2024-01-18 14:57:35 +08:00
fb28d7b3d1 Enqueue new feeds at front 2024-01-18 14:34:07 +08:00
ee142d3d7c Handle SIGINT in server better by moving DB call to after redis shutdown 2024-01-18 12:00:13 +08:00
bb55137bb4 Disconnect one client while quitting the other 2024-01-18 11:39:41 +08:00
fa685d4a29 Tear down redis with disconnect instead of quit 2024-01-18 11:28:09 +08:00
d558fe2b17 fix tests 2024-01-18 11:24:26 +08:00
5a7056b7ec Dont fail whole job if we cant update a subscription group 2024-01-18 10:18:45 +08:00
65347a1996 Use quit when shutting down redis 2024-01-17 17:30:16 +08:00
fd81f65e53 Remove server.close call 2024-01-17 16:37:51 +08:00
9e6b749604 Update error message 2024-01-17 16:21:42 +08:00
e1e2f86219 Remove duplicated error 2024-01-17 16:20:42 +08:00
dc4126d52c REvert some unneeded env changes 2024-01-17 16:15:00 +08:00
361d57ac1d Remove secrets loading as this is handled by k8s now. Fix redis init 2024-01-17 13:33:20 +08:00
d1438fe800 Remove old code, clean up redis logging 2024-01-17 11:47:31 +08:00
4f23271f29 Remove some debug 2024-01-17 11:45:05 +08:00
7a925f3fdc Clean up redis code, remove connection close in job 2024-01-17 11:14:59 +08:00
d92ee4bcfe Clean up redis instantiation 2024-01-17 11:03:52 +08:00
68b7b93586 More logging 2024-01-17 10:42:38 +08:00
ec765c0f5c Some more logging 2024-01-17 10:21:19 +08:00
0936942378 Remove connect call 2024-01-16 23:32:53 +08:00
50b48a4225 Separate worker and client code for redis connections 2024-01-16 23:21:48 +08:00
c5e4e2216b Simplify connection options 2024-01-16 23:02:46 +08:00
49734efec7 Add logging 2024-01-16 22:43:06 +08:00
7c8304ac15 Fix client imports 2024-01-16 22:08:30 +08:00
7ee3866f34 Pull in the newer connection and retry strategy code 2024-01-16 22:04:19 +08:00
90a0455c36 Update job to use ioredis 2024-01-16 22:00:25 +08:00
fcf2d07c99 Update redis data source 2024-01-16 21:58:34 +08:00
8580398d6f Clean up post rebase 2024-01-16 21:35:46 +08:00
ba3e5b053d Cleanup after rebase 2024-01-16 21:31:44 +08:00
f184c8baff Fix path 2024-01-16 21:30:17 +08:00
84195f10c2 Fix endpoint 2024-01-16 21:30:17 +08:00
4df9b70c95 Fix for detecting environment 2024-01-16 21:30:17 +08:00
e050864a91 Add more debugging 2024-01-16 21:30:17 +08:00
9633e7df79 Update envar name 2024-01-16 21:30:17 +08:00
62fdb866a8 Add some extra logging 2024-01-16 21:30:17 +08:00
26d832bb92 Trim URLs from feeds 2024-01-16 21:30:17 +08:00
652f4b6180 Use createHttpTask for save operation 2024-01-16 21:30:17 +08:00
26657c5611 Use cloud task function from backend code instead of from rss-handler 2024-01-16 21:30:17 +08:00
a8e8fe23da Remove azure config from backend 2024-01-16 21:30:17 +08:00
69eb22ae3c Remove some env vars that are not used 2024-01-16 21:30:17 +08:00
c7f605d00a If redis fails assume we need to refetch the item 2024-01-16 21:30:17 +08:00
00b72f1c3a Add lwn.net to block list 2024-01-16 21:30:17 +08:00
d31d309bc0 MOre on env parsing for k8s 2024-01-16 21:30:17 +08:00
f3f9f1a210 Some queue admin 2024-01-16 21:30:17 +08:00
5986bd0a68 Change around redis initialization so we can pull in secrets from secret manager async on startup 2024-01-16 21:30:15 +08:00
0a82e5721e Graceful k8s shutdown 2024-01-16 21:27:22 +08:00
7bb6602454 Fix linting 2024-01-16 21:27:22 +08:00