Commit Graph

1892 Commits

Author SHA1 Message Date
c5e4e2216b Simplify connection options 2024-01-16 23:02:46 +08:00
49734efec7 Add logging 2024-01-16 22:43:06 +08:00
7c8304ac15 Fix client imports 2024-01-16 22:08:30 +08:00
7ee3866f34 Pull in the newer connection and retry strategy code 2024-01-16 22:04:19 +08:00
90a0455c36 Update job to use ioredis 2024-01-16 22:00:25 +08:00
fcf2d07c99 Update redis data source 2024-01-16 21:58:34 +08:00
8580398d6f Clean up post rebase 2024-01-16 21:35:46 +08:00
ba3e5b053d Cleanup after rebase 2024-01-16 21:31:44 +08:00
f184c8baff Fix path 2024-01-16 21:30:17 +08:00
84195f10c2 Fix endpoint 2024-01-16 21:30:17 +08:00
4df9b70c95 Fix for detecting environment 2024-01-16 21:30:17 +08:00
e050864a91 Add more debugging 2024-01-16 21:30:17 +08:00
9633e7df79 Update envar name 2024-01-16 21:30:17 +08:00
62fdb866a8 Add some extra logging 2024-01-16 21:30:17 +08:00
26d832bb92 Trim URLs from feeds 2024-01-16 21:30:17 +08:00
652f4b6180 Use createHttpTask for save operation 2024-01-16 21:30:17 +08:00
26657c5611 Use cloud task function from backend code instead of from rss-handler 2024-01-16 21:30:17 +08:00
a8e8fe23da Remove azure config from backend 2024-01-16 21:30:17 +08:00
69eb22ae3c Remove some env vars that are not used 2024-01-16 21:30:17 +08:00
c7f605d00a If redis fails assume we need to refetch the item 2024-01-16 21:30:17 +08:00
00b72f1c3a Add lwn.net to block list 2024-01-16 21:30:17 +08:00
d31d309bc0 MOre on env parsing for k8s 2024-01-16 21:30:17 +08:00
5986bd0a68 Change around redis initialization so we can pull in secrets from secret manager async on startup 2024-01-16 21:30:15 +08:00
0a82e5721e Graceful k8s shutdown 2024-01-16 21:27:22 +08:00
7bb6602454 Fix linting 2024-01-16 21:27:22 +08:00
7aa76b70fe Add missing jobs 2024-01-16 21:27:22 +08:00
819052f51f Add queue-processor endpoint to the api 2024-01-16 21:27:22 +08:00
b4914f5346 Fix creation of redis clients 2024-01-16 21:27:20 +08:00
447bba23ba Fix init 2024-01-16 21:26:30 +08:00
20df5c6212 Parse redis cert on load 2024-01-16 21:26:28 +08:00
45fcde8ebc Update redis config 2024-01-16 21:25:34 +08:00
b4ce07efd3 Better handling of cases when redis isnt configured 2024-01-16 21:25:34 +08:00
d29c26d93b Some redis setup 2024-01-16 21:25:34 +08:00
fc25d6d615 Enqueue rss-refresh-feed jobs in bull 2024-01-16 21:25:31 +08:00
150a456c35 replace redis client library with ioredis 2024-01-16 15:42:50 +08:00
1e05f7dade log error 2024-01-16 12:17:07 +08:00
5141c2a042 do not retry saving following items if item is saved 2024-01-16 12:15:21 +08:00
816019e6a3 extend ttl of the saved item cache to 26 hours 2024-01-16 11:17:21 +08:00
06067c1d66 fix tests 2024-01-15 11:26:40 +08:00
bd612bd310 replace username too 2024-01-15 11:23:01 +08:00
deddb51c42 fix: change user email address after user deleted account 2024-01-12 11:45:28 +08:00
f81ad17fb1 fix tests 2024-01-10 18:07:58 +08:00
d9d800cfc4 add index for sorting by saved_at 2024-01-10 17:09:15 +08:00
1ec5b7affe fix labels not saved when merging highlights 2024-01-05 23:22:09 +08:00
ccd4f2d3f0 catch redis client error and continue the process 2024-01-05 15:20:42 +08:00
f4ff4b9fcd fix tests 2024-01-04 22:27:31 +08:00
32a58e49f9 make redis optional for backend 2024-01-04 21:55:41 +08:00
bcd05cc7fc set the url in redis when an item is inserted into db 2024-01-04 18:10:14 +08:00
08c4624fce save the url in redis for 8 hours so rss-feeder will not try to re-save it 2024-01-04 18:03:34 +08:00
d1db49f9bb Merge pull request #3300 from omnivore-app/fix/batch-prune
fix/batch prune
2024-01-04 15:19:50 +08:00