Commit Graph

4869 Commits

Author SHA1 Message Date
d2c0efc540 add some debug 2023-10-18 18:22:22 +08:00
479fc8fb7d Add a test for checksumming 2023-10-18 17:11:02 +08:00
921a46a13a Linting fixes 2023-10-18 16:51:23 +08:00
d592dc44c6 Add back missing pubdate check 2023-10-18 16:34:40 +08:00
7848413645 Update schema 2023-10-18 16:34:20 +08:00
f14fc034fe Add last fetched column to the database 2023-10-18 16:28:22 +08:00
cf101c6d18 Cache and check feed checksums to reduce fetching 2023-10-18 16:26:03 +08:00
14349d8257 Merge pull request #2952 from omnivore-app/fix/queue-manager-print-latency
Post the avg latency in the update message
2023-10-18 13:37:01 +08:00
46313b14ba set trust proxy = true if set in env var 2023-10-18 13:06:33 +08:00
988b20e30c test trust proxy=true 2023-10-18 12:30:27 +08:00
506004d410 test trust proxy=2 2023-10-18 11:58:15 +08:00
32ba744d20 test trust proxy=1 2023-10-18 11:04:32 +08:00
91076014cd log req.ip 2023-10-18 11:04:32 +08:00
0874f6ff21 log x-forwarded-for header for debugging purpose 2023-10-18 11:04:32 +08:00
f8d5e3f261 Merge pull request #2959 from omnivore-app/fix/api-attachments
Only use signed URLs for PDF attachments
2023-10-18 10:50:41 +08:00
71aaef3628 Update attachment URL 2023-10-18 10:43:53 +08:00
b88c64424f Special handling of file URLs 2023-10-18 10:37:21 +08:00
78843fff14 Remove import 2023-10-18 10:27:09 +08:00
4220922ff8 Preserve original URL if possible 2023-10-18 10:23:26 +08:00
b6ce4f39b1 Fix imports 2023-10-18 10:15:49 +08:00
25c0051fd4 Only use signed URLs for PDF attachments 2023-10-18 10:14:35 +08:00
1053c9b53a Bump threshold for testing 2023-10-18 09:11:11 +08:00
7f61acc907 skip old feed if the pubDate is before last_fetched timestamp 2023-10-17 19:40:29 +08:00
fd57e075d7 Clean up return signature 2023-10-17 18:30:57 +08:00
d8a5ed42e8 Remove unused var 2023-10-17 18:28:56 +08:00
7eadda02e8 Post the avg latency in the update message 2023-10-17 18:18:58 +08:00
fa2fba1a2c Merge pull request #2942 from omnivore-app/fix/rules
improvement on subscriptions and delete user api
2023-10-17 17:14:49 +08:00
5f11bf1fde remove elasticsearch dep from packages/db 2023-10-17 17:12:26 +08:00
700fd73dbb disallow social login if account is deleted 2023-10-17 17:07:46 +08:00
16f20d126d Merge pull request #2945 from omnivore-app/feat/api-queue-manager
Add queue manager service
2023-10-17 16:46:43 +08:00
6e79f6c67f update sql to deduplicate rss subscriptions 2023-10-17 16:41:14 +08:00
d450bdd8e6 Linting improvements 2023-10-17 16:03:38 +08:00
97cb8d3af7 Bump test limit 2023-10-17 15:53:05 +08:00
eb667e04b9 update reading progress in db 2023-10-17 15:09:16 +08:00
a6d3bb22b1 Add a check param so we can avoid checks on container startup while deploying 2023-10-17 14:46:57 +08:00
d141fea977 Handle cases where fetching queue counts fails 2023-10-17 14:18:45 +08:00
1f600c272e Better handling of network failures for labels/subscriptions/searches in the left menu 2023-10-17 13:36:47 +08:00
ab0fc1087d update tsv only if necessary 2023-10-17 12:02:44 +08:00
b700c75552 Use the GCP project id 2023-10-16 22:32:41 +08:00
51e2aaa3ea Add node-fetch dependency 2023-10-16 20:29:03 +08:00
e4332b74f9 Add queue manager service 2023-10-16 20:11:51 +08:00
74b25a23ac Temporarily remove next/previous web controls 2023-10-16 17:51:28 +08:00
a537252db3 Limit CSV import sizes via web 2023-10-16 17:50:04 +08:00
1b2d93e118 remove duplicate rss subscriptions by user and url; create a unique constraint 2023-10-16 17:35:29 +08:00
00bd183287 do not retry importer job if user account is deleted 2023-10-16 16:33:22 +08:00
9e8ccb35e3 Limit users to a single import a day 2023-10-16 15:48:03 +08:00
e54c1c81a1 soft delete user by calling delete account api 2023-10-16 15:24:53 +08:00
4f86f05aac Remove JSONLD test 2023-10-16 11:39:03 +08:00
34798f39f0 Disable JSONLD fetching which can be quite slow 2023-10-16 11:25:37 +08:00
4ae6c476f8 shows api error message 2023-10-14 13:18:40 +08:00