Commit Graph

1698 Commits

Author SHA1 Message Date
7e89235806 update content-fetch 2024-01-26 13:01:53 +08:00
be0a2e8c52 use different redis server for mq and cache 2024-01-26 13:01:53 +08:00
4c765378e3 do not retry if find_thumbnail job fails 2024-01-26 13:01:53 +08:00
e54c691c09 create a job for finding thumbnail 2024-01-26 13:01:51 +08:00
f3c1b9d9a0 Merge pull request #3430 from omnivore-app/fix/queue-processor-custom-metrics
Expose custom metrics for the queue processor
2024-01-25 21:17:49 +08:00
fd7c2ffb49 fix code blocks not formatted correctly in articles from wechat official accounts 2024-01-25 16:30:59 +08:00
dae90aaffa fix code blocks not formatted correctly 2024-01-25 16:30:59 +08:00
8834efabd4 throw error if save-page job failed 2024-01-25 16:30:59 +08:00
5e239d2568 run readability in save-page instead of puppeteer 2024-01-25 16:30:59 +08:00
a639a2fa10 Add types to exported metrics 2024-01-25 12:37:02 +08:00
5f9be385b7 Remove unneeded escapes 2024-01-24 21:34:51 +08:00
c581372a93 Improve exported metrics naming convention 2024-01-24 21:13:13 +08:00
7bb63b4ecd for campability with old clients, use refreshedAt to replace lastFetchedAt 2024-01-24 15:32:43 +08:00
3f3a96297f update entity 2024-01-24 14:55:50 +08:00
1563b44197 save the timestamp when feed fails 2024-01-24 14:54:39 +08:00
9e55fe0d7b do not retry if user is deleted 2024-01-24 14:12:34 +08:00
d357d2b0af fix tests 2024-01-24 13:41:49 +08:00
86c4bbabee update logs 2024-01-24 13:30:57 +08:00
9d378d3f46 get active user subscriptions only 2024-01-24 13:21:37 +08:00
fd74ebffa2 validate feed item url and convert relative url to absolute url 2024-01-24 13:15:46 +08:00
6f3fccfcd0 mark subscription as error if item was failed 2024-01-24 13:09:43 +08:00
d24db92e03 Dont force init this queue 2024-01-24 12:40:00 +08:00
c29f31d618 Add _count to prom metrics names 2024-01-24 12:39:04 +08:00
e4109a63f0 Expose custom metrics for the queue processor 2024-01-24 12:15:38 +08:00
3cb7c38e7f update refreshed_at when feed is processed 2024-01-24 12:12:26 +08:00
68a4fb298d add refreshedAt to the gql schema 2024-01-24 12:03:26 +08:00
58d41951c2 Dont not fetch content for medium.com rss feeds
All these are blocked
2024-01-24 02:11:39 +08:00
f8264bfc10 Hard code tweet url to avoid import 2024-01-23 23:45:28 +08:00
c1d5ec722f do not encode url when getting file data 2024-01-23 22:06:27 +08:00
d4e487e181 set the state to failed if content is not fetched 2024-01-23 21:50:10 +08:00
47da6fb3dc Merge pull request #3421 from omnivore-app/fix/title
fix: do not throw error if title is undefined in cache
2024-01-23 19:33:22 +08:00
5495ad782e fix: do not throw error if title is undefined in cache 2024-01-23 19:19:46 +08:00
8f5d4ae8a0 fix: catch rejected promise if it is in a try-catch block 2024-01-23 18:45:46 +08:00
567ce172e6 make title optional for cache in save-page job 2024-01-23 16:55:17 +08:00
9f7669b010 fix: do not use encoded url as cache key 2024-01-22 16:49:05 +08:00
21405e6328 Fix await 2024-01-22 15:48:15 +08:00
e407db914a Add new job for handling upload content 2024-01-22 15:36:46 +08:00
3e0f8c884e Merge pull request #3404 from omnivore-app/debug/extra-logging
Add logging to save_page service
2024-01-22 13:59:19 +08:00
6dd4f49c2f Add logging to save_page service 2024-01-22 13:32:17 +08:00
4da93cbd2d Merge pull request #3402 from omnivore-app/fix/unique-constraint
fix: ignore error when saving existing library item in db
2024-01-22 12:38:09 +08:00
141036dc6c fix tests 2024-01-22 12:18:08 +08:00
db8284dc0b Wait until backend queue is ready before putting jobs into it 2024-01-22 11:31:46 +08:00
f7b17cb93f Only create queue object once in queue processor 2024-01-22 11:27:13 +08:00
0f78419e1a Remove some debug 2024-01-22 11:26:59 +08:00
5964d827c8 fix tests 2024-01-22 11:04:11 +08:00
33c994ad5c Remove RSS feed task handler url as this handled with jobs now 2024-01-22 11:00:55 +08:00
a807a4a18e fix: do not throw error when creating duplicate item in db 2024-01-22 10:45:47 +08:00
9d3a183c45 Dont map label input 2024-01-21 15:44:41 +08:00
6cedffc249 Only require original content in savePageJob 2024-01-21 15:30:06 +08:00
202d19c9d3 Fix api status mapping 2024-01-21 14:11:53 +08:00