Commit Graph

5518 Commits

Author SHA1 Message Date
7e89235806 update content-fetch 2024-01-26 13:01:53 +08:00
be0a2e8c52 use different redis server for mq and cache 2024-01-26 13:01:53 +08:00
4c765378e3 do not retry if find_thumbnail job fails 2024-01-26 13:01:53 +08:00
e54c691c09 create a job for finding thumbnail 2024-01-26 13:01:51 +08:00
f3c1b9d9a0 Merge pull request #3430 from omnivore-app/fix/queue-processor-custom-metrics
Expose custom metrics for the queue processor
2024-01-25 21:17:49 +08:00
fd7c2ffb49 fix code blocks not formatted correctly in articles from wechat official accounts 2024-01-25 16:30:59 +08:00
04fd8d2e5d Update generated html 2024-01-25 16:30:59 +08:00
7ff327787b add test case 2024-01-25 16:30:59 +08:00
dae90aaffa fix code blocks not formatted correctly 2024-01-25 16:30:59 +08:00
8834efabd4 throw error if save-page job failed 2024-01-25 16:30:59 +08:00
5e239d2568 run readability in save-page instead of puppeteer 2024-01-25 16:30:59 +08:00
a639a2fa10 Add types to exported metrics 2024-01-25 12:37:02 +08:00
5f9be385b7 Remove unneeded escapes 2024-01-24 21:34:51 +08:00
c581372a93 Improve exported metrics naming convention 2024-01-24 21:13:13 +08:00
7bb63b4ecd for campability with old clients, use refreshedAt to replace lastFetchedAt 2024-01-24 15:32:43 +08:00
3f3a96297f update entity 2024-01-24 14:55:50 +08:00
1563b44197 save the timestamp when feed fails 2024-01-24 14:54:39 +08:00
9e55fe0d7b do not retry if user is deleted 2024-01-24 14:12:34 +08:00
d357d2b0af fix tests 2024-01-24 13:41:49 +08:00
86c4bbabee update logs 2024-01-24 13:30:57 +08:00
9d378d3f46 get active user subscriptions only 2024-01-24 13:21:37 +08:00
fd74ebffa2 validate feed item url and convert relative url to absolute url 2024-01-24 13:15:46 +08:00
6f3fccfcd0 mark subscription as error if item was failed 2024-01-24 13:09:43 +08:00
d24db92e03 Dont force init this queue 2024-01-24 12:40:00 +08:00
c29f31d618 Add _count to prom metrics names 2024-01-24 12:39:04 +08:00
e4109a63f0 Expose custom metrics for the queue processor 2024-01-24 12:15:38 +08:00
3cb7c38e7f update refreshed_at when feed is processed 2024-01-24 12:12:26 +08:00
68a4fb298d add refreshedAt to the gql schema 2024-01-24 12:03:26 +08:00
9e966bb269 add REFRESH_ERROR to the status of subscriptions and add a new column refreshed_at 2024-01-24 11:26:35 +08:00
58d41951c2 Dont not fetch content for medium.com rss feeds
All these are blocked
2024-01-24 02:11:39 +08:00
c7cfb8693f Remove unused change 2024-01-23 23:46:59 +08:00
f8264bfc10 Hard code tweet url to avoid import 2024-01-23 23:45:28 +08:00
4fce7e9287 Add new job for handling upload content 2024-01-23 23:45:03 +08:00
c1d5ec722f do not encode url when getting file data 2024-01-23 22:06:27 +08:00
d4e487e181 set the state to failed if content is not fetched 2024-01-23 21:50:10 +08:00
47da6fb3dc Merge pull request #3421 from omnivore-app/fix/title
fix: do not throw error if title is undefined in cache
2024-01-23 19:33:22 +08:00
e96458192d fix redis client cert in nitter handler 2024-01-23 19:30:38 +08:00
5495ad782e fix: do not throw error if title is undefined in cache 2024-01-23 19:19:46 +08:00
8f5d4ae8a0 fix: catch rejected promise if it is in a try-catch block 2024-01-23 18:45:46 +08:00
25603cf136 Merge pull request #3417 from omnivore-app/fix/puppeteer-parse
fix/puppeteer parse
2024-01-23 17:08:49 +08:00
f4a2edf8f4 show detailed logs 2024-01-23 16:58:08 +08:00
567ce172e6 make title optional for cache in save-page job 2024-01-23 16:55:17 +08:00
fd0bb37d3a make title optional for cache 2024-01-23 16:54:35 +08:00
1332cda356 give highest priority to save-page job for adding items by links 2024-01-23 16:48:57 +08:00
94dd4be659 fix: page content not saved when title is empty but content is not 2024-01-23 16:47:42 +08:00
7f59a23294 Dont pass library item id to backend when updating highlights
The native (iOS and Android) code needs this param but we
cant send it to the web.
2024-01-23 14:51:17 +08:00
afbcd2f02e Merge pull request #3413 from omnivore-app/fix/thumbnailer
fix: catch images fetching error in thumbailer to prevent from retrying
2024-01-23 14:48:12 +08:00
1411cf074e fix: finalUrl defaults to the url of the page saved 2024-01-23 14:14:54 +08:00
7264151841 do not use proxy url 2024-01-23 13:51:30 +08:00
f48604252c fix: catch images fetching error in thumbailer to prevent from retrying 2024-01-23 13:37:15 +08:00