Commit Graph

102 Commits

Author SHA1 Message Date
989f4f04e0 add scan feeds api to scan feeds from opml or html 2023-11-24 12:11:33 +08:00
fa2fba1a2c Merge pull request #2942 from omnivore-app/fix/rules
improvement on subscriptions and delete user api
2023-10-17 17:14:49 +08:00
1b2d93e118 remove duplicate rss subscriptions by user and url; create a unique constraint 2023-10-16 17:35:29 +08:00
34798f39f0 Disable JSONLD fetching which can be quite slow 2023-10-16 11:25:37 +08:00
f4f38e4b31 reduce unnecessary logs 2023-10-09 17:26:03 +08:00
efdbc4f345 use interpolated string or dictionary parameter in logs 2023-10-05 14:32:03 +08:00
b1899e340d replace library item 2023-10-05 14:25:10 +08:00
9370951893 create a repository directory 2023-10-05 14:22:56 +08:00
425864ce01 remove knex 2023-10-05 14:21:56 +08:00
293becf596 Ignore link density checks in newsletters 2023-09-12 15:53:43 +08:00
55841e595f fix dependecies 2023-08-11 11:12:03 +08:00
163dbc73a6 do not send content in the thumbnail task payload 2023-08-10 11:55:59 +08:00
99a52f8d56 replace all the console logs with logger logs 2023-07-27 16:06:44 +08:00
61967fdde5 fix test 2023-07-26 18:07:25 +08:00
8cd47eec11 run prettier 2023-07-26 16:41:55 +08:00
07d43812a7 use winston logger instead of console log so the log will be truncated if it exceeds the max entry size 2023-07-26 16:27:18 +08:00
1006cdad36 reduce error log size 2023-07-25 19:11:08 +08:00
113720caf6 wrap document fragment in the <html> and <body> in order to parse the HTML correctly 2023-07-17 16:14:59 +08:00
d69e732579 fix: dedupe url if failed to save 2023-06-01 16:11:35 +08:00
15b41560de fix: improve the speed of generating highlighted markdown content 2023-05-26 15:51:54 +08:00
4cc9547935 fix: fallback to html if failed to convert html to markdown 2023-05-19 16:55:50 +08:00
0adab7ad23 fix: sentry report on unable to find highlight 2023-05-18 21:07:51 +08:00
48554be76d fix: wrap link with == 2023-05-18 21:04:27 +08:00
2bf932cbdc fix: &npsp; breaks highlight 2023-05-18 16:50:49 +08:00
e3d8fae6c5 Remove debug log 2023-05-12 19:28:19 +08:00
791d11f581 Allow content to be converted into highlightedMarkdown format 2023-05-12 19:27:04 +08:00
42dc3f7330 Fix some external requests not being mocked 2023-04-12 17:04:59 +08:00
4969391d4c Replace picture with image 2023-04-12 12:15:53 +08:00
7f761049d7 Preparse the newsletter content 2023-02-17 09:49:19 +08:00
cc8b1cefdb Preserve <pre> elements with prism- class and identity them as code blocks 2023-02-14 12:33:59 +08:00
d816ee9563 Allow image and media to be loaded in puppeteer 2023-02-13 16:50:39 +08:00
c285a017c3 Increase view.html iframe height 2023-02-09 22:20:58 +08:00
761f2ff8f2 Add JWT token to the request 2023-02-09 18:05:04 +08:00
a91cf9ef63 Add an option for the original html to be parsed by distiller 2023-02-09 17:44:02 +08:00
7bfd36e308 Fix readability not run in puppeteer-parse 2023-01-12 18:33:47 +08:00
7b749f974d Convert HTML to markdown if specified 2023-01-05 12:12:48 +08:00
7c39db207b Replace createArticle with savePage in puppeteer-parse service 2022-12-28 10:15:05 +08:00
e9b31e375f Update savePage API to accept parsed content in the param 2022-12-27 21:59:31 +08:00
080a1982b2 Remove unused import 2022-11-21 22:39:10 +08:00
9741f6b12d Add highlights to newly saved pages if they contain highlight markers 2022-11-21 22:39:10 +08:00
a7e92addb0 Create 128 * 128 proxy image for the site icon 2022-10-18 15:32:30 +08:00
49ed8e279b Calls preParseContent function in content-handler package before parsing content 2022-10-07 16:56:38 +08:00
679977805f Remove custom content-handler in packages/api 2022-10-07 16:56:38 +08:00
8942398092 Change GET to HEAD 2022-09-30 12:52:09 +08:00
9841ce7f8e Remove parsing newsletter emails from forwarded emails 2022-09-30 12:51:23 +08:00
2f6b26d21d Use GET request as some host do not allow HEAD requests 2022-09-28 20:18:40 +08:00
a55ad135fd Set 5s for the HEAD request timeout 2022-09-28 19:26:42 +08:00
a6795b380a Fetch favicon from url 2022-09-28 19:02:29 +08:00
56e3ccadf0 Add test case for Axios AM newsletter 2022-09-21 12:16:13 +08:00
b03f7ebeb8 Add handler to pre-process morning brew newsletters 2022-09-15 16:21:09 +08:00