Commit Graph

117 Commits

Author SHA1 Message Date
d69e732579 fix: dedupe url if failed to save 2023-06-01 16:11:35 +08:00
8ddde61285 fix: increase twitter-handler timeout to 60 seconds 2023-06-01 16:11:35 +08:00
4d422402f8 fix: convert published time to GMT +8 in the parsed wechat blogs 2023-05-24 10:55:54 +08:00
94aead9988 Add content handler for weixin.qq.com 2023-05-16 14:46:44 +08:00
89c85e5627 Merge pull request #2109 from omnivore-app/feat/tweet-titles
Better tweet titles
2023-04-25 14:17:33 +08:00
6560a6e694 Add type definitions 2023-04-25 12:23:37 +08:00
155fad5b9c Truncate tweet text used in titles using lodash 2023-04-25 11:39:55 +08:00
53e81cc06e Better formatting of tweet titles 2023-04-25 09:47:52 +08:00
187ad654e7 Add debug logs 2023-04-22 12:29:46 +08:00
2760ce60f0 Fix list-unsubscribe header undefined 2023-04-22 11:07:15 +08:00
89ac9c46cc Remove other places that use rfc2047 decoder 2023-04-20 20:53:06 +08:00
06733227d6 Remove new "restack" and "share" buttons from SubStack newsletters 2023-04-18 14:53:27 +08:00
6c27c5385f Remove footnote links in wikipedia articles 2023-04-13 12:10:07 +08:00
e03301e294 Merge pull request #2026 from omnivore-app/fix/embedded-quote-tweets
Handle embedded quote tweets
2023-04-12 16:23:38 +08:00
c366cd6472 Fix test value, there is only one quote tweet 2023-04-12 15:37:26 +08:00
ae45067a32 Add test data file 2023-04-12 15:16:11 +08:00
344514bd0f Handle embedded quote tweets 2023-04-12 14:50:20 +08:00
4969391d4c Replace picture with image 2023-04-12 12:15:53 +08:00
eb58bf11ba Force to use content handler of piped.video when saving from extensions 2023-04-10 20:52:09 +08:00
bfbd80e8f1 Get the published date 2023-04-06 16:41:21 +08:00
70f4068d89 Add handler for piped video 2023-04-06 16:31:06 +08:00
29776359f2 Fix a typo in the url 2023-03-10 18:27:58 +08:00
687771f676 Use YouTube as site name 2023-03-10 18:26:21 +08:00
56ce70dbd4 Revert using youtube data api 2023-03-10 18:21:51 +08:00
98d5f92ad4 Call youtube data api to fetch published date 2023-03-10 17:38:03 +08:00
a0aab94e8b Add site_name and published date to saved twitter 2023-03-10 16:42:40 +08:00
de9524c3e8 Fix confusing unsubscribing url with email address 2023-02-27 12:06:46 +08:00
729b8159f9 Merge pull request #1818 from omnivore-app/fix/energy-world-newsletter
Preparse the newsletter content
2023-02-17 22:41:20 +08:00
31eb67efb1 Fix sometimes there is extra spaces between sender and email address by checking only the email address 2023-02-17 22:05:35 +08:00
7f761049d7 Preparse the newsletter content 2023-02-17 09:49:19 +08:00
cc8b1cefdb Preserve <pre> elements with prism- class and identity them as code blocks 2023-02-14 12:33:59 +08:00
db1a194d11 Add support for india times newsletter 2023-02-03 18:18:44 +08:00
d36b608919 Add support for energy-world newsletter 2023-02-03 17:23:51 +08:00
b6c41b9c73 Add support for every.io newsletter 2023-02-03 16:59:27 +08:00
363489f5be Add generic newsletter handler 2023-02-03 14:46:24 +08:00
39b87e2aaf Add support for Time To Sign Off newsletter 2023-02-02 17:01:25 +08:00
ba8b6796f3 Merge pull request #1746 from omnivore-app/fix/save-youtube-playlist
Fix incorrect Youtube playlist author name and description
2023-01-31 11:06:25 +08:00
61bf89b9ad Add tests 2023-01-30 19:10:27 +08:00
4f12580b1c Use email header x-beehiiv-type to detect beehiiv newsletter and get the newsletter url from the header x-newsletter 2023-01-30 19:03:15 +08:00
88f6e20bfc Pass email headers to the content-handler 2023-01-30 18:52:38 +08:00
ec7344b923 Get playlist id from the URL and retrieve the information of the playlist 2023-01-30 16:53:19 +08:00
1b3d4bbffa Do not escape the title of youtube video or tweet which is saved in elastic 2023-01-18 19:08:36 +08:00
6133d0865a Set title for YouTube based on oembed data 2023-01-16 20:03:23 +08:00
145a8b9730 Fix last two tweets not saved in a long thread by waiting for document loaded after scrolling 2023-01-12 22:03:29 +08:00
1243e2ace2 Fix the error when no name in subscription by using the email address as the author when no author found in the newsletter 2023-01-10 11:17:22 +08:00
ab16447c14 Fix not saving all the tweets in a thread 2023-01-03 21:26:34 +08:00
3a3a06b5d6 Fix vote count 2022-11-29 16:18:09 +08:00
1fe86b6230 Parse owner 2022-11-29 15:48:45 +08:00
f8e0efad05 fix bug 2022-11-29 15:40:22 +08:00
8ee19a98fa parse authors 2022-11-29 12:26:37 +08:00