|
|
f0e6458e4a
|
filter out replies
|
2023-06-21 16:01:09 +08:00 |
|
|
|
a3ad9375bf
|
replace url in tweets
|
2023-06-21 15:50:55 +08:00 |
|
|
|
d2094981ad
|
increase timeout value to 60 seconds
|
2023-06-21 15:21:40 +08:00 |
|
|
|
dde104b95e
|
fix video attachment not saved
|
2023-06-21 15:07:21 +08:00 |
|
|
|
a109d0383f
|
go to the next thread page to scrape long thread
|
2023-06-20 19:17:34 +08:00 |
|
|
|
89f89875d6
|
fix date parsing
|
2023-06-20 17:35:59 +08:00 |
|
|
|
ff9fcef08d
|
disable twitter-handler
|
2023-06-20 14:59:14 +08:00 |
|
|
|
65758f3469
|
feat: add nitter handler to scrape tweets from twitter.com and nitter.net
|
2023-06-20 14:56:54 +08:00 |
|
|
|
fb2c70a6fd
|
change the page viewport when scraping twitter thread
|
2023-06-15 18:33:26 +08:00 |
|
|
|
d69e732579
|
fix: dedupe url if failed to save
|
2023-06-01 16:11:35 +08:00 |
|
|
|
8ddde61285
|
fix: increase twitter-handler timeout to 60 seconds
|
2023-06-01 16:11:35 +08:00 |
|
|
|
4d422402f8
|
fix: convert published time to GMT +8 in the parsed wechat blogs
|
2023-05-24 10:55:54 +08:00 |
|
|
|
94aead9988
|
Add content handler for weixin.qq.com
|
2023-05-16 14:46:44 +08:00 |
|
|
|
89c85e5627
|
Merge pull request #2109 from omnivore-app/feat/tweet-titles
Better tweet titles
|
2023-04-25 14:17:33 +08:00 |
|
|
|
6560a6e694
|
Add type definitions
|
2023-04-25 12:23:37 +08:00 |
|
|
|
155fad5b9c
|
Truncate tweet text used in titles using lodash
|
2023-04-25 11:39:55 +08:00 |
|
|
|
53e81cc06e
|
Better formatting of tweet titles
|
2023-04-25 09:47:52 +08:00 |
|
|
|
187ad654e7
|
Add debug logs
|
2023-04-22 12:29:46 +08:00 |
|
|
|
2760ce60f0
|
Fix list-unsubscribe header undefined
|
2023-04-22 11:07:15 +08:00 |
|
|
|
89ac9c46cc
|
Remove other places that use rfc2047 decoder
|
2023-04-20 20:53:06 +08:00 |
|
|
|
06733227d6
|
Remove new "restack" and "share" buttons from SubStack newsletters
|
2023-04-18 14:53:27 +08:00 |
|
|
|
6c27c5385f
|
Remove footnote links in wikipedia articles
|
2023-04-13 12:10:07 +08:00 |
|
|
|
e03301e294
|
Merge pull request #2026 from omnivore-app/fix/embedded-quote-tweets
Handle embedded quote tweets
|
2023-04-12 16:23:38 +08:00 |
|
|
|
c366cd6472
|
Fix test value, there is only one quote tweet
|
2023-04-12 15:37:26 +08:00 |
|
|
|
ae45067a32
|
Add test data file
|
2023-04-12 15:16:11 +08:00 |
|
|
|
344514bd0f
|
Handle embedded quote tweets
|
2023-04-12 14:50:20 +08:00 |
|
|
|
4969391d4c
|
Replace picture with image
|
2023-04-12 12:15:53 +08:00 |
|
|
|
eb58bf11ba
|
Force to use content handler of piped.video when saving from extensions
|
2023-04-10 20:52:09 +08:00 |
|
|
|
bfbd80e8f1
|
Get the published date
|
2023-04-06 16:41:21 +08:00 |
|
|
|
70f4068d89
|
Add handler for piped video
|
2023-04-06 16:31:06 +08:00 |
|
|
|
29776359f2
|
Fix a typo in the url
|
2023-03-10 18:27:58 +08:00 |
|
|
|
687771f676
|
Use YouTube as site name
|
2023-03-10 18:26:21 +08:00 |
|
|
|
56ce70dbd4
|
Revert using youtube data api
|
2023-03-10 18:21:51 +08:00 |
|
|
|
98d5f92ad4
|
Call youtube data api to fetch published date
|
2023-03-10 17:38:03 +08:00 |
|
|
|
a0aab94e8b
|
Add site_name and published date to saved twitter
|
2023-03-10 16:42:40 +08:00 |
|
|
|
de9524c3e8
|
Fix confusing unsubscribing url with email address
|
2023-02-27 12:06:46 +08:00 |
|
|
|
729b8159f9
|
Merge pull request #1818 from omnivore-app/fix/energy-world-newsletter
Preparse the newsletter content
|
2023-02-17 22:41:20 +08:00 |
|
|
|
31eb67efb1
|
Fix sometimes there is extra spaces between sender and email address by checking only the email address
|
2023-02-17 22:05:35 +08:00 |
|
|
|
7f761049d7
|
Preparse the newsletter content
|
2023-02-17 09:49:19 +08:00 |
|
|
|
cc8b1cefdb
|
Preserve <pre> elements with prism- class and identity them as code blocks
|
2023-02-14 12:33:59 +08:00 |
|
|
|
db1a194d11
|
Add support for india times newsletter
|
2023-02-03 18:18:44 +08:00 |
|
|
|
d36b608919
|
Add support for energy-world newsletter
|
2023-02-03 17:23:51 +08:00 |
|
|
|
b6c41b9c73
|
Add support for every.io newsletter
|
2023-02-03 16:59:27 +08:00 |
|
|
|
363489f5be
|
Add generic newsletter handler
|
2023-02-03 14:46:24 +08:00 |
|
|
|
39b87e2aaf
|
Add support for Time To Sign Off newsletter
|
2023-02-02 17:01:25 +08:00 |
|
|
|
ba8b6796f3
|
Merge pull request #1746 from omnivore-app/fix/save-youtube-playlist
Fix incorrect Youtube playlist author name and description
|
2023-01-31 11:06:25 +08:00 |
|
|
|
61bf89b9ad
|
Add tests
|
2023-01-30 19:10:27 +08:00 |
|
|
|
4f12580b1c
|
Use email header x-beehiiv-type to detect beehiiv newsletter and get the newsletter url from the header x-newsletter
|
2023-01-30 19:03:15 +08:00 |
|
|
|
88f6e20bfc
|
Pass email headers to the content-handler
|
2023-01-30 18:52:38 +08:00 |
|
|
|
ec7344b923
|
Get playlist id from the URL and retrieve the information of the playlist
|
2023-01-30 16:53:19 +08:00 |
|
