6ca1e7dc25
Add no-sandbox in the puppeteer args
2022-10-27 12:49:00 +08:00
03777587f2
Fetch max 100 tweets in a thread
2022-10-26 22:44:19 +08:00
b5926ccf1c
Get old tweet thread with puppeteer and new tweet with twitter api
2022-10-26 20:41:51 +08:00
5f0d0ed69b
Get tweet reply ids from thread id using puppeteer
2022-10-25 22:09:16 +08:00
343c8fb5cc
Get tweet reply ids from thread id
2022-10-25 18:25:49 +08:00
31bc9fe5be
Fix node-weekly newsletter getting forwarded
...
* This error is caused by a previous rebase conflict and resolving the conflict caused an important line missing
* Revert the change to add CooperPressHandler to the array of newsletter handlers
* Updated the test to get the correct handler from email content to prevent such cases
2022-10-21 09:57:05 +08:00
57846a1c5e
Fix tests
2022-10-18 15:14:38 +08:00
706607ea2b
Rebase main
2022-10-18 14:54:33 +08:00
1fda6946bb
Save newsletters hosted by cooper-press.com correctly
2022-10-18 14:53:02 +08:00
9757394a05
Merge pull request #1318 from omnivore-app/fix/newsletter-ghost-org
...
Save newsletters hosted by ghost.org correctly
2022-10-18 14:50:27 +08:00
59427fa896
Mock the substack domain also when testing redirects
...
We were making the actual call to the redirected URL here,
instead of mocking it. We need to mock both the embedded email
domain, and the domain we are redirected to.
2022-10-18 12:51:53 +08:00
d8c5c97960
Save newsletters hosted by ghost.org correctly
2022-10-17 19:27:02 +08:00
37439c6622
Save fs.blog newsletter correctly
2022-10-17 17:59:27 +08:00
ff21770a70
Add GitHubHandler class
2022-10-13 18:38:01 +08:00
f39c6923b0
Create a content handler for GitHub pages
...
This will search for the markdown <article> element and make it
the only page element so we add a repo's README.
2022-10-13 18:11:14 +08:00
5dcde8dac3
Fix not correctly identify milkroad newsletters due to the HTML format changes again by the author
2022-10-13 10:52:03 +08:00
08c30f9c24
Show the original tweet firstly
2022-10-10 15:33:36 +08:00
5d70d04154
If the saved tweet is a reply, we need to get the referenced tweet
2022-10-10 15:12:41 +08:00
220576235f
Merge pull request #1291 from omnivore-app/sywhb-patch-1
...
Get tweet thread by conversation_id
2022-10-10 09:52:30 +08:00
8f048dd15e
Change the milkroad newsletters parser according to the change of milkroad newsletter
2022-10-08 09:37:12 +08:00
06c1e09505
lint
2022-10-08 09:28:50 +08:00
2ff995d3b2
Get tweet thread by conversation_id
2022-10-08 09:09:18 +08:00
c9400ca517
Remove dom param in preHandler method
2022-10-07 16:57:01 +08:00
49ed8e279b
Calls preParseContent function in content-handler package before parsing content
2022-10-07 16:56:38 +08:00
810df2ad8c
Fix the tweets in reverse order and media file not showing
2022-10-07 16:31:56 +08:00
a8f964f615
Save only tweets in the thread by the original author
2022-10-07 13:47:20 +08:00
5bde463c94
Save unrolled recent twitter thread
2022-10-06 16:56:12 +08:00
c2a44f4991
Restore HTTP interceptor to the normal unmocked behaviour after testing
2022-10-05 11:29:23 +08:00
edd1b908ee
Fix tests
2022-10-05 11:29:23 +08:00
61303419a0
Add timeout
2022-10-04 14:25:19 +08:00
767053e31b
mock redirect request
2022-10-04 11:27:55 +08:00
4b01fccad8
Fix content-fetch dockerfile
2022-10-03 14:21:31 +08:00
25740465f2
Add timeout
2022-09-30 13:10:58 +08:00
b00a516737
Add other newsletter handlers
2022-09-30 12:51:23 +08:00
9b209314a6
Rename content to websites
2022-09-30 12:51:22 +08:00
f7b20f3186
Add newsletter handlers
2022-09-30 12:51:22 +08:00
dfbd317f99
Import content-handler in inbound-email-handler
2022-09-30 12:51:22 +08:00
99956539a0
Handle newsletter in content-handlers
2022-09-30 12:51:22 +08:00
8c61832c77
Import content-handler in content-fetch
2022-09-30 12:51:22 +08:00
8fb398eae4
Add tests
2022-09-30 12:51:22 +08:00
5fdb8b337d
Lint
2022-09-30 12:51:22 +08:00
6deb62d983
Add handlers for content-fetching
2022-09-30 12:51:22 +08:00
91952e587b
Replace newsletter-handler with content-handler
2022-09-30 12:51:22 +08:00
