a062152d4a
fix tests
2024-04-11 11:08:22 +08:00
f66d3fa36c
migrate inbound-email tasks from pubsub to bullmq
2024-04-11 11:08:22 +08:00
764b05fff4
save reply-to in recent emails
2024-04-11 11:08:22 +08:00
809c572ca7
reduce the size of the log entry by truncating any string values to 500 characters
2024-01-29 14:32:45 +08:00
585957469c
fix: init sentry sdk to disable tracing warning in cloud logs
2024-01-23 12:46:51 +08:00
9021854be7
convert plain text newsletter email content to html using markdown-to-html and save it if html is not available
2023-09-25 21:16:43 +08:00
b891e547c9
Make content optional
2023-04-24 21:03:39 +08:00
187ad654e7
Add debug logs
2023-04-22 12:29:46 +08:00
50f55501f4
Fix list-unsubscribe header undefined
2023-04-21 15:42:58 +08:00
de0fb8542a
Decode email metadata from rfc2047 encoded
2023-04-20 20:52:43 +08:00
8e3d2b0b91
Save epub email attachments
2023-04-19 11:36:28 +08:00
182860e4d3
Update comment
2023-04-14 18:50:31 +08:00
0a2598e296
Parse the author name from email address
2023-04-14 18:48:24 +08:00
f7d46752e1
Forward subscription confirmation email
2023-04-14 18:40:38 +08:00
e620861eaf
Invert newsletter detection logic
2023-04-06 18:07:10 +08:00
6ade830605
To in the envelope will always be a single-element array
2023-03-23 18:33:32 +08:00
ea3077ea2e
Use receipient address in the envelope field
2023-03-23 18:18:33 +08:00
017c8f5f8a
Forward Gmail verification email to the user
2023-03-07 18:50:08 +08:00
88f6e20bfc
Pass email headers to the content-handler
2023-01-30 18:52:38 +08:00
7dbf8662fc
Fix test
2023-01-19 09:38:21 +08:00
8f9c317dd1
Save received email before publishing data
2023-01-18 22:35:07 +08:00
d60890d154
Add pubsub to save received email
2023-01-18 17:13:11 +08:00
3f373ab3b6
Save received email
2023-01-18 15:00:34 +08:00
66d3ffe7f3
Fix not correctly set confirmation code from Gmail in Spanish
2022-11-01 12:54:45 +08:00
b00a516737
Add other newsletter handlers
2022-09-30 12:51:23 +08:00
dfbd317f99
Import content-handler in inbound-email-handler
2022-09-30 12:51:22 +08:00
512c7e10d8
Update sender address
2022-09-09 15:19:54 +08:00
02ab4e45e5
Fix not setting confirmation code from Google Japan confiramtion emails
2022-09-09 15:12:19 +08:00
7d608ed2cb
Use parsed from, to and subject from email headers
2022-08-05 10:03:09 +08:00
2ae7219e35
Update comment
2022-08-04 20:32:17 +08:00
70deb348cf
Fix not getting correct sender email address from forwarding email by Gmail rules
2022-08-04 18:50:23 +08:00
6f11ccacb1
Save article from forwarding emails
2022-07-27 12:15:28 +08:00
d184ca8d04
Add function isProbablyArticle to test if a forwarded email contains an article to save
2022-07-27 12:15:26 +08:00
cea1c856f7
fix not getting unsubscribe email address from beehiv newsletter by decoding the list-unsubscribe header
2022-07-25 17:15:12 +08:00
6ea5bc3b18
fix dependecies
2022-07-08 12:10:32 +08:00
cb1968a82d
Publish unsubscribe header info in the non-newsletter queue
2022-07-07 17:13:18 +08:00
0b15fefeb9
Move parseUnsubscribeHeader to index.ts
2022-07-07 17:12:26 +08:00
824d211df2
Support morning brew newsletter and add tests
2022-05-16 10:37:50 +08:00
adfaf6b8ce
Use newsletter's title and author as page's ones
2022-05-12 18:08:38 +08:00
ebfdf1f3a0
Fix parsing newsletter url from substack
2022-04-21 21:28:00 +08:00
5c7f4a22bf
Save subscriptions when saving newsletters ( #447 )
...
* parse unsub mailTo or httpUrl and send to pubsub
* save subscription from newsletter
* fix tests
2022-04-20 09:24:40 +08:00
0a67032fd3
fix tests
2022-04-06 21:09:22 +08:00
d1269f815e
identify a newsletter by checking both list-url and unsubscribe-url in headers and email sender address
2022-04-06 20:59:14 +08:00
705b67946d
Close #115 ( #117 )
...
* forward all emails we failed to handle
* update Regex to get confirmation code from email subject
* add tests
* removed real email from tests
2022-02-24 10:28:17 +08:00
610c9c6348
Closes #37 ( #109 )
...
* change return value for new version of pubsub
* add support for the other bloomberg newsletters not only business
* add default fallback url if newsletter url not found
* revert pubsub version change
2022-02-23 11:17:59 +08:00
e9b77117c9
update to work with latest GCP API
2022-02-21 16:52:33 -08:00
207f77c419
Add support for Golang Weekly newsletters ( #96 )
...
* abstract different newsletter handler to a class
* create a generic newsletter handler class
* add support for golang-weekly newsletters
* add tests for golang weekly newsletters
* use addressparser lib to parse author from from address
2022-02-21 14:37:48 +08:00
05aa5d737e
Merge pull request #82 from omnivore-app/feature/bloomberg-newsletters
...
Add support for Bloomberg newsletter
2022-02-18 01:08:46 +08:00
e3839647e1
parse bloomberg newsletter
2022-02-17 20:14:06 +08:00
ad8bca3d84
use subject as title
2022-02-17 18:59:07 +08:00
