Benature/omnivore
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
11,554 Commits 1 Branch 0 Tags
0c377c370fba5221ffa4aa91ccfc65241cf3713d
Commit Graph

90 Commits

Author SHA1 Message Date
Hongbo Wu
2ae7219e35 Update comment 2022-08-04 20:32:17 +08:00
Hongbo Wu
70deb348cf Fix not getting correct sender email address from forwarding email by Gmail rules 2022-08-04 18:50:23 +08:00
Hongbo Wu
6f11ccacb1 Save article from forwarding emails 2022-07-27 12:15:28 +08:00
Hongbo Wu
d184ca8d04 Add function isProbablyArticle to test if a forwarded email contains an article to save 2022-07-27 12:15:26 +08:00
Hongbo Wu
dec2027fc8 Merge pull request #1009 from omnivore-app/fix/unsubscribe 
fix not getting unsubscribe email address from beehiv newsletter by decoding the list-unsubscribe header
 2022-07-27 09:41:42 +08:00
dependabot[bot]
d1b013d826 Bump @google-cloud/functions-framework from 3.1.0 to 3.1.2 
Bumps [@google-cloud/functions-framework](https://github.com/GoogleCloudPlatform/functions-framework-nodejs) from 3.1.0 to 3.1.2.
- [Release notes](https://github.com/GoogleCloudPlatform/functions-framework-nodejs/releases)
- [Changelog](https://github.com/GoogleCloudPlatform/functions-framework-nodejs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/GoogleCloudPlatform/functions-framework-nodejs/compare/v3.1.0...v3.1.2)

---
updated-dependencies:
- dependency-name: "@google-cloud/functions-framework"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-07-25 21:32:05 +00:00
Hongbo Wu
cea1c856f7 fix not getting unsubscribe email address from beehiv newsletter by decoding the list-unsubscribe header 2022-07-25 17:15:12 +08:00
Jackson Harper
c94d5db259 Merge pull request #889 from omnivore-app/dependabot/npm_and_yarn/axios-0.27.2 
Bump axios from 0.26.0 to 0.27.2
 2022-07-08 13:48:27 -07:00
Hongbo Wu
6ea5bc3b18 fix dependecies 2022-07-08 12:10:32 +08:00
Hongbo Wu
7b714e7bc3 fix tests 2022-07-07 17:38:14 +08:00
Hongbo Wu
cb1968a82d Publish unsubscribe header info in the non-newsletter queue 2022-07-07 17:13:18 +08:00
Hongbo Wu
0b15fefeb9 Move parseUnsubscribeHeader to index.ts 2022-07-07 17:12:26 +08:00
dependabot[bot]
e91f25e58c Bump axios from 0.26.0 to 0.27.2 
Bumps [axios](https://github.com/axios/axios) from 0.26.0 to 0.27.2.
- [Release notes](https://github.com/axios/axios/releases)
- [Changelog](https://github.com/axios/axios/blob/v0.27.2/CHANGELOG.md)
- [Commits](https://github.com/axios/axios/compare/v0.26.0...v0.27.2)

---
updated-dependencies:
- dependency-name: axios
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-06-27 21:31:14 +00:00
Hongbo Wu
824d211df2 Support morning brew newsletter and add tests 2022-05-16 10:37:50 +08:00
Hongbo Wu
adfaf6b8ce Use newsletter's title and author as page's ones 2022-05-12 18:08:38 +08:00
Hongbo Wu
6d2700e865 fix tests 2022-04-21 21:31:31 +08:00
Hongbo Wu
ebfdf1f3a0 Fix parsing newsletter url from substack 2022-04-21 21:28:00 +08:00
Hongbo Wu
5c7f4a22bf Save subscriptions when saving newsletters (#447) 
* parse unsub mailTo or httpUrl and send to pubsub

* save subscription from newsletter

* fix tests
 2022-04-20 09:24:40 +08:00
Jackson Harper
29039d098a Merge pull request #375 from omnivore-app/dependabot/npm_and_yarn/google-cloud/functions-framework-3.1.0 
Bump @google-cloud/functions-framework from 3.0.0 to 3.1.0
 2022-04-12 08:46:21 -07:00
Hongbo Wu
0a67032fd3 fix tests 2022-04-06 21:09:22 +08:00
Hongbo Wu
d1269f815e identify a newsletter by checking both list-url and unsubscribe-url in headers and email sender address 2022-04-06 20:59:14 +08:00
dependabot[bot]
452a776aef Bump @google-cloud/functions-framework from 3.0.0 to 3.1.0 
Bumps [@google-cloud/functions-framework](https://github.com/GoogleCloudPlatform/functions-framework-nodejs) from 3.0.0 to 3.1.0.
- [Release notes](https://github.com/GoogleCloudPlatform/functions-framework-nodejs/releases)
- [Changelog](https://github.com/GoogleCloudPlatform/functions-framework-nodejs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/GoogleCloudPlatform/functions-framework-nodejs/compare/v3.0.0...v3.1.0)

---
updated-dependencies:
- dependency-name: "@google-cloud/functions-framework"
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-04-04 22:36:00 +00:00
dependabot[bot]
6ac10c4780 Bump @google-cloud/functions-framework from 1.9.0 to 3.0.0 
Bumps [@google-cloud/functions-framework](https://github.com/GoogleCloudPlatform/functions-framework-nodejs) from 1.9.0 to 3.0.0.
- [Release notes](https://github.com/GoogleCloudPlatform/functions-framework-nodejs/releases)
- [Changelog](https://github.com/GoogleCloudPlatform/functions-framework-nodejs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/GoogleCloudPlatform/functions-framework-nodejs/compare/v1.9.0...v3.0.0)

---
updated-dependencies:
- dependency-name: "@google-cloud/functions-framework"
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-03-23 18:51:39 +00:00
Hongbo Wu
705b67946d Close #115 (#117) 
* forward all emails we failed to handle

* update Regex to get confirmation code from email subject

* add tests

* removed real email from tests
 2022-02-24 10:28:17 +08:00
Hongbo Wu
610c9c6348 Closes #37 (#109) 
* change return value for new version of pubsub

* add support for the other bloomberg newsletters not only business

* add default fallback url if newsletter url not found

* revert pubsub version change
 2022-02-23 11:17:59 +08:00
Jackson Harper
e9b77117c9 update to work with latest GCP API 2022-02-21 16:52:33 -08:00
Hongbo Wu
207f77c419 Add support for Golang Weekly newsletters (#96) 
* abstract different newsletter handler to a class

* create a generic newsletter handler class

* add support for golang-weekly newsletters

* add tests for golang weekly newsletters

* use addressparser lib to parse author from from address
 2022-02-21 14:37:48 +08:00
Jackson Harper
05aa5d737e Merge pull request #82 from omnivore-app/feature/bloomberg-newsletters 
Add support for Bloomberg newsletter
 2022-02-18 01:08:46 +08:00
Hongbo Wu
e3839647e1 parse bloomberg newsletter 2022-02-17 20:14:06 +08:00
Hongbo Wu
ad8bca3d84 use subject as title 2022-02-17 18:59:07 +08:00
Hongbo Wu
7229c64da0 fix: Should not get fake uploading url in demo (#79) 
* fix not getting fake uploading url in demo

* use internal service endpoint env

* update internal svc endpoint
 2022-02-17 13:34:50 +08:00
Hongbo Wu
bd8178a464 add support for bloomberg newsletters 2022-02-17 13:19:58 +08:00
Hongbo Wu
77ba7531f3 add tests for upload 2022-02-16 15:26:11 +08:00
Hongbo Wu
9460197132 add more logs for debugging 2022-02-16 11:34:01 +08:00
Hongbo Wu
5d95e6c734 add pdf attachment upload 2022-02-15 22:22:13 +08:00
Hongbo Wu
e85273d87a add support for axios newsletters (#49) 
* add support for axios newsletters

* fix raw url

* fix getting newsletter url from axios

* add test for url

* add axios parser
 2022-02-15 11:56:03 +08:00
dependabot[bot]
0f843809e3 Bump axios from 0.21.4 to 0.26.0 
Bumps [axios](https://github.com/axios/axios) from 0.21.4 to 0.26.0.
- [Release notes](https://github.com/axios/axios/releases)
- [Changelog](https://github.com/axios/axios/blob/master/CHANGELOG.md)
- [Commits](https://github.com/axios/axios/compare/v0.21.4...v0.26.0)

---
updated-dependencies:
- dependency-name: axios
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-02-14 21:35:58 +00:00
Jackson Harper
8163b5a4de Upgrade axios 2022-02-11 13:51:43 -08:00
Jackson Harper
e0ccb126da Remove some unused mailer dependencies 2022-02-11 12:20:54 -08:00
Jackson Harper
84f32935f5 Open source omnivore 2022-02-11 09:24:33 -08:00