Commit Graph

117 Commits

Author SHA1 Message Date
a4533dc016 Merge pull request #201 from omnivore-app/feature/beehiiv-newsletter-support
Support newsletters hosted on beehiiv
2022-03-15 14:03:55 -07:00
8e1b4fb1a4 Formatting 2022-03-14 15:36:17 -07:00
a81181ee60 Dont make queries for readingProgressPercent unless we have to 2022-03-14 15:22:53 -07:00
fc7d972855 Fix typo in readability date handling causing this parse issue
Can remove our special handler for the published date now that we
are pulling it out correctly.
2022-03-14 10:20:19 -07:00
5983cfe2a6 Attempt to set publishedDate if readability fails to parse it
This can happen if JSONLD fails to load. The test page here has
an encoding issue that causes the oembed jsonld to fail to load
and then readability fails to parse the date.
2022-03-13 21:23:51 -07:00
78660c886d rm debug 2022-03-13 09:06:15 -07:00
a874482d11 Dont perform an extra query for isArchived 2022-03-13 09:00:25 -07:00
bea7d084c4 SetClaims when creating an email article 2022-03-09 19:45:52 -08:00
f7814a0c4a Remove unused function 2022-03-09 19:45:31 -08:00
b0fe9059a9 Dont try to generate highlight URL previews until share is re-enabled 2022-03-09 09:49:03 -08:00
a5a42a36e7 Merge pull request #206 from omnivore-app/dependabot/npm_and_yarn/opentelemetry/exporter-jaeger-1.0.1
Bump @opentelemetry/exporter-jaeger from 0.24.0 to 1.0.1
2022-03-08 21:00:53 -08:00
9bda6ede06 Bump @opentelemetry/exporter-jaeger from 0.24.0 to 1.0.1
Bumps [@opentelemetry/exporter-jaeger](https://github.com/open-telemetry/opentelemetry-js) from 0.24.0 to 1.0.1.
- [Release notes](https://github.com/open-telemetry/opentelemetry-js/releases)
- [Changelog](https://github.com/open-telemetry/opentelemetry-js/blob/main/CHANGELOG.md)
- [Commits](https://github.com/open-telemetry/opentelemetry-js/compare/v0.24.0...stable/v1.0.1)

---
updated-dependencies:
- dependency-name: "@opentelemetry/exporter-jaeger"
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-03-09 04:45:18 +00:00
384a0771a7 Merge pull request #200 from omnivore-app/fix/validate-urls
Use the validateUrl method to validate URLs
2022-03-08 20:28:33 -08:00
c45c408c14 Fix formatting 2022-03-08 15:27:05 -08:00
e8fca4a7a9 Remove debug line 2022-03-08 15:20:24 -08:00
354fe36dd5 Add a test for save email 2022-03-08 15:17:11 -08:00
26dadab4aa rm debug, we dont need to set claims on create 2022-03-08 15:10:01 -08:00
b982bf34d6 SetClaims on userArticle create/update in saveEmail 2022-03-08 14:43:10 -08:00
9ae81d7394 Add extra debugging on newsletter save errors 2022-03-08 14:00:35 -08:00
2184c2a8d3 Parse online URLs for beehiiv newsletters 2022-03-07 15:49:44 -08:00
2cb5cc065a Add support for identifying newsletters hosted on beehiiv.com 2022-03-07 15:23:56 -08:00
bba094fbcd Add tests for beehiiv.com hosted newsletters 2022-03-07 15:05:38 -08:00
be7e36ffed Use the validateUrl method to validate URLs 2022-03-07 14:34:32 -08:00
ae329d2651 Add test data file 2022-03-03 19:47:37 -08:00
b6fd3e786e Fix parsing authors from page metadata 2022-03-03 19:40:02 -08:00
49092b707d Remove async 2022-03-03 19:31:51 -08:00
05373ba3c7 add methid to parse content metadata 2022-03-03 17:10:06 -08:00
c2e08d0e8f Fetch title and author from page metadate if possible 2022-03-03 15:20:58 -08:00
b17f22949c Use the readability title if available 2022-03-03 14:21:30 -08:00
a4bb67deee Use the readability byline for email authors if available 2022-03-03 14:21:03 -08:00
b326a5f8e7 Add more matches on substack icons 2022-03-03 13:42:30 -08:00
484cd78ac5 prettier 2022-03-02 23:14:10 -08:00
65ce8353dc Attempt to pull URLs for probable newsletter emails out of content 2022-03-02 23:09:10 -08:00
21329949e5 Fix to email address in saveNewsletterEmail 2022-03-02 22:06:15 -08:00
02d505a7e2 Add some debugging 2022-03-02 21:39:10 -08:00
8fe9827ad2 If an email appears to be a newsletter at it to the library 2022-03-02 20:47:53 -08:00
65cc666579 Pass HTML instead of a JSDOM into isProbablyNewsletter to better encapsulate 2022-03-02 20:38:11 -08:00
c4e237927d Allow any on GCP func 2022-03-02 20:27:40 -08:00
e660e41ed5 Fix warnings 2022-03-02 19:49:10 -08:00
9206230659 Better name for the save newsletter service 2022-03-02 19:45:28 -08:00
d66c114a7d Remove file, this is moved into the parser 2022-03-02 16:36:36 -08:00
b5f9478350 Dont mutate function input 2022-03-02 16:34:56 -08:00
f7f83fe080 New function to determine if an HTML blob is probably a newsletter based on its content 2022-03-02 16:31:15 -08:00
505f888e37 Update to latest intercom client 2022-03-01 11:20:31 -08:00
cadccfc7e1 Bump intercom-client from 2.11.2 to 3.1.4
Bumps [intercom-client](https://github.com/intercom/intercom-node) from 2.11.2 to 3.1.4.
- [Release notes](https://github.com/intercom/intercom-node/releases)
- [Commits](https://github.com/intercom/intercom-node/commits/v3.1.4)

---
updated-dependencies:
- dependency-name: intercom-client
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-03-01 18:40:33 +00:00
fc9aa9452c Add a flag in readability to retain table elements in newsletter emails (#152)
* add a flag in readability to retain table elements in newsletter emails

* remove header of axios newsletters
2022-03-01 11:49:38 +08:00
b2faf8a78d Bump @opentelemetry/instrumentation-express from 0.24.0 to 0.28.0
Bumps [@opentelemetry/instrumentation-express](https://github.com/open-telemetry/opentelemetry-js-contrib) from 0.24.0 to 0.28.0.
- [Release notes](https://github.com/open-telemetry/opentelemetry-js-contrib/releases)
- [Changelog](https://github.com/open-telemetry/opentelemetry-js-contrib/blob/main/CHANGELOG.md)
- [Commits](https://github.com/open-telemetry/opentelemetry-js-contrib/compare/v0.24.0...contrib-test-utils-v0.28.0)

---
updated-dependencies:
- dependency-name: "@opentelemetry/instrumentation-express"
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-02-28 21:27:15 +00:00
7bf454ae91 use dataloader to fetch all labels of a list of linkIds in a single q… (#133)
* use dataloader to fetch all labels of a list of linkIds in a single query and cached

* add labels in GQL query in frontend
2022-02-28 12:13:26 +08:00
328ebc48cb Apply code block highlighting before running DOM clean 2022-02-26 19:04:32 -08:00
e0b8cfc938 Import highlightjs types
We still need these dev packages because of the way our docker
builds are setup.
2022-02-26 17:37:01 -08:00