Commit Graph

58 Commits

Author SHA1 Message Date
c59b4ca97e Merge pull request #3054 from omnivore-app/feature/social-feeds
feature: following
2023-11-15 11:19:14 +08:00
17fdbcca2c Some servers look for Accept: text/html for RSS 2023-11-10 21:01:57 +08:00
adf13131db add folder to library_item table 2023-11-10 17:34:46 +08:00
9dfc5f856d rename variables 2023-11-09 19:00:57 +08:00
f96ba17c92 fetch rss content if required 2023-11-09 16:09:23 +08:00
b7496db56c add following handler to save following item 2023-11-09 15:53:44 +08:00
a71181982f create a following task for each rss item fetched 2023-11-09 13:18:24 +08:00
a00ce8893e reduce feed parsing 2023-11-08 18:16:48 +08:00
9b0b378c39 check is_fetching_content and only fetch content if required for rss feed items 2023-11-08 18:16:48 +08:00
41805d13db Bump @sentry/serverless from 6.19.3 to 7.77.0
Bumps [@sentry/serverless](https://github.com/getsentry/sentry-javascript) from 6.19.3 to 7.77.0.
- [Release notes](https://github.com/getsentry/sentry-javascript/releases)
- [Changelog](https://github.com/getsentry/sentry-javascript/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/getsentry/sentry-javascript/compare/6.19.3...7.77.0)

---
updated-dependencies:
- dependency-name: "@sentry/serverless"
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-07 03:35:00 +00:00
d50726f3b4 fix: check lastBuildDate instead of pubDate in rss feed 2023-10-27 21:42:20 +08:00
b8eb376226 fix: wrong node version in docker-file in rss-handler 2023-10-27 16:01:27 +08:00
c4773dc904 Landing page improvements and various supporting improvements 2023-10-24 09:43:39 +01:00
3fa3526a16 fix wrong order of parameters in update scription api integration 2023-10-20 15:16:02 +08:00
25c0ee3b34 return 1 for updateFrequency if it is not a number 2023-10-19 21:08:54 +08:00
1880f2ace4 Update rss handler to fetch a group of rss feeds in one task 2023-10-19 17:27:55 +08:00
88a46e6ee6 Send ok when checksum has not been updated 2023-10-19 14:18:01 +08:00
699e8077dc Add feed custom fields, set timeout/redirects 2023-10-19 09:57:28 +08:00
3a4547a6af Remove debug 2023-10-18 21:01:01 +08:00
d2c0efc540 add some debug 2023-10-18 18:22:22 +08:00
479fc8fb7d Add a test for checksumming 2023-10-18 17:11:02 +08:00
921a46a13a Linting fixes 2023-10-18 16:51:23 +08:00
d592dc44c6 Add back missing pubdate check 2023-10-18 16:34:40 +08:00
cf101c6d18 Cache and check feed checksums to reduce fetching 2023-10-18 16:26:03 +08:00
7f61acc907 skip old feed if the pubDate is before last_fetched timestamp 2023-10-17 19:40:29 +08:00
caa5969940 fix updated subscription always show failed in the rss handler logs 2023-10-11 14:44:39 +08:00
b9af543b45 fix rss feeds 2023-10-05 14:31:06 +08:00
e70fd23ec8 fix 406 not acceptable error from subscribing an rss feed 2023-10-02 22:26:45 +08:00
010e2841da fix getting 403 when parsing some rss url by setting a user agent in the request 2023-09-27 10:38:49 +08:00
ef52c03dfa Add a max count to RSS refreshes 2023-09-15 22:35:58 +08:00
792cf0b207 upgrade google cloud sdk 2023-08-11 13:55:29 +08:00
e83a55c845 use alternate link before self 2023-08-04 16:30:17 +08:00
85575917ff use published or updated if isoDate is not available for atom feeds 2023-08-03 22:21:11 +08:00
0ad562c46c fix parsing rss item link error because links can be an array of string too 2023-08-03 15:50:56 +08:00
0da4494772 fix link parsing error 2023-08-03 13:22:03 +08:00
82d820ea8f get link following the order of preference: via, self, alternate 2023-08-03 13:05:26 +08:00
88dec7e53e save latest rss feed item which is older than 24 hours if the feed has never been fetched and no need feed items 2023-07-21 12:34:13 +08:00
c891389b18 save rss feed without isoDate 2023-07-20 14:31:53 +08:00
cd440a77c3 send last fetched at as a unix timestamp in ms 2023-07-19 14:09:38 +08:00
234b51af28 reword comment 2023-07-19 13:45:44 +08:00
834c4ec2bd if the feed has never been fetched, save the last valid item 2023-07-19 13:44:29 +08:00
896b03a4db fix invalid request body in rss handler 2023-07-17 18:14:15 +08:00
c7edfdb27d fetch items published within 24 hours 2023-07-17 17:27:59 +08:00
03ce4b00d2 add authorization header in rss feed fetching request 2023-07-17 17:27:12 +08:00
387174c8e9 use isoDate only 2023-07-14 13:54:55 +08:00
153662ce6a set savedAt and publishedAt timestamp for rss item 2023-07-14 12:21:34 +08:00
6531dd30e9 skip rss items which are published before 48 hours 2023-07-14 12:08:08 +08:00
82d1cb221b change rss color to match rss icon 2023-07-13 11:44:57 +08:00
78b40dbddc fix date comparison 2023-07-13 10:56:34 +08:00
0170ea3109 fetch rss item by url 2023-07-13 10:09:48 +08:00