Commit Graph

91 Commits

Author SHA1 Message Date
88a7e8d85b fix tests 2024-04-04 12:17:15 +08:00
03f89d890e fix tests 2024-02-08 10:42:37 +08:00
d357d2b0af fix tests 2024-01-24 13:41:49 +08:00
628cfc64d1 fix: replace \n with new line in redis cert 2024-01-22 11:09:15 +08:00
c297a8dd4e feat: group fetch content tasks by url 2024-01-18 18:48:46 +08:00
150a456c35 replace redis client library with ioredis 2024-01-16 15:42:50 +08:00
b65ada2a55 fix: too many open redis connections 2024-01-10 11:55:58 +08:00
34e6f1b00a fix redis command server incompatibility 2024-01-09 16:26:54 +08:00
26f91b3601 Merge pull request #3340 from omnivore-app/fix/test
fix rss handler tests
2024-01-09 12:36:19 +08:00
3cfee2915a fix rss handler tests 2024-01-09 12:23:39 +08:00
131261431d add comment 2024-01-09 12:09:42 +08:00
0969e81de3 fix: catch rss parsing failure in a nested try-catch block 2024-01-09 12:04:14 +08:00
a2ab8327ca fix: increment feed fetch failed count if rss feed is failed to fetch 2024-01-09 11:22:20 +08:00
44bed67e35 add comment 2024-01-05 15:41:01 +08:00
ccd4f2d3f0 catch redis client error and continue the process 2024-01-05 15:20:42 +08:00
b54b696fab skip parsing blocked feeds stored in redis 2024-01-04 23:06:37 +08:00
6d48816c22 fix tests 2024-01-04 22:42:31 +08:00
08c4624fce save the url in redis for 8 hours so rss-feeder will not try to re-save it 2024-01-04 18:03:34 +08:00
0f774b6ae4 skip recently saved rss item 2024-01-04 17:36:12 +08:00
816416934f Move the rss content block check to the rss handler 2023-12-29 12:42:43 +08:00
c9b93a1180 Dont try to fetch content for some feed URLs like arvix which blocks fetches 2023-12-29 12:26:43 +08:00
e0b8e4ae2b Merge pull request #3250 from omnivore-app/fix/duplicate-rss-item
skip fetching re-published items in the feed to deduplicate
2023-12-15 17:42:38 +08:00
1b9590f010 add test cases 2023-12-15 17:29:29 +08:00
991f984b6f skip fetching re-published items in the feed to deduplicate 2023-12-15 13:48:43 +08:00
a257147fc5 fetch following item content only when required 2023-12-14 17:25:55 +08:00
bd3945fc7e Merge pull request #3164 from omnivore-app/feature/fetch-content-for-following
feat: fetch content for rss feed items in following folder
2023-11-28 12:07:17 +08:00
3824da2ae5 Merge pull request #3166 from omnivore-app/feature/scan-feeds-api
add scan feeds api to scan feeds from opml or html
2023-11-28 11:27:36 +08:00
87bd9d5b60 Add group membership, more debug 2023-11-25 12:59:03 +08:00
af5040a518 saving posts from telegram channel as rss items 2023-11-24 17:23:35 +08:00
fd781644f1 feat: fetch content for rss feed items in following folder 2023-11-23 18:03:25 +08:00
4e60396d17 save thumbnail of the following item 2023-11-20 17:28:34 +08:00
148f329770 use service base url 2023-11-16 11:54:34 +08:00
5057448c4f update following task handler url 2023-11-15 15:58:17 +08:00
c59b4ca97e Merge pull request #3054 from omnivore-app/feature/social-feeds
feature: following
2023-11-15 11:19:14 +08:00
17fdbcca2c Some servers look for Accept: text/html for RSS 2023-11-10 21:01:57 +08:00
adf13131db add folder to library_item table 2023-11-10 17:34:46 +08:00
9dfc5f856d rename variables 2023-11-09 19:00:57 +08:00
f96ba17c92 fetch rss content if required 2023-11-09 16:09:23 +08:00
b7496db56c add following handler to save following item 2023-11-09 15:53:44 +08:00
a71181982f create a following task for each rss item fetched 2023-11-09 13:18:24 +08:00
a00ce8893e reduce feed parsing 2023-11-08 18:16:48 +08:00
9b0b378c39 check is_fetching_content and only fetch content if required for rss feed items 2023-11-08 18:16:48 +08:00
41805d13db Bump @sentry/serverless from 6.19.3 to 7.77.0
Bumps [@sentry/serverless](https://github.com/getsentry/sentry-javascript) from 6.19.3 to 7.77.0.
- [Release notes](https://github.com/getsentry/sentry-javascript/releases)
- [Changelog](https://github.com/getsentry/sentry-javascript/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/getsentry/sentry-javascript/compare/6.19.3...7.77.0)

---
updated-dependencies:
- dependency-name: "@sentry/serverless"
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-07 03:35:00 +00:00
d50726f3b4 fix: check lastBuildDate instead of pubDate in rss feed 2023-10-27 21:42:20 +08:00
b8eb376226 fix: wrong node version in docker-file in rss-handler 2023-10-27 16:01:27 +08:00
c4773dc904 Landing page improvements and various supporting improvements 2023-10-24 09:43:39 +01:00
3fa3526a16 fix wrong order of parameters in update scription api integration 2023-10-20 15:16:02 +08:00
25c0ee3b34 return 1 for updateFrequency if it is not a number 2023-10-19 21:08:54 +08:00
1880f2ace4 Update rss handler to fetch a group of rss feeds in one task 2023-10-19 17:27:55 +08:00
88a46e6ee6 Send ok when checksum has not been updated 2023-10-19 14:18:01 +08:00