|
|
3fa3526a16
|
fix wrong order of parameters in update scription api integration
|
2023-10-20 15:16:02 +08:00 |
|
|
|
25c0ee3b34
|
return 1 for updateFrequency if it is not a number
|
2023-10-19 21:08:54 +08:00 |
|
|
|
1880f2ace4
|
Update rss handler to fetch a group of rss feeds in one task
|
2023-10-19 17:27:55 +08:00 |
|
|
|
88a46e6ee6
|
Send ok when checksum has not been updated
|
2023-10-19 14:18:01 +08:00 |
|
|
|
699e8077dc
|
Add feed custom fields, set timeout/redirects
|
2023-10-19 09:57:28 +08:00 |
|
|
|
3a4547a6af
|
Remove debug
|
2023-10-18 21:01:01 +08:00 |
|
|
|
d2c0efc540
|
add some debug
|
2023-10-18 18:22:22 +08:00 |
|
|
|
479fc8fb7d
|
Add a test for checksumming
|
2023-10-18 17:11:02 +08:00 |
|
|
|
921a46a13a
|
Linting fixes
|
2023-10-18 16:51:23 +08:00 |
|
|
|
d592dc44c6
|
Add back missing pubdate check
|
2023-10-18 16:34:40 +08:00 |
|
|
|
cf101c6d18
|
Cache and check feed checksums to reduce fetching
|
2023-10-18 16:26:03 +08:00 |
|
|
|
7f61acc907
|
skip old feed if the pubDate is before last_fetched timestamp
|
2023-10-17 19:40:29 +08:00 |
|
|
|
caa5969940
|
fix updated subscription always show failed in the rss handler logs
|
2023-10-11 14:44:39 +08:00 |
|
|
|
b9af543b45
|
fix rss feeds
|
2023-10-05 14:31:06 +08:00 |
|
|
|
e70fd23ec8
|
fix 406 not acceptable error from subscribing an rss feed
|
2023-10-02 22:26:45 +08:00 |
|
|
|
010e2841da
|
fix getting 403 when parsing some rss url by setting a user agent in the request
|
2023-09-27 10:38:49 +08:00 |
|
|
|
ef52c03dfa
|
Add a max count to RSS refreshes
|
2023-09-15 22:35:58 +08:00 |
|
|
|
792cf0b207
|
upgrade google cloud sdk
|
2023-08-11 13:55:29 +08:00 |
|
|
|
e83a55c845
|
use alternate link before self
|
2023-08-04 16:30:17 +08:00 |
|
|
|
85575917ff
|
use published or updated if isoDate is not available for atom feeds
|
2023-08-03 22:21:11 +08:00 |
|
|
|
0ad562c46c
|
fix parsing rss item link error because links can be an array of string too
|
2023-08-03 15:50:56 +08:00 |
|
|
|
0da4494772
|
fix link parsing error
|
2023-08-03 13:22:03 +08:00 |
|
|
|
82d820ea8f
|
get link following the order of preference: via, self, alternate
|
2023-08-03 13:05:26 +08:00 |
|
|
|
88dec7e53e
|
save latest rss feed item which is older than 24 hours if the feed has never been fetched and no need feed items
|
2023-07-21 12:34:13 +08:00 |
|
|
|
c891389b18
|
save rss feed without isoDate
|
2023-07-20 14:31:53 +08:00 |
|
|
|
cd440a77c3
|
send last fetched at as a unix timestamp in ms
|
2023-07-19 14:09:38 +08:00 |
|
|
|
234b51af28
|
reword comment
|
2023-07-19 13:45:44 +08:00 |
|
|
|
834c4ec2bd
|
if the feed has never been fetched, save the last valid item
|
2023-07-19 13:44:29 +08:00 |
|
|
|
896b03a4db
|
fix invalid request body in rss handler
|
2023-07-17 18:14:15 +08:00 |
|
|
|
c7edfdb27d
|
fetch items published within 24 hours
|
2023-07-17 17:27:59 +08:00 |
|
|
|
03ce4b00d2
|
add authorization header in rss feed fetching request
|
2023-07-17 17:27:12 +08:00 |
|
|
|
387174c8e9
|
use isoDate only
|
2023-07-14 13:54:55 +08:00 |
|
|
|
153662ce6a
|
set savedAt and publishedAt timestamp for rss item
|
2023-07-14 12:21:34 +08:00 |
|
|
|
6531dd30e9
|
skip rss items which are published before 48 hours
|
2023-07-14 12:08:08 +08:00 |
|
|
|
82d1cb221b
|
change rss color to match rss icon
|
2023-07-13 11:44:57 +08:00 |
|
|
|
78b40dbddc
|
fix date comparison
|
2023-07-13 10:56:34 +08:00 |
|
|
|
0170ea3109
|
fetch rss item by url
|
2023-07-13 10:09:48 +08:00 |
|
|
|
6f201a9cb4
|
fix save page api request invalid parameter
|
2023-07-12 17:50:25 +08:00 |
|
|
|
b1b4a2e3fd
|
save rss feed url in the index
|
2023-07-11 13:14:43 +08:00 |
|
|
|
eb9a3eddd0
|
skip old item
|
2023-07-11 12:59:55 +08:00 |
|
|
|
44473ba089
|
upload feed subscriptions in cloud storage in cronjob
|
2023-07-11 12:22:49 +08:00 |
|
|
|
08182adbe1
|
remove cloud task
|
2023-07-10 16:46:13 +08:00 |
|
|
|
c39799fb67
|
update subscription lastFetchedAt after fetching all items
|
2023-07-10 15:54:21 +08:00 |
|
|
|
abd59f0527
|
save each item in a feed
|
2023-07-07 21:48:16 +08:00 |
|
|
|
a7773bf00b
|
test rss-parse
|
2023-07-06 19:51:30 +08:00 |
|
