13 Commits

Author	SHA1	Message	Date
Hongbo Wu	fd80724d79	fallback to guid if link of rss item is not available	2024-01-26 22:09:53 +08:00
Hongbo Wu	e4e07c8acf	cache fetched content for 24 hours	2024-01-26 13:01:53 +08:00
Hongbo Wu	5e239d2568	run readability in save-page instead of puppeteer	2024-01-25 16:30:59 +08:00
Hongbo Wu	fd0bb37d3a	make title optional for cache	2024-01-23 16:54:35 +08:00
Hongbo Wu	356ad38678	reduce logs	2024-01-19 18:01:09 +08:00
Hongbo Wu	8acdea5002	set cache if not exists	2024-01-19 17:14:49 +08:00
Hongbo Wu	51d5166321	get cached content from redis when saving pages	2024-01-19 17:06:37 +08:00
Hongbo Wu	699d38609b	cache fetch result in redis	2024-01-19 16:58:24 +08:00
Hongbo Wu	d4f49dceb6	remove job id	2024-01-18 18:48:46 +08:00
Hongbo Wu	a6f0e2f2d9	add save page job processor	2024-01-18 18:48:46 +08:00
Hongbo Wu	43df5d30a8	prioritized jobs	2024-01-18 18:48:46 +08:00
Hongbo Wu	0015a946b2	create batch save page jobs after fetching content	2024-01-18 18:48:46 +08:00
Hongbo Wu	d9feb740cb	convert content-fetch to typescript	2024-01-18 18:48:46 +08:00