|
|
f2ff4b7b0a
|
fix: only send content_fetch_failure event to analytics
|
2024-05-31 12:44:01 +08:00 |
|
|
|
fc9d5c64ec
|
do not fail if cache missed
|
2024-05-17 17:27:34 +08:00 |
|
|
|
6f2aa2e0cd
|
add more logs
|
2024-05-17 17:19:55 +08:00 |
|
|
|
52ebf466e3
|
get content from cache first when saving url
|
2024-05-17 16:46:54 +08:00 |
|
|
|
9c3d619ad5
|
put locale and timezone in cache key
|
2024-05-17 16:22:20 +08:00 |
|
|
|
dde9f16396
|
put error message in the analytic event
|
2024-05-17 16:16:44 +08:00 |
|
|
|
f3ce6f4d4e
|
catch content fetch result in redis
|
2024-05-17 15:55:28 +08:00 |
|
|
|
efb9b6b139
|
add source to the content_fetch event
|
2024-05-17 14:54:46 +08:00 |
|
|
|
9dee510be1
|
fix rss
|
2024-05-14 20:18:18 +08:00 |
|
|
|
cce5f2463d
|
still use redis for cache
|
2024-05-14 17:16:26 +08:00 |
|
|
|
04ba62977e
|
fix rebase conflicts
|
2024-05-14 17:14:41 +08:00 |
|
|
|
e093c9e096
|
fix comment
|
2024-05-14 17:14:41 +08:00 |
|
|
|
3e925e0193
|
update comment
|
2024-05-14 17:14:41 +08:00 |
|
|
|
5bd157ca25
|
hash url as the key
|
2024-05-14 17:14:41 +08:00 |
|
|
|
7a0b2f3d33
|
upload file only not exists
|
2024-05-14 17:14:41 +08:00 |
|
|
|
9286174ec7
|
upload and download original content from GCS
|
2024-05-14 17:14:40 +08:00 |
|
|
|
33e1c4dd00
|
remove flush method from analytics class
|
2024-05-13 19:10:14 +08:00 |
|
|
|
7634ed667f
|
capture total time of fetching a page
|
2024-05-13 17:01:52 +08:00 |
|
|
|
f64bd4700f
|
update analytic event details
|
2024-05-13 15:18:04 +08:00 |
|
|
|
a924c8448b
|
capture content-fetch success and error events
|
2024-05-13 14:55:48 +08:00 |
|
|
|
0c0a95a79c
|
fix newsletter dir not saved correctly
|
2024-04-24 21:10:13 +08:00 |
|
|
|
824b256d20
|
fix memory leak from axios error
|
2024-04-24 15:55:54 +08:00 |
|
|
|
7f441b4ff3
|
dedupe save-page job
|
2024-04-23 21:44:25 +08:00 |
|
|
|
88a7e8d85b
|
fix tests
|
2024-04-04 12:17:15 +08:00 |
|
|
|
927394e07c
|
fix: save url operation is delayed
|
2024-02-21 17:54:08 +08:00 |
|
|
|
819135f118
|
Label the content-fetch and web images
|
2024-02-21 14:16:21 +08:00 |
|
|
|
856a7bc5ef
|
Add health checks to content-fetch
|
2024-02-12 14:42:51 +08:00 |
|
|
|
86f4553dd1
|
fix: duplicate key value violates unique constraint "library_item_pkey"
|
2024-02-07 20:41:34 +08:00 |
|
|
|
9a342f273c
|
Increase delay on save page retry
|
2024-02-06 12:41:11 +08:00 |
|
|
|
9e6b5d2dcf
|
Backoff for save page
|
2024-02-03 15:35:08 +08:00 |
|
|
|
fd80724d79
|
fallback to guid if link of rss item is not available
|
2024-01-26 22:09:53 +08:00 |
|
|
|
52419c39da
|
resolve conflicts
|
2024-01-26 13:01:53 +08:00 |
|
|
|
e4e07c8acf
|
cache fetched content for 24 hours
|
2024-01-26 13:01:53 +08:00 |
|
|
|
7e89235806
|
update content-fetch
|
2024-01-26 13:01:53 +08:00 |
|
|
|
5e239d2568
|
run readability in save-page instead of puppeteer
|
2024-01-25 16:30:59 +08:00 |
|
|
|
f4a2edf8f4
|
show detailed logs
|
2024-01-23 16:58:08 +08:00 |
|
|
|
fd0bb37d3a
|
make title optional for cache
|
2024-01-23 16:54:35 +08:00 |
|
|
|
1332cda356
|
give highest priority to save-page job for adding items by links
|
2024-01-23 16:48:57 +08:00 |
|
|
|
eac93e6cb6
|
Reduce logging
|
2024-01-22 12:02:35 +08:00 |
|
|
|
6ab737432b
|
More logging
|
2024-01-21 15:31:16 +08:00 |
|
|
|
52050728ba
|
Add more debugging logs
|
2024-01-20 10:29:07 +08:00 |
|
|
|
6b89f4b809
|
graceful shutdown redis
|
2024-01-19 18:06:12 +08:00 |
|
|
|
356ad38678
|
reduce logs
|
2024-01-19 18:01:09 +08:00 |
|
|
|
4340286b89
|
add retry on failure in jobs
|
2024-01-19 17:38:25 +08:00 |
|
|
|
8acdea5002
|
set cache if not exists
|
2024-01-19 17:14:49 +08:00 |
|
|
|
51d5166321
|
get cached content from redis when saving pages
|
2024-01-19 17:06:37 +08:00 |
|
|
|
699d38609b
|
cache fetch result in redis
|
2024-01-19 16:58:24 +08:00 |
|
|
|
7c25a628d9
|
fix pem format
|
2024-01-19 11:44:16 +08:00 |
|
|
|
2e8f173879
|
create queue on start up
|
2024-01-19 11:26:53 +08:00 |
|
|
|
a6d7623cea
|
do not close redis connection
|
2024-01-19 10:39:10 +08:00 |
|
