|
|
08fbb8aebf
|
use different queues for fast,slow and rss content fetch jobs
|
2024-08-21 12:24:35 +08:00 |
|
|
|
e3eae1c96c
|
create a worker to process content-fetch job
|
2024-08-21 12:24:35 +08:00 |
|
|
|
bbc7b5e600
|
use @omnivore/utils in import-handler
|
2024-07-03 22:20:27 +08:00 |
|
|
|
59c826fd5e
|
use @omnivore/utils in content-fetch
|
2024-07-03 21:58:22 +08:00 |
|
|
|
9dee510be1
|
fix rss
|
2024-05-14 20:18:18 +08:00 |
|
|
|
cce5f2463d
|
still use redis for cache
|
2024-05-14 17:16:26 +08:00 |
|
|
|
9286174ec7
|
upload and download original content from GCS
|
2024-05-14 17:14:40 +08:00 |
|
|
|
a924c8448b
|
capture content-fetch success and error events
|
2024-05-13 14:55:48 +08:00 |
|
|
|
a6f0e2f2d9
|
add save page job processor
|
2024-01-18 18:48:46 +08:00 |
|
|
|
0015a946b2
|
create batch save page jobs after fetching content
|
2024-01-18 18:48:46 +08:00 |
|
|
|
d9feb740cb
|
convert content-fetch to typescript
|
2024-01-18 18:48:46 +08:00 |
|
|
|
51e586ed3d
|
separate content-fetch in puppeteer packages from saving page content
|
2024-01-18 18:48:46 +08:00 |
|
|
|
41805d13db
|
Bump @sentry/serverless from 6.19.3 to 7.77.0
Bumps [@sentry/serverless](https://github.com/getsentry/sentry-javascript) from 6.19.3 to 7.77.0.
- [Release notes](https://github.com/getsentry/sentry-javascript/releases)
- [Changelog](https://github.com/getsentry/sentry-javascript/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/getsentry/sentry-javascript/compare/6.19.3...7.77.0)
---
updated-dependencies:
- dependency-name: "@sentry/serverless"
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
|
2023-11-07 03:35:00 +00:00 |
|
|
|
c4773dc904
|
Landing page improvements and various supporting improvements
|
2023-10-24 09:43:39 +01:00 |
|
|
|
e75e49a7b4
|
Remove logging dependecies in puppeteer-parse
|
2022-11-17 11:28:26 +08:00 |
|
|
|
db8c9cf97d
|
Add function-framework dependency
|
2022-11-16 10:52:07 +08:00 |
|
|
|
d6e687d5d1
|
Update env example
|
2022-11-16 10:15:49 +08:00 |
|
|
|
b18af10e75
|
Import puppeteer-parse in content-fetch
|
2022-11-16 10:15:49 +08:00 |
|
|
|
00fed8a0fb
|
Remove content-fetch-gcf and create a Dockerfile for the cloud function
|
2022-11-16 10:15:49 +08:00 |
|
|
|
623bb8780c
|
Call puppeteer module from content-fetch
|
2022-11-16 10:15:49 +08:00 |
|
|
|
53d6afe25f
|
Fix tests
|
2022-10-04 10:47:58 +08:00 |
|
|
|
a9607adfd3
|
Import content-handler as local dependency
|
2022-10-03 11:11:24 +08:00 |
|
|
|
8c61832c77
|
Import content-handler in content-fetch
|
2022-09-30 12:51:22 +08:00 |
|
|
|
cb609d893e
|
Escape HTML entities in puppeteer-parse
|
2022-09-23 16:40:32 +08:00 |
|
|
|
d12f3642e6
|
Bump puppeteer-core from 15.3.2 to 16.1.0
Bumps [puppeteer-core](https://github.com/puppeteer/puppeteer) from 15.3.2 to 16.1.0.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/CHANGELOG.md)
- [Commits](https://github.com/puppeteer/puppeteer/compare/v15.3.2...v16.1.0)
---
updated-dependencies:
- dependency-name: puppeteer-core
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
|
2022-08-11 02:15:16 +00:00 |
|
|
|
610c790a7e
|
do not use puppeteer-extra plugin
|
2022-07-15 11:09:57 +08:00 |
|
|
|
bb7ea78e8f
|
Bump puppeteer-core from 13.7.0 to 15.3.2
Bumps [puppeteer-core](https://github.com/puppeteer/puppeteer) from 13.7.0 to 15.3.2.
- [Release notes](https://github.com/puppeteer/puppeteer/releases)
- [Changelog](https://github.com/puppeteer/puppeteer/blob/main/CHANGELOG.md)
- [Commits](https://github.com/puppeteer/puppeteer/compare/v13.7.0...v15.3.2)
---
updated-dependencies:
- dependency-name: puppeteer-core
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
|
2022-07-11 21:35:51 +00:00 |
|
|
|
e91f25e58c
|
Bump axios from 0.26.0 to 0.27.2
Bumps [axios](https://github.com/axios/axios) from 0.26.0 to 0.27.2.
- [Release notes](https://github.com/axios/axios/releases)
- [Changelog](https://github.com/axios/axios/blob/v0.27.2/CHANGELOG.md)
- [Commits](https://github.com/axios/axios/compare/v0.26.0...v0.27.2)
---
updated-dependencies:
- dependency-name: axios
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
|
2022-06-27 21:31:14 +00:00 |
|
|
|
b766e17189
|
Remove jsdom in content-fetch
|
2022-05-12 16:48:59 +08:00 |
|
|
|
9606cd6b28
|
Remove chrome-aws-lambda dependencies
|
2022-05-12 16:32:22 +08:00 |
|
|
|
45a2a1393f
|
Use chrome-aws-lambda args
|
2022-05-09 20:59:20 +08:00 |
|
|
|
6f82499deb
|
Merge puppeteer changes
|
2022-05-09 13:52:40 +08:00 |
|
|
|
fd934a949e
|
Add a standalone service content fetching
|
2022-05-08 21:52:36 -07:00 |
|
