|
|
70d6e9dcae
|
reduce logs
|
2024-08-29 18:18:17 +08:00 |
|
|
|
0366c426bc
|
process up to 2 jobs concurrently
|
2024-08-21 17:58:58 +08:00 |
|
|
|
03ff18af81
|
remove unused dependencies
|
2024-08-21 14:09:49 +08:00 |
|
|
|
0fbc6d0a87
|
update importer to use content-fetch queue
|
2024-08-21 12:24:35 +08:00 |
|
|
|
49556453e9
|
fix importer dependency
|
2024-08-13 17:38:31 +08:00 |
|
|
|
3fe22e0f8e
|
Merge pull request #4215 from omnivore-app/feature/exporter
create a cloud run service for the exporter
|
2024-08-13 17:20:44 +08:00 |
|
|
|
110f537e72
|
sleep for 1 second to avoid rate limiting
|
2024-07-22 18:36:11 +08:00 |
|
|
|
95657e3d3e
|
queue email sending jobs in exporter and importer
|
2024-07-21 11:11:29 +08:00 |
|
|
|
01bce43781
|
create a cloud run service for the exporter
|
2024-07-19 17:12:40 +08:00 |
|
|
|
56a97e5711
|
Bump @fast-csv/parse from 4.3.6 to 5.0.0
Bumps [@fast-csv/parse](https://github.com/C2FO/fast-csv/tree/HEAD/packages/parse) from 4.3.6 to 5.0.0.
- [Release notes](https://github.com/C2FO/fast-csv/releases)
- [Changelog](https://github.com/C2FO/fast-csv/blob/main/packages/parse/CHANGELOG.md)
- [Commits](https://github.com/C2FO/fast-csv/commits/v5.0.0/packages/parse)
---
updated-dependencies:
- dependency-name: "@fast-csv/parse"
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
|
2024-07-08 21:53:29 +00:00 |
|
|
|
649463b785
|
only disconnect redis message queue client if it is different from cache client
|
2024-07-04 16:09:32 +08:00 |
|
|
|
0a1b7345e9
|
add timeout
|
2024-07-04 12:56:28 +08:00 |
|
|
|
bbc7b5e600
|
use @omnivore/utils in import-handler
|
2024-07-03 22:20:27 +08:00 |
|
|
|
88a7e8d85b
|
fix tests
|
2024-04-04 12:17:15 +08:00 |
|
|
|
c356183acd
|
Remove typescript and eslint changes
|
2024-03-12 11:01:44 +08:00 |
|
|
|
7d291f084b
|
Merge all changes from main, update theming of Discover
|
2024-03-07 17:39:57 +01:00 |
|
|
|
628cfc64d1
|
fix: replace \n with new line in redis cert
|
2024-01-22 11:09:15 +08:00 |
|
|
|
8a91a3c629
|
fix importer tests
|
2024-01-18 18:48:46 +08:00 |
|
|
|
150a456c35
|
replace redis client library with ioredis
|
2024-01-16 15:42:50 +08:00 |
|
|
|
c0373646cb
|
Fix Linting...
|
2024-01-09 11:22:32 +01:00 |
|
|
|
32ae38fcba
|
upgrade sentry to 7.77.0 in packages/api
|
2023-11-08 12:23:36 +08:00 |
|
|
|
dd1cb188e4
|
fix tests
|
2023-10-30 14:41:53 +08:00 |
|
|
|
47f67c237d
|
change source to pocket if item is imported from pocket
|
2023-10-30 14:41:52 +08:00 |
|
|
|
c4773dc904
|
Landing page improvements and various supporting improvements
|
2023-10-24 09:43:39 +01:00 |
|
|
|
9ee87e2e52
|
convert type of date in the csv to int before parsing date
|
2023-08-15 18:44:30 +08:00 |
|
|
|
e3654e8ae2
|
fix test
|
2023-08-14 16:38:24 +08:00 |
|
|
|
d25f19207b
|
add savedAt and publishedAt to the csv file
|
2023-08-14 13:49:06 +08:00 |
|
|
|
ba2d34c1af
|
validate csv file in the importer
|
2023-08-14 13:38:36 +08:00 |
|
|
|
792cf0b207
|
upgrade google cloud sdk
|
2023-08-11 13:55:29 +08:00 |
|
|
|
fa1ff9ba17
|
Upgrade node to 18.16
|
2023-07-24 15:55:11 +08:00 |
|
|
|
fc7a649566
|
limit import to 20k urls
|
2023-07-17 18:09:13 +08:00 |
|
|
|
af7350bd31
|
fix: importer status update email not sent
* create omnivore-authorization header to contain the token
|
2023-06-28 11:00:40 +08:00 |
|
|
|
8ad937ed84
|
allow more labels format in the csv
|
2023-06-14 13:33:20 +08:00 |
|
|
|
42305ee0b4
|
use a separate queue for sending emails
|
2023-06-14 13:17:59 +08:00 |
|
|
|
dddd763ba2
|
fix graphql error by setting clientRequestId empty
|
2023-06-13 21:15:34 +08:00 |
|
|
|
27ff2856e2
|
remove client request id in import task which caused the pdf upload failure
|
2023-06-13 18:21:36 +08:00 |
|
|
|
4a438f45f5
|
add timeout and content length to the axios requests
|
2023-06-12 21:31:35 +08:00 |
|
|
|
63bddf13a1
|
set default metrics to zero
|
2023-06-05 18:16:41 +08:00 |
|
|
|
4cad18f51c
|
fix taskId not being set in the cloud task payload
|
2023-06-05 17:52:36 +08:00 |
|
|
|
992a78e173
|
add dockerfile
|
2023-06-01 16:29:30 +08:00 |
|
|
|
8a89a47c16
|
fix: testcases
|
2023-06-01 16:11:35 +08:00 |
|
|
|
1073f88d69
|
fix: add start:collector command
|
2023-06-01 16:11:35 +08:00 |
|
|
|
813a90e3c9
|
feat: send importer status update
|
2023-06-01 16:11:35 +08:00 |
|
|
|
fba8e0424d
|
feat: add importer metrics collector
|
2023-06-01 16:11:35 +08:00 |
|
|
|
5f465112bf
|
feat: update matter importer metrics
|
2023-06-01 16:11:35 +08:00 |
|
|
|
67014e68fd
|
feat: send email notification once the import has finished
|
2023-06-01 16:11:35 +08:00 |
|
|
|
19facec4e2
|
feat: add importer metrics collector
|
2023-06-01 16:11:35 +08:00 |
|
|
|
c64476b44a
|
Add test for label parsing
|
2023-05-24 18:17:29 +08:00 |
|
|
|
9218e16415
|
Add test file
|
2023-05-24 18:10:30 +08:00 |
|
|
|
f1f83a6891
|
Handle empty state columns in the import CSV files
|
2023-05-24 18:09:42 +08:00 |
|
