|
|
a6653414e8
|
fix: use software graphic rendering instead of gpu and reduce browser launch timeout to 10 seconds
|
2024-07-05 12:13:00 +08:00 |
|
|
|
1eb1d25960
|
remove specific user-data-dir
|
2024-07-04 19:34:23 +08:00 |
|
|
|
38a3e03780
|
improve args
|
2024-07-04 19:32:11 +08:00 |
|
|
|
b38b28c75e
|
create a browser singleton instance and checks browser existence before creating context
|
2024-07-04 19:12:42 +08:00 |
|
|
|
dde9f16396
|
put error message in the analytic event
|
2024-05-17 16:16:44 +08:00 |
|
|
|
f43c48e376
|
reduce chromium launch timeout to 30 seconds
|
2024-05-17 14:27:59 +08:00 |
|
|
|
293ed87100
|
remove redundant response from return value
|
2024-05-16 12:21:11 +08:00 |
|
|
|
cd315fa6c6
|
remove redundant assignment
|
2024-05-14 13:07:42 +08:00 |
|
|
|
484676750e
|
reconnect/restart browser if it crashed/lost connections
|
2024-05-14 13:04:17 +08:00 |
|
|
|
a924c8448b
|
capture content-fetch success and error events
|
2024-05-13 14:55:48 +08:00 |
|
|
|
d886c3b7d0
|
catch puppeteer page error
|
2024-05-13 14:35:47 +08:00 |
|
|
|
d23bccf459
|
upgrade puppeteer-core to prevent ProtocolTimeout and adding more debug logs
|
2024-05-13 14:28:26 +08:00 |
|
|
|
0ac5299c32
|
do not pass browser instance to content-handler
|
2024-05-13 13:10:02 +08:00 |
|
|
|
86e637febd
|
add more logs to debug browser context
|
2024-05-13 12:56:20 +08:00 |
|
|
|
475c636c1a
|
print browser log
|
2024-05-13 12:55:15 +08:00 |
|
|
|
88a7e8d85b
|
fix tests
|
2024-04-04 12:17:15 +08:00 |
|
|
|
0e46dc2302
|
save dir in the database
|
2024-03-04 12:28:51 +08:00 |
|
|
|
5e239d2568
|
run readability in save-page instead of puppeteer
|
2024-01-25 16:30:59 +08:00 |
|
|
|
94dd4be659
|
fix: page content not saved when title is empty but content is not
|
2024-01-23 16:47:42 +08:00 |
|
|
|
1411cf074e
|
fix: finalUrl defaults to the url of the page saved
|
2024-01-23 14:14:54 +08:00 |
|
|
|
a03eee5ef7
|
fix dependecies
|
2024-01-18 18:48:46 +08:00 |
|
|
|
d9feb740cb
|
convert content-fetch to typescript
|
2024-01-18 18:48:46 +08:00 |
|
|
|
cd3402b98a
|
rewrite puppeteer in typescript
|
2024-01-18 18:48:46 +08:00 |
|
|
|
51e586ed3d
|
separate content-fetch in puppeteer packages from saving page content
|
2024-01-18 18:48:46 +08:00 |
|
|
|
ad63c75e63
|
fix typo
|
2023-12-08 11:29:03 +08:00 |
|
|
|
3759e10615
|
fix feed url in pdf file not saved
|
2023-12-08 11:29:02 +08:00 |
|
|
|
d09ec51136
|
Merge pull request #3182 from omnivore-app/fix/importer-notification
|
2023-11-28 14:59:52 +08:00 |
|
|
|
b10b704da3
|
fix importer metrics not updated when failed to catch invalid url in the list
|
2023-11-28 12:14:27 +08:00 |
|
|
|
fd781644f1
|
feat: fetch content for rss feed items in following folder
|
2023-11-23 18:03:25 +08:00 |
|
|
|
c4773dc904
|
Landing page improvements and various supporting improvements
|
2023-10-24 09:43:39 +01:00 |
|
|
|
1b1cce7485
|
disable javascript for the host
|
2023-10-20 18:59:22 +08:00 |
|
|
|
d746510358
|
cont
|
2023-10-19 21:50:16 +08:00 |
|
|
|
f750648824
|
fix importer triggers thumbnailer unexpectedly
|
2023-10-19 21:46:43 +08:00 |
|
|
|
0fcc7096aa
|
docs: fix typo in packages/puppeteer-parse/README.md
|
2023-10-18 17:33:22 +05:45 |
|
|
|
00bd183287
|
do not retry importer job if user account is deleted
|
2023-10-16 16:33:22 +08:00 |
|
|
|
5f6be169bd
|
add savedAt and publishedAt to saveUrl api
|
2023-08-14 17:10:34 +08:00 |
|
|
|
792cf0b207
|
upgrade google cloud sdk
|
2023-08-11 13:55:29 +08:00 |
|
|
|
7641a2567e
|
disable extensions too
|
2023-08-02 16:12:24 +08:00 |
|
|
|
4eab6ea6d2
|
remove hardware acceleration
|
2023-08-02 16:07:43 +08:00 |
|
|
|
a97fcd1e88
|
do not use single process in chromium
|
2023-08-02 15:58:32 +08:00 |
|
|
|
63cbb3011e
|
upgrade puppeteer and update chromium args
|
2023-08-02 15:33:15 +08:00 |
|
|
|
153662ce6a
|
set savedAt and publishedAt timestamp for rss item
|
2023-07-14 12:21:34 +08:00 |
|
|
|
0170ea3109
|
fetch rss item by url
|
2023-07-13 10:09:48 +08:00 |
|
|
|
fd67baea09
|
remove the code to get create_time from wechat article in browser runtime
|
2023-07-11 16:20:08 +08:00 |
|
|
|
1f283e6122
|
add optional locale and timezone to saveUrl request for puppeteer to use
|
2023-07-11 16:15:32 +08:00 |
|
|
|
244fb4ccb5
|
fix: removing node with background image
|
2023-06-26 16:40:14 +08:00 |
|
|
|
43dcb8d5d7
|
fix: invalid url in puppeteer
|
2023-06-26 15:08:46 +08:00 |
|
|
|
d2e476a3ea
|
add debug logs
|
2023-06-14 12:53:43 +08:00 |
|
|
|
9fbe32b219
|
mark import failed on the last failed retry
|
2023-06-13 17:30:26 +08:00 |
|
|
|
4a438f45f5
|
add timeout and content length to the axios requests
|
2023-06-12 21:31:35 +08:00 |
|
