Commit Graph

806 Commits

Author SHA1 Message Date
2152a9e466 Fix getting embeded class lists bug 2022-05-10 16:57:38 +08:00
76d47f7dc5 Fix updating live collections 2022-05-10 16:57:02 +08:00
79a941a2b6 Default use options.url if exists 2022-05-10 16:56:09 +08:00
cc48034145 Add linkedom to dependencies 2022-05-10 16:54:14 +08:00
5698790288 Pass url to readability 2022-05-10 16:53:45 +08:00
5007b11a3c Add url to readability option 2022-05-10 16:52:10 +08:00
7dd460352e Merge pull request #566 from omnivore-app/optimize-puppeteer
Optimize saving performance
2022-05-10 09:43:33 +08:00
af9888cc81 Use overflow hidden to clip google auth button to container 2022-05-09 13:14:31 -07:00
956371dd51 Clean up login page
Update margins on login layout

Add missing image from about page
2022-05-09 11:39:50 -07:00
1f0abbaa30 Add tests 2022-05-09 11:11:13 -07:00
31eb1a0f61 Fix parsing video IDs from youtube URLs 2022-05-09 11:03:17 -07:00
45a2a1393f Use chrome-aws-lambda args 2022-05-09 20:59:20 +08:00
47c3578820 Add more puppeteer args 2022-05-09 14:32:46 +08:00
bb5b4ec174 Ignore app.yaml 2022-05-09 13:54:02 +08:00
6f82499deb Merge puppeteer changes 2022-05-09 13:52:40 +08:00
1dffbfc881 Add puppeteer-code dependencies 2022-05-09 13:45:45 +08:00
59a2639b7d Reduce http call to get jsonld data if title or content or sitename or byline exists 2022-05-09 13:45:45 +08:00
a457c9d128 Update article content only when code blocks exist 2022-05-09 13:45:45 +08:00
4c7f6d0281 Update comments 2022-05-09 13:45:45 +08:00
4571f1f51c Add metrics 2022-05-09 13:45:45 +08:00
21799b7b6d Add puppeteer-stealth and puppeteer-ad-block plugin and a user-data-dir to reduce processing time 2022-05-09 13:45:45 +08:00
fd934a949e Add a standalone service content fetching 2022-05-08 21:52:36 -07:00
b24a91c746 Merge pull request #561 from omnivore-app/faster-save
Faster save by reusing JSDOM
2022-05-07 10:30:40 +08:00
aa95c3abe5 Merge pull request #556 from omnivore-app/fix/enable-saved-searches
Enable saved search buttons for all users
2022-05-06 08:20:35 -07:00
eaad96acdd Return parsed dom back to backend 2022-05-06 12:29:08 +08:00
5f5076e864 Highlight code element without reinitialize jsdom 2022-05-06 12:20:54 +08:00
7c6b810522 Remove redundant JSDOM 2022-05-06 10:53:36 +08:00
1bda035890 Make the highlight cards work a little better in list mode 2022-05-05 14:44:45 -07:00
b53dae36a0 Enable saved search buttons for all users 2022-05-05 11:17:00 -07:00
d0610a7cce Merge pull request #553 from omnivore-app/fix/financial-times-rendering
Improve rendering of the Financial Times
2022-05-05 09:37:54 -07:00
6ef14e1f91 Mark ft.com page a readerable 2022-05-05 09:28:22 -07:00
384c5dbf9f Improve rendering of the Financial Times 2022-05-05 09:14:51 -07:00
b9c2c1186b Fix batch_size=500 to avoid exceeding max memory limit and requests_per_second=250 to throttle update requests
Fix batch_size=500 to avoid exceeding max memory limit and requests_per_second=250 to throttle update requests
2022-05-05 21:10:49 +08:00
46b390204b Merge pull request #549 from omnivore-app/fix/parse-image
Parse image and save it in an <img> element
2022-05-05 20:25:14 +08:00
24373018af Return non-text elements if no text content found after parsing in readability 2022-05-05 19:26:39 +08:00
35e3e347d6 Remove image text 2022-05-05 19:25:09 +08:00
7183ca2e89 Add request timeout = 30m in elastic client 2022-05-05 13:28:01 +08:00
911afd77e5 Reduce requests per second and scroll_size 2022-05-05 12:40:44 +08:00
c4ea185e17 Add comment 2022-05-05 12:16:53 +08:00
6f29f18743 Parse image and save it in a <img> element 2022-05-05 12:13:08 +08:00
a9a792c006 Merge pull request #543 from omnivore-app/fix/elastic-migration
Tune the update speed
2022-05-05 11:00:55 +08:00
f47e2754c2 Add state in search result graphql 2022-05-05 09:54:52 +08:00
96fbd84bbb Extend timeout 2022-05-05 09:02:56 +08:00
74693d40c0 Mark page as readerable 2022-05-04 15:01:35 -07:00
8386aebaf8 Remove ads from fiercepharma page 2022-05-04 14:22:08 -07:00
a657da2b5f Merge pull request #545 from omnivore-app/fix/youtube-urls
Fix parsing of video IDs out of shared YouTube URLs
2022-05-04 11:29:25 -07:00
b4d89b673f Merge pull request #541 from omnivore-app/fix/add-labels-to-appreader
Display labels on the appreader page
2022-05-04 11:27:21 -07:00
08e14c7577 Fix parsing of video IDs out of shared YouTube URLs 2022-05-04 10:45:16 -07:00
400a62b9f4 Merge pull request #396 from omnivore-app/feature/search-highlights-web
Feature/search highlights web
2022-05-04 09:11:38 -07:00
cd9c6a40d9 Tune the update speed 2022-05-04 22:44:28 +08:00