Commit Graph

11619 Commits

Author SHA1 Message Date
4de6cfc1f8 fix: return markdown content for the old clients when highlighted markdown is requested 2024-08-07 09:34:35 +08:00
c15f16eb02 Merge pull request #4245 from omnivore-app/fix/popular-read-original-content
stop adding original content from popular read
2024-08-06 15:15:29 +08:00
64cf10205b fix tests 2024-08-06 14:44:15 +08:00
126bbd4d86 Merge pull request #4239 from omnivore-app/optimize-migration-script
optimize the batch update script to use index by adding order by user_id
2024-08-05 17:00:54 +08:00
a6637fcbed update batch_size 2024-08-05 15:49:29 +08:00
7295b90397 fix typo 2024-08-05 15:39:55 +08:00
498790d221 commit changes first 2024-08-05 15:38:36 +08:00
431640605f optimize the batch update script to use index by adding order by user_id 2024-08-05 15:34:56 +08:00
f467681189 Merge pull request #4235 from omnivore-app/fix/original-html
stop storing original html in the database
2024-08-02 14:53:10 +08:00
8bbf2c0702 add script to update original_content to NULL in db 2024-08-01 11:56:36 +08:00
322f736fe0 stop storing original html in the database 2024-07-31 19:14:38 +08:00
07648ae592 Merge pull request #4233 from omnivore-app/dependabot/npm_and_yarn/react-hot-toast-2.4.1
Bump react-hot-toast from 2.2.0 to 2.4.1
2024-07-31 10:43:21 +08:00
d96b22b9b4 Merge pull request #4231 from omnivore-app/dependabot/npm_and_yarn/fast-xml-parser-4.4.1
Bump fast-xml-parser from 4.3.6 to 4.4.1
2024-07-31 10:15:16 +08:00
445839c420 Bump react-hot-toast from 2.2.0 to 2.4.1
Bumps [react-hot-toast](https://github.com/timolins/react-hot-toast) from 2.2.0 to 2.4.1.
- [Release notes](https://github.com/timolins/react-hot-toast/releases)
- [Commits](https://github.com/timolins/react-hot-toast/compare/v2.2.0...v2.4.1)

---
updated-dependencies:
- dependency-name: react-hot-toast
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-07-29 21:08:26 +00:00
d0d6c1b164 Bump fast-xml-parser from 4.3.6 to 4.4.1
Bumps [fast-xml-parser](https://github.com/NaturalIntelligence/fast-xml-parser) from 4.3.6 to 4.4.1.
- [Release notes](https://github.com/NaturalIntelligence/fast-xml-parser/releases)
- [Changelog](https://github.com/NaturalIntelligence/fast-xml-parser/blob/master/CHANGELOG.md)
- [Commits](https://github.com/NaturalIntelligence/fast-xml-parser/compare/v4.3.6...v4.4.1)

---
updated-dependencies:
- dependency-name: fast-xml-parser
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-07-29 20:56:20 +00:00
bdae03ef95 Merge pull request #4221 from omnivore-app/fix/content-fetch-error
improve content-fetch
2024-07-25 13:40:14 +08:00
156feb8e17 rate limit save url action in redis: max 5 save urls in a minute 2024-07-25 13:08:38 +08:00
c503b47ea2 revert index 2024-07-25 12:10:53 +08:00
ee5e66d9b3 Merge pull request #4075 from omnivore-app/feature/posts
feat: posts api
2024-07-25 11:42:35 +08:00
465e5dc7d1 Add an index of columns user_id and created_at to the library_item table for counting query 2024-07-25 11:18:52 +08:00
6f12b5e406 reduce bulk action batch size to 50 2024-07-25 10:54:21 +08:00
2cc35e23b2 Merge pull request #4204 from omnivore-app/dependabot/npm_and_yarn/aws4-axios-3.3.6
Bump aws4-axios from 3.3.4 to 3.3.6
2024-07-25 10:35:56 +08:00
261ff11014 Merge pull request #4199 from omnivore-app/dependabot/npm_and_yarn/pkg/extension/braces-3.0.3
Bump braces from 3.0.2 to 3.0.3 in /pkg/extension
2024-07-25 10:33:08 +08:00
2c4107d666 Merge pull request #4195 from omnivore-app/dependabot/npm_and_yarn/ws-7.5.10
Bump ws from 7.5.9 to 7.5.10
2024-07-25 10:32:17 +08:00
28057a45d6 Merge pull request #4169 from omnivore-app/dependabot/npm_and_yarn/csv-stringify-6.5.0
Bump csv-stringify from 6.4.0 to 6.5.0
2024-07-25 10:28:05 +08:00
7295a0052b Merge pull request #4168 from omnivore-app/dependabot/npm_and_yarn/fast-csv/parse-5.0.0
Bump @fast-csv/parse from 4.3.6 to 5.0.0
2024-07-25 10:27:44 +08:00
dd51500acf Merge pull request #4222 from omnivore-app/fix/tts-cache
fix: use tts-cache Redis server for tts cache
2024-07-25 10:26:49 +08:00
0a6672416e fix: use tts-cache Redis server for tts cache 2024-07-25 10:22:49 +08:00
0e0c4bddac block failed domains 2024-07-24 16:55:50 +08:00
dee421d3c8 add hour rate limiter middleware to the api router and allows max 600 requests per hour 2024-07-24 16:24:49 +08:00
6776cdf1cd check if there are more than five items "created" within a minute instead of "saved" 2024-07-24 15:59:22 +08:00
31fe4b65a0 remove readability from content-fetch 2024-07-24 12:53:41 +08:00
066883a84d remove unused dependencies 2024-07-24 12:51:25 +08:00
29a5b20d2c remove scrapingbee from content-fetch 2024-07-24 12:17:13 +08:00
284dcfa323 Merge pull request #4212 from omnivore-app/feature/use-gpt-4-o-mini
use new gpt-4o-mini openai model
2024-07-23 14:01:06 +08:00
f87ecbcf18 Merge pull request #4207 from omnivore-app/fix/published-date-change-in-wechat
fix/published date change in wechat
2024-07-23 13:58:17 +08:00
4c1b9a1c4b Merge pull request #4210 from omnivore-app/fix/self-hosting
add missing lines to build utils dependency to the docker file for self-hosting
2024-07-23 13:57:46 +08:00
ea7f24777a Merge pull request #4214 from omnivore-app/fix/self-hosting-1
add missing redis env var to docker-compose file
2024-07-23 13:57:17 +08:00
8209b05273 Merge pull request #4146 from omnivore-app/remove-ultra-realistic-voices-in-backend
map realistic voice to openai voice in tts-handler
2024-07-23 11:06:53 +08:00
0c377c370f add missing redis env var to docker-compose file 2024-07-19 15:24:22 +08:00
3f76431c47 use new gpt-4o-mini openai model 2024-07-19 11:45:38 +08:00
228b9df86d add missing lines to build utils dependency to the docker file for self-hosting 2024-07-18 16:26:01 +08:00
5876e4cd66 Bump ws from 7.5.9 to 7.5.10
Bumps [ws](https://github.com/websockets/ws) from 7.5.9 to 7.5.10.
- [Release notes](https://github.com/websockets/ws/releases)
- [Commits](https://github.com/websockets/ws/compare/7.5.9...7.5.10)

---
updated-dependencies:
- dependency-name: ws
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-07-18 04:24:49 +00:00
1f29fcef78 Merge pull request #4208 from omnivore-app/fix/youtube-transcript
fix: youtube transcript not parsed correctly
2024-07-18 12:23:23 +08:00
d9b088cc01 fix tests 2024-07-18 12:22:21 +08:00
b5fe0cb279 remove all the commas in the raw transcript which are added by youtubei 2024-07-18 12:10:45 +08:00
faa3e1d00e upgrade youtubei version to fix the caption parsing error 2024-07-18 12:10:07 +08:00
52341e538f Merge pull request #4206 from omnivore-app/fix/substack-headings
fix: substack headings are removed because its class name contains header
2024-07-18 11:20:32 +08:00
f2b3a66b72 remove metadata and cover image from content 2024-07-18 11:18:51 +08:00
02280b576b fix: wechat official account articles published date not captured because its format is changed 2024-07-18 10:33:06 +08:00