Commit Graph

189 Commits

Author SHA1 Message Date
4e582fb55d Improving Self-Hosting and Removing 3rd Party dependencies. (#4513)
* fix: Library Header layout shift

* Bump Github Actions versions.

* Self-Hosting Changes

* Fix Minio Environment Variable

* Just make pdfs successful, due to lack of PDFHandler

* Fix issue where flag was set wrong

* Added an NGINX Example file

* Add some documentation for self-hosting via Docker Compose

* Make some adjustments to Puppeteer due to failing sites.

* adjust timings

* Add start of Mail Service

* Fix Docker Files

* More email service stuff

* Add Guide to use Zapier for Email-Importing.

* Ensure that if no env is provided it uses the old email settings

* Add some instructions for self-hosted email

* Add SNS Endpoints for Mail Watcher

* Add steps and functionality for using SES and SNS for email

* Uncomment a few jobs.

* Added option for Firefox for parser. Was having issues with Chromium on Docker.

* Add missing space.

Co-authored-by: Russ Taylor <729694+russtaylor@users.noreply.github.com>

* Fix some wording on the Guide

* update browser extension to handle self-hosted instances

* add slight documentation to options page

* Fix MV

* Do raw handlers for Medium

* Fix images in Medium

* Update self-hosting/GUIDE.md

Co-authored-by: Mike Baker <1426795+mbaker3@users.noreply.github.com>

* Update Guide with other variables

* Add The Verge to JS-less handlers

* Update regex and image-proxy

* Update self-hosting/nginx/nginx.conf

Co-authored-by: Mike Baker <1426795+mbaker3@users.noreply.github.com>

* Update regex and image-proxy

* Update self-hosting/docker-compose/docker-compose.yml

Co-authored-by: Mike Baker <1426795+mbaker3@users.noreply.github.com>

* Fix Minio for Export

* Merge to main

* Update GUIDE with newer NGINX

* Update nginx config to include api/save route

* Enable Native PDF View for PDFS

* Enable Native PDF View for PDFS

* feat:lover packages test

* feat:working build

* feat:alpine build

* docs:api dockerfile docs

* Write a PDF.js wrapper to replace pspdfkit

* Revert changes for replication, set settings to have default mode

* build folder got removed due to gitignore on pdf

* Add Box shadow to pdf pages

* Add Toggle for Progress in PDFS, enabled native viewer toggle

* Update node version to LTS

* Update node version to LTS

* Fix Linting issues

* Fix Linting issues

* Make env variable nullable

* Add touchend listener for mobile

* Make changes to PDF for mobile

* fix(android): change serverUrl to selfhosted first

* feat:2 stage alpine content fetch

* feat:separated start script

* fix:changed to node 22

* Add back youtube functionality and add guide

* trigger build

* Fix cache issue on YouTube

* Allow empty AWS_S3_ENDPOINT

* Allow empty AWS_S3_ENDPOINT

* Add GCHR for all images

* Add GCHR For self hosting.

* Add GCHR For self hosting.

* Test prebuilt.

* Test prebuilt

* Test prebuilt...

* Fix web image

* Remove Web Image (For now)

* Move docker-compose to images

* Move docker-compose files to correct locations

* Remove the need for ARGS

* Update packages, and Typescript versions

* Fix

* Fix issues with build on Web

* Correct push

* Fix Linting issues

* Fix Trace import

* Add missing types

* Fix Tasks

* Add information into guide about self-build

* Fix issues with PDF Viewer

---------

Co-authored-by: keumky2 <keumky2@woowahan.com>
Co-authored-by: William Theaker <wtheaker@nvidia.com>
Co-authored-by: Russ Taylor <729694+russtaylor@users.noreply.github.com>
Co-authored-by: David Adams <david@dadams2.com>
Co-authored-by: Mike Baker <1426795+mbaker3@users.noreply.github.com>
Co-authored-by: m1xxos <66390094+m1xxos@users.noreply.github.com>
Co-authored-by: Adil <mr.adil777@gmail.com>
2025-01-27 13:33:16 +01:00
49f9fb4d4e Merge pull request #4337 from omnivore-app/fix/remove-tts-cache
remove tts cache
2024-08-30 14:06:39 +08:00
70d6e9dcae reduce logs 2024-08-29 18:18:17 +08:00
5e2323ab23 remove tts cache 2024-08-28 09:46:50 +08:00
0a6672416e fix: use tts-cache Redis server for tts cache 2024-07-25 10:22:49 +08:00
e296c0d5bc fix typo 2024-07-04 16:31:48 +08:00
a841f5748e map realistic voice to openai voice in tts-handler 2024-07-04 16:26:31 +08:00
59c826fd5e use @omnivore/utils in content-fetch 2024-07-03 21:58:22 +08:00
0800a1661e use @omnivore/utils in text-to-speech-handler 2024-07-03 21:48:07 +08:00
7dcce0fba3 fix: missing chai and mocha type import 2024-05-01 15:03:38 +08:00
7a167c7c55 add tests 2024-04-30 14:42:46 +08:00
76c1cd5330 fix: filter punctuation and whitespace only utterance out 2024-04-30 14:33:10 +08:00
1a3697e24b fix: skip unwanted nodes and update the index when converting html to utterances 2024-04-30 13:58:37 +08:00
6278f5fa98 remove ffmpeg dependency 2024-04-11 16:51:42 +08:00
70b1a1d3c7 add comment 2024-04-09 10:47:23 +08:00
c4882c2542 update dev cli 2024-04-09 10:43:33 +08:00
90fe5e8109 ignore expiration of jwt token for tts streaming 2024-04-09 10:30:40 +08:00
88a7e8d85b fix tests 2024-04-04 12:17:15 +08:00
628cfc64d1 fix: replace \n with new line in redis cert 2024-01-22 11:09:15 +08:00
d9feb740cb convert content-fetch to typescript 2024-01-18 18:48:46 +08:00
881a98eb86 Create new environment variables for tts redis 2024-01-18 14:57:35 +08:00
150a456c35 replace redis client library with ioredis 2024-01-16 15:42:50 +08:00
55337ecca3 fix tests 2024-01-16 13:44:53 +08:00
842b2304c3 fix smart quotes not tokenized correctly 2024-01-16 12:31:15 +08:00
e395036e61 Add openai voices 2023-11-08 19:33:36 +08:00
41805d13db Bump @sentry/serverless from 6.19.3 to 7.77.0
Bumps [@sentry/serverless](https://github.com/getsentry/sentry-javascript) from 6.19.3 to 7.77.0.
- [Release notes](https://github.com/getsentry/sentry-javascript/releases)
- [Changelog](https://github.com/getsentry/sentry-javascript/blob/develop/CHANGELOG.md)
- [Commits](https://github.com/getsentry/sentry-javascript/compare/6.19.3...7.77.0)

---
updated-dependencies:
- dependency-name: "@sentry/serverless"
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2023-11-07 03:35:00 +00:00
c4773dc904 Landing page improvements and various supporting improvements 2023-10-24 09:43:39 +01:00
5ec5916cc8 Increase cache time for text to speech data 2023-09-07 14:01:31 +08:00
6b398c0571 Add more ultra voices, add a larger font size in the reader 2023-08-23 12:18:01 +08:00
792cf0b207 upgrade google cloud sdk 2023-08-11 13:55:29 +08:00
0426bdb29f Merge pull request #2554 from omnivore-app/fix/logging
fix/logging
2023-07-28 12:19:16 +08:00
3146b3bcc5 remove redundant logs 2023-07-27 17:55:17 +08:00
2e965afd69 reformat sql query in logs 2023-07-27 17:34:12 +08:00
078c26801d Upgrade the speech sdk version 2023-07-26 18:31:20 +08:00
fa1ff9ba17 Upgrade node to 18.16 2023-07-24 15:55:11 +08:00
14b7ed5252 Fallback to old sentence tokenizer if new one is failed 2023-04-20 19:44:08 +08:00
6337d60146 Add test for Chinese 2023-04-20 17:10:32 +08:00
c63ecc94fb Replace SentenceTokenizerNew with SentenceTokenizer 2023-04-18 09:33:48 +08:00
c697b0cb4d Add test case 2023-04-17 19:13:09 +08:00
8a86f19e61 Upgrade natural nodejs module and use a new sentence tokenizer based on parsing 2023-04-17 18:56:17 +08:00
d484d26f98 Strip emojis on realistic speech text 2023-02-16 19:16:01 +08:00
1e9fd24cb6 Merge pull request #1808 from omnivore-app/fix/empty-synthesized-output
Return empty result if no synthesized output from api
2023-02-16 17:06:31 +08:00
3dde59c4a6 Clean up logging of API errors 2023-02-16 16:45:37 +08:00
f25b9f09a7 Add some logging 2023-02-16 16:23:03 +08:00
cd9c2e50b5 Use a voice mapping 2023-02-16 15:43:12 +08:00
9d5cb84648 Return arraybuffer from realistic voice API 2023-02-16 13:19:24 +08:00
7177279951 Fix envar name 2023-02-16 11:23:28 +08:00
9566c17db3 Update API for ultra realistic voices 2023-02-16 10:56:24 +08:00
5bde7f0344 Lint 2023-02-15 23:49:05 +08:00
9d5b298dc0 Return empty result if no synthesized output from api 2023-02-15 17:37:48 +08:00