375 Commits

Author SHA1 Message Date
4e582fb55d Improving Self-Hosting and Removing 3rd Party dependencies. (#4513)
* fix: Library Header layout shift

* Bump Github Actions versions.

* Self-Hosting Changes

* Fix Minio Environment Variable

* Just make pdfs successful, due to lack of PDFHandler

* Fix issue where flag was set wrong

* Added an NGINX Example file

* Add some documentation for self-hosting via Docker Compose

* Make some adjustments to Puppeteer due to failing sites.

* adjust timings

* Add start of Mail Service

* Fix Docker Files

* More email service stuff

* Add Guide to use Zapier for Email-Importing.

* Ensure that if no env is provided it uses the old email settings

* Add some instructions for self-hosted email

* Add SNS Endpoints for Mail Watcher

* Add steps and functionality for using SES and SNS for email

* Uncomment a few jobs.

* Added option for Firefox for parser. Was having issues with Chromium on Docker.

* Add missing space.

Co-authored-by: Russ Taylor <729694+russtaylor@users.noreply.github.com>

* Fix some wording on the Guide

* update browser extension to handle self-hosted instances

* add slight documentation to options page

* Fix MV

* Do raw handlers for Medium

* Fix images in Medium

* Update self-hosting/GUIDE.md

Co-authored-by: Mike Baker <1426795+mbaker3@users.noreply.github.com>

* Update Guide with other variables

* Add The Verge to JS-less handlers

* Update regex and image-proxy

* Update self-hosting/nginx/nginx.conf

Co-authored-by: Mike Baker <1426795+mbaker3@users.noreply.github.com>

* Update regex and image-proxy

* Update self-hosting/docker-compose/docker-compose.yml

Co-authored-by: Mike Baker <1426795+mbaker3@users.noreply.github.com>

* Fix Minio for Export

* Merge to main

* Update GUIDE with newer NGINX

* Update nginx config to include api/save route

* Enable Native PDF View for PDFS

* Enable Native PDF View for PDFS

* feat:lover packages test

* feat:working build

* feat:alpine build

* docs:api dockerfile docs

* Write a PDF.js wrapper to replace pspdfkit

* Revert changes for replication, set settings to have default mode

* build folder got removed due to gitignore on pdf

* Add Box shadow to pdf pages

* Add Toggle for Progress in PDFS, enabled native viewer toggle

* Update node version to LTS

* Update node version to LTS

* Fix Linting issues

* Fix Linting issues

* Make env variable nullable

* Add touchend listener for mobile

* Make changes to PDF for mobile

* fix(android): change serverUrl to selfhosted first

* feat:2 stage alpine content fetch

* feat:separated start script

* fix:changed to node 22

* Add back youtube functionality and add guide

* trigger build

* Fix cache issue on YouTube

* Allow empty AWS_S3_ENDPOINT

* Allow empty AWS_S3_ENDPOINT

* Add GCHR for all images

* Add GCHR For self hosting.

* Add GCHR For self hosting.

* Test prebuilt.

* Test prebuilt

* Test prebuilt...

* Fix web image

* Remove Web Image (For now)

* Move docker-compose to images

* Move docker-compose files to correct locations

* Remove the need for ARGS

* Update packages, and Typescript versions

* Fix

* Fix issues with build on Web

* Correct push

* Fix Linting issues

* Fix Trace import

* Add missing types

* Fix Tasks

* Add information into guide about self-build

* Fix issues with PDF Viewer

---------

Co-authored-by: keumky2 <keumky2@woowahan.com>
Co-authored-by: William Theaker <wtheaker@nvidia.com>
Co-authored-by: Russ Taylor <729694+russtaylor@users.noreply.github.com>
Co-authored-by: David Adams <david@dadams2.com>
Co-authored-by: Mike Baker <1426795+mbaker3@users.noreply.github.com>
Co-authored-by: m1xxos <66390094+m1xxos@users.noreply.github.com>
Co-authored-by: Adil <mr.adil777@gmail.com>
2025-01-27 13:33:16 +01:00
2ff987de6f fix github action 2024-08-29 18:00:42 +08:00
b22af65f93 add archived status to user account 2024-08-29 14:23:32 +08:00
e1b809f7d7 allow omnivore_admin to delete filters 2024-08-29 14:23:32 +08:00
82943921b1 fix table permission 2024-08-27 18:05:06 +08:00
f77ded31e1 save export tasks in db and check db before starting export 2024-08-27 17:48:05 +08:00
611640be17 drop column if exists 2024-08-06 15:16:01 +08:00
9b4bfa454c drop original_content column from library_item table 2024-08-06 15:16:01 +08:00
a6637fcbed update batch_size 2024-08-05 15:49:29 +08:00
7295b90397 fix typo 2024-08-05 15:39:55 +08:00
498790d221 commit changes first 2024-08-05 15:38:36 +08:00
431640605f optimize the batch update script to use index by adding order by user_id 2024-08-05 15:34:56 +08:00
8bbf2c0702 add script to update original_content to NULL in db 2024-08-01 11:56:36 +08:00
166b338e0c resolve rebase conflicts 2024-07-01 10:49:09 +08:00
e93d7b646f resolve rebase conflicts 2024-07-01 10:49:09 +08:00
ded0c04b49 resolve rebase conflicts 2024-07-01 10:49:09 +08:00
fa3e6fe341 make libraryItemIds not null 2024-07-01 10:49:09 +08:00
3fb146e864 list posts api 2024-07-01 10:11:32 +08:00
c02f2d5036 create post table and entity 2024-07-01 10:11:32 +08:00
19a603db8a update setup.sh 2024-06-26 17:26:06 +08:00
0c87e46578 fix permission error when drop role omnivore_admin 2024-06-21 19:40:22 +08:00
5a63af25f9 Alter omnivore_admin role to prevent omnivore_admin to be inherited by app_user or omnivore_user 2024-06-21 11:42:36 +08:00
6a54d651a8 do not create library_item_topic_idx index on library_item table since it locks the table/row for a long time 2024-06-19 16:13:05 +08:00
5f11726bd5 set lock_timeout while running migrations 2024-06-19 11:52:22 +08:00
d618fe92af remove drop index query 2024-06-18 22:09:06 +08:00
ef33671f56 add schema 2024-06-18 22:08:11 +08:00
dece399faf create index concurrently on topic column in library_item table 2024-06-18 21:24:43 +08:00
f0b71e6833 create ltree extension if not exists 2024-06-18 18:29:45 +08:00
31f04344fc resolve rebase conflicts 2024-06-13 18:41:35 +08:00
88e3d648c8 add a REST API to trigger the expire folder job 2024-06-13 18:36:33 +08:00
7940c3f4ea add list folder policy api 2024-06-13 18:29:21 +08:00
25ca4c7791 create folder_policy table 2024-06-13 18:29:21 +08:00
e3d70fc27d Merge pull request #4052 from omnivore-app/feature/prune-trash-items
feature/prune trash items
2024-06-13 17:58:18 +08:00
9ef91ff1ca add an REST API to trigger the prune trash job 2024-06-13 14:48:14 +08:00
30adbb735f fix typo in sql 2024-06-12 19:41:07 +08:00
71d07caf94 run prune trash job at 3am UTC daily 2024-06-12 19:27:42 +08:00
652e2cc564 More explicit default on migration 2024-06-12 19:16:39 +08:00
fb5ef3422c commit the delete query for each user in the loop to reduce lock time 2024-06-12 19:09:40 +08:00
755f483ba9 create a function to batch delete items in trash 2024-06-12 18:38:14 +08:00
dc6f5521dc Add migrations 2024-06-10 18:20:59 +08:00
76383d8a33 feat: generate preview content if excerpt less than 180 chars 2024-06-06 19:08:41 +08:00
e9f9f5dded add index for user_id column on highlight table 2024-06-06 17:33:42 +08:00
e131afc183 update API 2024-05-28 14:45:33 +08:00
57b28c39bf store topic as a ltree 2024-05-27 21:17:54 +08:00
80841bf9af add score to library_item table 2024-05-27 11:11:05 +08:00
67dac9ba31 add public item source 2024-05-26 14:41:38 +08:00
f2d2e852e1 grant db permission 2024-05-24 15:32:14 +08:00
a48a614676 save just read feed in redis sorted set 2024-05-24 14:52:21 +08:00
cb4fc23507 implement justReadFeed API 2024-05-23 22:07:19 +08:00
b058952c2d implement updateJustReadFeed job 2024-05-23 21:10:01 +08:00