* fix: Library Header layout shift
* Bump Github Actions versions.
* Self-Hosting Changes
* Fix Minio Environment Variable
* Just make pdfs successful, due to lack of PDFHandler
* Fix issue where flag was set wrong
* Added an NGINX Example file
* Add some documentation for self-hosting via Docker Compose
* Make some adjustments to Puppeteer due to failing sites.
* adjust timings
* Add start of Mail Service
* Fix Docker Files
* More email service stuff
* Add Guide to use Zapier for Email-Importing.
* Ensure that if no env is provided it uses the old email settings
* Add some instructions for self-hosted email
* Add SNS Endpoints for Mail Watcher
* Add steps and functionality for using SES and SNS for email
* Uncomment a few jobs.
* Added option for Firefox for parser. Was having issues with Chromium on Docker.
* Add missing space.
Co-authored-by: Russ Taylor <729694+russtaylor@users.noreply.github.com>
* Fix some wording on the Guide
* update browser extension to handle self-hosted instances
* add slight documentation to options page
* Fix MV
* Do raw handlers for Medium
* Fix images in Medium
* Update self-hosting/GUIDE.md
Co-authored-by: Mike Baker <1426795+mbaker3@users.noreply.github.com>
* Update Guide with other variables
* Add The Verge to JS-less handlers
* Update regex and image-proxy
* Update self-hosting/nginx/nginx.conf
Co-authored-by: Mike Baker <1426795+mbaker3@users.noreply.github.com>
* Update regex and image-proxy
* Update self-hosting/docker-compose/docker-compose.yml
Co-authored-by: Mike Baker <1426795+mbaker3@users.noreply.github.com>
* Fix Minio for Export
* Merge to main
* Update GUIDE with newer NGINX
* Update nginx config to include api/save route
* Enable Native PDF View for PDFS
* Enable Native PDF View for PDFS
* feat:lover packages test
* feat:working build
* feat:alpine build
* docs:api dockerfile docs
* Write a PDF.js wrapper to replace pspdfkit
* Revert changes for replication, set settings to have default mode
* build folder got removed due to gitignore on pdf
* Add Box shadow to pdf pages
* Add Toggle for Progress in PDFS, enabled native viewer toggle
* Update node version to LTS
* Update node version to LTS
* Fix Linting issues
* Fix Linting issues
* Make env variable nullable
* Add touchend listener for mobile
* Make changes to PDF for mobile
* fix(android): change serverUrl to selfhosted first
* feat:2 stage alpine content fetch
* feat:separated start script
* fix:changed to node 22
* Add back youtube functionality and add guide
* trigger build
* Fix cache issue on YouTube
* Allow empty AWS_S3_ENDPOINT
* Allow empty AWS_S3_ENDPOINT
* Add GCHR for all images
* Add GCHR For self hosting.
* Add GCHR For self hosting.
* Test prebuilt.
* Test prebuilt
* Test prebuilt...
* Fix web image
* Remove Web Image (For now)
* Move docker-compose to images
* Move docker-compose files to correct locations
* Remove the need for ARGS
* Update packages, and Typescript versions
* Fix
* Fix issues with build on Web
* Correct push
* Fix Linting issues
* Fix Trace import
* Add missing types
* Fix Tasks
* Add information into guide about self-build
* Fix issues with PDF Viewer
---------
Co-authored-by: keumky2 <keumky2@woowahan.com>
Co-authored-by: William Theaker <wtheaker@nvidia.com>
Co-authored-by: Russ Taylor <729694+russtaylor@users.noreply.github.com>
Co-authored-by: David Adams <david@dadams2.com>
Co-authored-by: Mike Baker <1426795+mbaker3@users.noreply.github.com>
Co-authored-by: m1xxos <66390094+m1xxos@users.noreply.github.com>
Co-authored-by: Adil <mr.adil777@gmail.com>
* Add elastic to our docker compose
* add AND/OR/NOT search operations
* add elastic and create article in elastic
* change error code when elastic throws error
* add search pages in elastic
* add search by labels
* Add elastic to GitHub Action
* Update elastic version
* Fix port for elastic
* add url in search query
* Set elastic features when running tests
* add debug logs
* Use localhost instead of service hostname
* refresh elastic after create/update
* update search labels query
* add typescript support
* search pages in elastic
* fix search queries
* use elastic for saving page
* fix test failure
* update getArticle api to use elastic
* use generic get page function
* add elastic migration python script
* fix bulk helper param
* save elastic page id in article_saving_request instead of postgres article_id
* fix page archiving and deleting
* add tests for deleteArticle
* remove custom date type in elastic mappings which not exist in older version of elastic
* fix timestamp format issue
* add tests for save reading progress
* add tests for save file
* optimize search results
* add alias to index
* update migration script to receive env var as params
* Add failing test to validate we don't decrease reading progress
This test is failing with Elastic because we aren't fetching
the reading progress from elastic here, and are fetching it
from postgres.
* Rename readingProgress to readingProgressPercent
This is the name stored in elastic, so fixes issues pulling the
value out.
* Linting
* Add failing test for creating highlights w/elastic
This test fails because the highlight can't be looked up. Is there
a different ID we should be passing in to query for highlights,
or do we need to update the query to look for elastic_id?
* add tests code coverage threshold
* update nyc config
* include more files in test coverage
* change alias name
* update updateContent to update pages in elastic
* remove debug log
* fix createhighlight test
* search pages by alias in elastic
* update set labels and delete labels in elastic
* migration script enumeration
* make BULK_SIZE an env var
* fix pdf search indexing
* debug github action exit issue
* call pubsub when create/update/delete page in elastic
* fix json parsing bug and reduce reading data from file
* replace a depreciated pubsub api call
* debug github action exit issue
* debug github action exit issue
* add handler to upload elastic page data to GCS
* fix tests
* Use http_auth instead of basic_auth
* add index creation and existing postgres tables update in migration script
* fix a typo to connect to elastic
* rename readingProgress to readingProgressPercent
* migrate elastic_page_id in highlights and article_saving_request tables
* update migration script to include number of updated rows
* update db migration query
* read index mappings from file
* fix upload pages to gcs
* fix tests failure due to pageContext
* fix upload file id not exist error
* Handle savedAt & isArchived attributes w/out quering elastic
* Fix prettier issues
* fix content-type mismatching
* revert pageId to linkId because frontend was not deployed yet
* fix newsletters and attachment not saved in elastic
* put linkId in article for setting labels
* exclude orginalHtml in the result of searching to improve performace
* exclude content in the result of searching to improve performace
* remove score sorting
* do not refresh immediately to reduce searching and indexing time
* do not replace the backup data in gcs
* fix no article id defined in articleSavingRequest
* add logging of elastic api running time
* reduce home feed pagination size to 15
* reduce home feed pagination size to 10
* stop revalidating first page
* do not use a separate api to fetch reading progress
* Remove unused comment
* get reading progress if not exists
* replace ngram tokenizer with standard tokenizer
* fix tests
* remove .env.local
* add sort keyword in searching to sort by score
Co-authored-by: Hongbo Wu <hongbo@omnivore.app>
