URLs need to be sent to contentFetch exactly as they
were received, this is because many apps will use signed URLs
for PDFs being served from GCP or AWS. A signed URL needs to
keep all its query params in the same order to validate.
* Add state and taskName in elastic page mappings
* Add state and taskName in elastic page interface
* Create page with PROCESSING state before scrapping
* Update createArticleRequest API
* Fix tests
* Add default state for pages
* Update createArticle API
* Update save page
* Update save file
* Update saving item description
* Show unable to parse content for failed page
* Fix date parsing
* Search for not failed pages
* Fix tests
* Add test for saveUrl
* Update get article saving request api
* Update get article test
* Add test for articleSavingRequest API
* Add test for failure
* Return new page id if clientRequestId empty
* Update clientRequestId in savePage
* Update clientRequestId in saveFile
* Replace article with slug in articleSavingRequest
* Add slug in articleSavingRequest response
* Depreciate article
* Use slug in web
* Remove article and highlight fragments
* Query article.slug on Prod
* Show unable to parse description for failed page
* Fix a bug having duplicate pages when saving the same url multiple times
* Add state in response
* Rename variables in removeArticle API
* Rename state
* Add state in response in web
* Make state an enum
* Open temporary page by link id
* Use an empty reader view as the background for loading pages
* Progressively load the article page as content is loaded
* Add includePending flag in getArticles API
* Set includePending = true in web
* Add elastic update mappings in migration script
* Add elastic mappings in docker image
* Move index_settings.json to migrate package
* Remove elastic index creation in api
* Move elastic migrations to a separate directory
* Remove index_settings from api docker image
Co-authored-by: Jackson Harper <jacksonh@gmail.com>
* add highlight mappings
* return highlight in resolvers
* temporarily skip highlight tests
* add test for getting highlights
* update merge highlight
* separate elastic methods
* roll back merge highlight test
* add highlight to elastic script
* update delete highlight in elastic
* migrate highlight data from postgres to elastic
* rescue not found exception when page is not found in the migration script
* exclude highlights in searching pages results
* search pages with highlights only with has:highlight query
* add search endpoint to search pages or highlights
* reduce code smell in search api
* fix rebase error
* fix tests
* add test for search highlight
* add test for new search endpoint
* add labels to search results
* update schema
* update search query
* fix update/share highlights
* fix rebase error
* fix tests
* add highlight model in elastic
* add savedAt and publishedAt date range in search query
* add sort by updated and recently read
* fix tests
* close db connection when tests are done
* test github action
* revert github action test
* fix rebase error
* add docker-compose for api-test
* remove unused env
* remove highlights with no page attached to
* allow get_articles resolver to search for query so we can merge it without web changes
* add a count query in elastic
* if priority is not set, check the rate limit of user's libary
- if 5 articles added in the last minute: use low queue
- default: use normal queue
