Commit Graph

90 Commits

Author SHA1 Message Date
c4a599d2ba support newsletters hosted on convertkit.com 2022-07-12 11:47:38 +08:00
9599edb9fb Add support for newsletters hosted on getrevue.co 2022-07-06 22:06:51 +08:00
2e77241044 Check and get Revue newsletter url from email 2022-07-06 22:06:21 +08:00
75d3372426 Use gcf for low priority task 2022-06-24 10:13:14 -07:00
5f0cb493f2 Allow filter search result by updatedAt 2022-06-24 13:09:13 +08:00
f88083e535 Merge pull request #813 from omnivore-app/advanced-search
advanced search
2022-06-19 10:55:18 +08:00
9ec11cfc22 Add title, description, content as keyword in search.ts 2022-06-16 22:14:08 +08:00
215078bcb3 Add logseq to the allowed cors origin 2022-06-16 10:46:06 +08:00
05ea57f76f Linting 2022-06-09 12:08:42 -07:00
e23eada168 Use the public GCS URL for local uploaded files 2022-06-09 11:59:01 -07:00
fc68d51320 Support sort/filter by readAt 2022-06-04 22:12:03 +08:00
b56c6dafa9 Disable sorting options that need API improvements 2022-06-03 12:47:43 -07:00
975411d429 Merge pull request #719 from omnivore-app/fix/pdf-uploading-improvements 2022-06-02 16:47:03 -07:00
89164a353f Merge pull request #723 from omnivore-app/fix/tweet-not-saved
Fix tweet not saved
2022-06-02 11:20:40 +08:00
11f1b78c45 Remove changes to upload.ts 2022-05-31 15:26:33 -07:00
404805e0c0 Make async calls to parse() 2022-05-31 22:51:00 +08:00
74054cbdbd Merge pull request #716 from omnivore-app/api-token
Api tokens
2022-05-31 14:22:23 +08:00
6f35740272 Linting fixes 2022-05-30 22:38:24 -07:00
53c423b714 WIP: upload PDFs using background task 2022-05-30 22:30:43 -07:00
c0bb67a6b5 Verify api key for routers too 2022-05-28 22:00:01 +08:00
333b0259ba Fix tests 2022-05-27 18:33:49 +08:00
9051a3f43a Update api key validation 2022-05-27 18:33:49 +08:00
a09588d3a7 Update generateApiKey resolver 2022-05-27 18:33:49 +08:00
93b095818d Linting fixes 2022-05-26 21:40:40 -07:00
cb98a9cf86 Make clients opt into creating a page when uploading a file 2022-05-26 21:40:40 -07:00
7d4d1d7b67 Parse language in readability 2022-05-26 10:55:21 +08:00
6e06429636 Add language keyword in search query 2022-05-26 10:55:02 +08:00
a35b096d73 Support sort and filter by published in resolver 2022-05-24 18:25:32 +08:00
2ee95a1c14 Fix cannot convert null to object error message 2022-05-20 20:38:30 +08:00
eadeccce81 Linting fixes 2022-05-18 11:31:42 -07:00
004c766588 If parsing fails, attempt adding <html> wrappers to a document
LinkedDom seems less forgiving and expects the outerHTML of a
document, however older extension versions still send innerHTML.
2022-05-18 10:55:31 -07:00
d68549bcb7 Remove unused code 2022-05-18 15:52:31 +08:00
e76fb02f43 Fix window is not defined for parsing code blocks 2022-05-17 11:01:55 +08:00
1b8850ed33 Fix tests 2022-05-12 17:41:11 +08:00
602d141dec Rename doc to dom 2022-05-12 11:00:32 +08:00
a78a6c6ba4 Replace DomWindow with Document in handlers 2022-05-10 17:01:23 +08:00
6a57281e74 Remove DomWindow usage 2022-05-10 17:00:56 +08:00
acc7654a2f Replace jsdom with linkedom 2022-05-10 16:59:09 +08:00
5698790288 Pass url to readability 2022-05-10 16:53:45 +08:00
59a2639b7d Reduce http call to get jsonld data if title or content or sitename or byline exists 2022-05-09 13:45:45 +08:00
a457c9d128 Update article content only when code blocks exist 2022-05-09 13:45:45 +08:00
eaad96acdd Return parsed dom back to backend 2022-05-06 12:29:08 +08:00
5f5076e864 Highlight code element without reinitialize jsdom 2022-05-06 12:20:54 +08:00
7c6b810522 Remove redundant JSDOM 2022-05-06 10:53:36 +08:00
bc1ed3f054 Check state in articleSavingRequest 2022-05-04 19:33:13 +08:00
2b70d480d2 Remove article saving request (#493)
* Add state and taskName in elastic page mappings

* Add state and taskName in elastic page interface

* Create page with PROCESSING state before scrapping

* Update createArticleRequest API

* Fix tests

* Add default state for pages

* Update createArticle API

* Update save page

* Update save file

* Update saving item description

* Show unable to parse content for failed page

* Fix date parsing

* Search for not failed pages

* Fix tests

* Add test for saveUrl

* Update get article saving request api

* Update get article test

* Add test for articleSavingRequest API

* Add test for failure

* Return new page id if clientRequestId empty

* Update clientRequestId in savePage

* Update clientRequestId in saveFile

* Replace article with slug in articleSavingRequest

* Add slug in articleSavingRequest response

* Depreciate article

* Use slug in web

* Remove article and highlight fragments

* Query article.slug on Prod

* Show unable to parse description for failed page

* Fix a bug having duplicate pages when saving the same url multiple times

* Add state in response

* Rename variables in removeArticle API

* Rename state

* Add state in response in web

* Make state an enum

* Open temporary page by link id

* Use an empty reader view as the background for loading pages

* Progressively load the article page as content is loaded

* Add includePending flag in getArticles API

* Set includePending = true in web

* Add elastic update mappings in migration script

* Add elastic mappings in docker image

* Move index_settings.json to migrate package

* Remove elastic index creation in api

* Move elastic migrations to a separate directory

* Remove index_settings from api docker image

Co-authored-by: Jackson Harper <jacksonh@gmail.com>
2022-04-29 13:41:06 +08:00
71aa66ea9c Allow search for subscription:name (#461) 2022-04-22 08:47:41 +08:00
c2fd58a809 Make landing a restricted username page 2022-04-18 15:22:59 -07:00
ae0d1dd2ee Feature/search highlights backend (#395)
* add highlight mappings

* return highlight in resolvers

* temporarily skip highlight tests

* add test for getting highlights

* update merge highlight

* separate elastic methods

* roll back merge highlight test

* add highlight to elastic script

* update delete highlight in elastic

* migrate highlight data from postgres to elastic

* rescue not found exception when page is not found in the migration script

* exclude highlights in searching pages results

* search pages with highlights only with has:highlight query

* add search endpoint to search pages or highlights

* reduce code smell in search api

* fix rebase error

* fix tests

* add test for search highlight

* add test for new search endpoint

* add labels to search results

* update schema

* update search query

* fix update/share highlights

* fix rebase error

* fix tests

* add highlight model in elastic

* add savedAt and publishedAt date range in search query

* add sort by updated and recently read

* fix tests

* close db connection when tests are done

* test github action

* revert github action test

* fix rebase error

* add docker-compose for api-test

* remove unused env

* remove highlights with no page attached to

* allow get_articles resolver to search for query so we can merge it without web changes
2022-04-12 12:31:08 +08:00
2ebdaba780 add generate api key api and test (#392)
* add generate api key api and test

* test if user can make api call with the api key
2022-04-12 12:11:45 +08:00