|
|
5f11bf1fde
|
remove elasticsearch dep from packages/db
|
2023-10-17 17:12:26 +08:00 |
|
|
|
6e79f6c67f
|
update sql to deduplicate rss subscriptions
|
2023-10-17 16:41:14 +08:00 |
|
|
|
ab0fc1087d
|
update tsv only if necessary
|
2023-10-17 12:02:44 +08:00 |
|
|
|
1b2d93e118
|
remove duplicate rss subscriptions by user and url; create a unique constraint
|
2023-10-16 17:35:29 +08:00 |
|
|
|
e54c1c81a1
|
soft delete user by calling delete account api
|
2023-10-16 15:24:53 +08:00 |
|
|
|
3f4be32df8
|
Merge library item imports
|
2023-10-13 18:26:02 +08:00 |
|
|
|
b0f0dba53d
|
drop position trigger on labels table and sort labels by name returned by labels api
|
2023-10-12 10:39:35 +08:00 |
|
|
|
76b382966d
|
Make highlight modification two steps
|
2023-10-11 19:27:03 +08:00 |
|
|
|
3201f96d43
|
add default value = now() to updatedAt field in highlight tables only
|
2023-10-11 18:41:10 +08:00 |
|
|
|
0c612c27e7
|
add default value = now() to updatedAt field in labels, user_profile and highlight tables
|
2023-10-11 17:05:19 +08:00 |
|
|
|
dc14743fb8
|
remove data assertion from migration script to speed up
|
2023-10-10 22:26:02 +08:00 |
|
|
|
768845e101
|
update the filter value to use is:reading of the Continue Reading filter
|
2023-10-10 15:33:59 +08:00 |
|
|
|
e07416f3d1
|
only compare data of affected users
|
2023-10-06 08:25:57 +08:00 |
|
|
|
de5633e895
|
only compare data of affected users
|
2023-10-05 15:33:48 +08:00 |
|
|
|
1ace21405a
|
create an index for searching by slug
|
2023-10-05 14:32:05 +08:00 |
|
|
|
0e7f45a758
|
create a trigger to update recommender_names in library_item table
|
2023-10-05 14:32:05 +08:00 |
|
|
|
f6c906201b
|
fetch recommendations separately too
|
2023-10-05 14:32:05 +08:00 |
|
|
|
d4404b0248
|
fetch labels and highlights after items fetched in a search query
|
2023-10-05 14:32:05 +08:00 |
|
|
|
bb59ed757c
|
fix word count not return
|
2023-10-05 14:32:05 +08:00 |
|
|
|
bbbb862fac
|
create index for foreign keys
|
2023-10-05 14:32:05 +08:00 |
|
|
|
4948801d7b
|
fix a typo
|
2023-10-05 14:32:05 +08:00 |
|
|
|
a0ab7dcf62
|
fix year 0 is out of range error
|
2023-10-05 14:32:05 +08:00 |
|
|
|
4672aaffb6
|
skip item if duplicate id but different url
|
2023-10-05 14:32:05 +08:00 |
|
|
|
09f40a85dc
|
skip item if duplicate id
|
2023-10-05 14:32:05 +08:00 |
|
|
|
6ceb0ccf5b
|
remove version 4 from uuid generator
|
2023-10-05 14:32:05 +08:00 |
|
|
|
ca1a4878ce
|
fix valid 39 characters uuid not being inserted
|
2023-10-05 14:32:05 +08:00 |
|
|
|
eb0f0b6c4f
|
improve data migration speed
|
2023-10-05 14:32:05 +08:00 |
|
|
|
86478c13d2
|
fix sql
|
2023-10-05 14:32:05 +08:00 |
|
|
|
42e01613d4
|
inner join user table when inserting highlight to make sure user exists
|
2023-10-05 14:32:05 +08:00 |
|
|
|
4d846c520b
|
create a new sanitized tuple because tuple is immutable
|
2023-10-05 14:31:07 +08:00 |
|
|
|
475e32e859
|
Catch error from converting string to datetime
|
2023-10-05 14:31:07 +08:00 |
|
|
|
71c203cdb2
|
Update migration script to check the unique index while inserting data into library_item table
|
2023-10-05 14:31:07 +08:00 |
|
|
|
e950662ced
|
Replace the unique constraint on library_item table with a unique index of userId and md5 hashed original url
|
2023-10-05 14:31:07 +08:00 |
|
|
|
6604c42bf4
|
remove null byte from content
|
2023-10-05 14:31:07 +08:00 |
|
|
|
093440e1ab
|
replace surrogates with placeholder
|
2023-10-05 14:31:07 +08:00 |
|
|
|
aa9c97fcbc
|
encode with utf-16 if failed
|
2023-10-05 14:31:07 +08:00 |
|
|
|
f9ce8f6b3e
|
encode surrogatepass to avoid error when inserting into postgres
|
2023-10-05 14:31:07 +08:00 |
|
|
|
65115b3ba7
|
fix a typo
|
2023-10-05 14:31:07 +08:00 |
|
|
|
4c30a4f561
|
use enumerate to get index from for loop
|
2023-10-05 14:31:07 +08:00 |
|
|
|
e68f7b42ba
|
print original id for debugging
|
2023-10-05 14:31:07 +08:00 |
|
|
|
71e3c716be
|
excute insert query one by one if batch insert failed and if string is too long for tsvector, disable the update_library_item_tsv trigger temporarily and insert the failed one again
|
2023-10-05 14:31:07 +08:00 |
|
|
|
663ccdae41
|
try to insert library item one by one if batch insert failed
|
2023-10-05 14:31:07 +08:00 |
|
|
|
323be5376a
|
truncate long description to 1MB
|
2023-10-05 14:31:07 +08:00 |
|
|
|
85febfa8b6
|
fix a typo
|
2023-10-05 14:31:07 +08:00 |
|
|
|
c7e56fbce6
|
add PG_TIMEOUT to env var
|
2023-10-05 14:31:07 +08:00 |
|
|
|
6d6d34e94e
|
convert ES_TIMEOUT to int
|
2023-10-05 14:31:07 +08:00 |
|
|
|
e9527bb5ad
|
add es_timeout to env var
|
2023-10-05 14:31:07 +08:00 |
|
|
|
f46006e293
|
add end_time to the migrate script
|
2023-10-05 14:31:07 +08:00 |
|
|
|
4d1d9a8c1b
|
skip item if content length is greater than 1MB
|
2023-10-05 14:31:07 +08:00 |
|
|
|
0ff9fdef04
|
add elastic scroll time in the env var
|
2023-10-05 14:31:07 +08:00 |
|
