|
|
e07416f3d1
|
only compare data of affected users
|
2023-10-06 08:25:57 +08:00 |
|
|
|
de5633e895
|
only compare data of affected users
|
2023-10-05 15:33:48 +08:00 |
|
|
|
1ace21405a
|
create an index for searching by slug
|
2023-10-05 14:32:05 +08:00 |
|
|
|
0e7f45a758
|
create a trigger to update recommender_names in library_item table
|
2023-10-05 14:32:05 +08:00 |
|
|
|
f6c906201b
|
fetch recommendations separately too
|
2023-10-05 14:32:05 +08:00 |
|
|
|
d4404b0248
|
fetch labels and highlights after items fetched in a search query
|
2023-10-05 14:32:05 +08:00 |
|
|
|
bb59ed757c
|
fix word count not return
|
2023-10-05 14:32:05 +08:00 |
|
|
|
bbbb862fac
|
create index for foreign keys
|
2023-10-05 14:32:05 +08:00 |
|
|
|
4948801d7b
|
fix a typo
|
2023-10-05 14:32:05 +08:00 |
|
|
|
a0ab7dcf62
|
fix year 0 is out of range error
|
2023-10-05 14:32:05 +08:00 |
|
|
|
4672aaffb6
|
skip item if duplicate id but different url
|
2023-10-05 14:32:05 +08:00 |
|
|
|
09f40a85dc
|
skip item if duplicate id
|
2023-10-05 14:32:05 +08:00 |
|
|
|
6ceb0ccf5b
|
remove version 4 from uuid generator
|
2023-10-05 14:32:05 +08:00 |
|
|
|
ca1a4878ce
|
fix valid 39 characters uuid not being inserted
|
2023-10-05 14:32:05 +08:00 |
|
|
|
eb0f0b6c4f
|
improve data migration speed
|
2023-10-05 14:32:05 +08:00 |
|
|
|
86478c13d2
|
fix sql
|
2023-10-05 14:32:05 +08:00 |
|
|
|
42e01613d4
|
inner join user table when inserting highlight to make sure user exists
|
2023-10-05 14:32:05 +08:00 |
|
|
|
4d846c520b
|
create a new sanitized tuple because tuple is immutable
|
2023-10-05 14:31:07 +08:00 |
|
|
|
475e32e859
|
Catch error from converting string to datetime
|
2023-10-05 14:31:07 +08:00 |
|
|
|
71c203cdb2
|
Update migration script to check the unique index while inserting data into library_item table
|
2023-10-05 14:31:07 +08:00 |
|
|
|
e950662ced
|
Replace the unique constraint on library_item table with a unique index of userId and md5 hashed original url
|
2023-10-05 14:31:07 +08:00 |
|
|
|
6604c42bf4
|
remove null byte from content
|
2023-10-05 14:31:07 +08:00 |
|
|
|
093440e1ab
|
replace surrogates with placeholder
|
2023-10-05 14:31:07 +08:00 |
|
|
|
aa9c97fcbc
|
encode with utf-16 if failed
|
2023-10-05 14:31:07 +08:00 |
|
|
|
f9ce8f6b3e
|
encode surrogatepass to avoid error when inserting into postgres
|
2023-10-05 14:31:07 +08:00 |
|
|
|
65115b3ba7
|
fix a typo
|
2023-10-05 14:31:07 +08:00 |
|
|
|
4c30a4f561
|
use enumerate to get index from for loop
|
2023-10-05 14:31:07 +08:00 |
|
|
|
e68f7b42ba
|
print original id for debugging
|
2023-10-05 14:31:07 +08:00 |
|
|
|
71e3c716be
|
excute insert query one by one if batch insert failed and if string is too long for tsvector, disable the update_library_item_tsv trigger temporarily and insert the failed one again
|
2023-10-05 14:31:07 +08:00 |
|
|
|
663ccdae41
|
try to insert library item one by one if batch insert failed
|
2023-10-05 14:31:07 +08:00 |
|
|
|
323be5376a
|
truncate long description to 1MB
|
2023-10-05 14:31:07 +08:00 |
|
|
|
85febfa8b6
|
fix a typo
|
2023-10-05 14:31:07 +08:00 |
|
|
|
c7e56fbce6
|
add PG_TIMEOUT to env var
|
2023-10-05 14:31:07 +08:00 |
|
|
|
6d6d34e94e
|
convert ES_TIMEOUT to int
|
2023-10-05 14:31:07 +08:00 |
|
|
|
e9527bb5ad
|
add es_timeout to env var
|
2023-10-05 14:31:07 +08:00 |
|
|
|
f46006e293
|
add end_time to the migrate script
|
2023-10-05 14:31:07 +08:00 |
|
|
|
4d1d9a8c1b
|
skip item if content length is greater than 1MB
|
2023-10-05 14:31:07 +08:00 |
|
|
|
0ff9fdef04
|
add elastic scroll time in the env var
|
2023-10-05 14:31:07 +08:00 |
|
|
|
9e5196406e
|
revert rls on old tables
|
2023-10-05 14:31:07 +08:00 |
|
|
|
d5c247a98d
|
make cool-down time an env var
|
2023-10-05 14:31:07 +08:00 |
|
|
|
330e50fba5
|
increase scroll to 2m and cool down for 5 seconds
|
2023-10-05 14:31:07 +08:00 |
|
|
|
7d4948a43b
|
reduce scroll to 1m
|
2023-10-05 14:31:07 +08:00 |
|
|
|
8f1664b058
|
increase timeout
|
2023-10-05 14:31:07 +08:00 |
|
|
|
a83f7921f4
|
reduce shortId length to 14
|
2023-10-05 14:31:07 +08:00 |
|
|
|
a947310d30
|
reduce shortId length to 14
|
2023-10-05 14:31:07 +08:00 |
|
|
|
ecbabacc78
|
set reading progress to 0 if null
|
2023-10-05 14:31:07 +08:00 |
|
|
|
a445bc55d4
|
add default item_type
|
2023-10-05 14:31:07 +08:00 |
|
|
|
b4512d2d1c
|
convert ES_SCAN_SIZE to int
|
2023-10-05 14:31:07 +08:00 |
|
|
|
b20ad4a210
|
reorder migrate sql
|
2023-10-05 14:31:07 +08:00 |
|
|
|
ac77580cca
|
fix label names update not reflected
|
2023-10-05 14:31:07 +08:00 |
|
