Skip to content
This repository has been archived by the owner on Apr 26, 2024. It is now read-only.

Unified search query syntax using the full-text search capabilities of the underlying DB #11635

Merged
merged 59 commits into from
Oct 25, 2022
Merged

Unified search query syntax using the full-text search capabilities of the underlying DB #11635

merged 59 commits into from
Oct 25, 2022

Commits on Dec 22, 2021

  1. use websearch_to_tsquery

    @novocaine
    novocaine committed Dec 22, 2021
    Configuration menu
    Copy the full SHA
    d49af47 View commit details
    Browse the repository at this point in the history

  2. Support fallback using plainto_tsquery

    @novocaine
    novocaine committed Dec 22, 2021
    Configuration menu
    Copy the full SHA
    fea2848 View commit details
    Browse the repository at this point in the history

Commits on Dec 23, 2021

  1. cleanup

    @novocaine
    novocaine committed Dec 23, 2021
    Configuration menu
    Copy the full SHA
    ccb0d6c View commit details
    Browse the repository at this point in the history

  2. add tests for search_rooms

    @novocaine
    novocaine committed Dec 23, 2021
    Configuration menu
    Copy the full SHA
    409afd6 View commit details
    Browse the repository at this point in the history

  3. deflake

    @novocaine
    novocaine committed Dec 23, 2021
    Configuration menu
    Copy the full SHA
    ac002cb View commit details
    Browse the repository at this point in the history

  4. improve docstring

    @novocaine
    novocaine committed Dec 23, 2021
    Configuration menu
    Copy the full SHA
    bbbb651 View commit details
    Browse the repository at this point in the history

  5. pass tsquery_func to _find_highlights_in_postgres

    @novocaine
    novocaine committed Dec 23, 2021
    Configuration menu
    Copy the full SHA
    02defb2 View commit details
    Browse the repository at this point in the history

  6. Add tests for sqlite

    @novocaine
    novocaine committed Dec 23, 2021
    Configuration menu
    Copy the full SHA
    2eef5ed View commit details
    Browse the repository at this point in the history

  7. Don't preprocess sqllite queries

    @novocaine
    novocaine committed Dec 23, 2021
    Configuration menu
    Copy the full SHA
    28dc642 View commit details
    Browse the repository at this point in the history

  8. Also test the size of "results", as its generated by a different quer… 

    …y to count
    @novocaine
    novocaine committed Dec 23, 2021
    Configuration menu
    Copy the full SHA
    8ac3ea1 View commit details
    Browse the repository at this point in the history

  9. fix comment

    @novocaine
    novocaine committed Dec 23, 2021
    Configuration menu
    Copy the full SHA
    5198cb2 View commit details
    Browse the repository at this point in the history

  10. Use plainto_tsquery instead of crafting the query ourselves

    @novocaine
    novocaine committed Dec 23, 2021
    Configuration menu
    Copy the full SHA
    b3c7e0d View commit details
    Browse the repository at this point in the history

  11. black

    @novocaine
    novocaine committed Dec 23, 2021
    Configuration menu
    Copy the full SHA
    10f181a View commit details
    Browse the repository at this point in the history

  12. Merge branch 'develop' of github.com:matrix-org/synapse into use-webs… 

    …earch_to_tsquery-for-fts
    @novocaine
    novocaine committed Dec 23, 2021
    Configuration menu
    Copy the full SHA
    905f572 View commit details
    Browse the repository at this point in the history

  13. Add feature file

    @novocaine
    novocaine committed Dec 23, 2021
    Configuration menu
    Copy the full SHA
    05a0cdd View commit details
    Browse the repository at this point in the history

  14. Use common cases for all tests

    @novocaine
    novocaine committed Dec 23, 2021
    Configuration menu
    Copy the full SHA
    b0417e9 View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2022

  1. Merge branch 'develop' of github.com:novocaine/synapse into use-webse… 

    …arch_to_tsquery-for-fts
    @novocaine
    novocaine committed Jan 10, 2022
    Configuration menu
    Copy the full SHA
    04c394b View commit details
    Browse the repository at this point in the history

Commits on May 26, 2022

  1. Merge branch 'develop' into use-websearch_to_tsquery-for-fts

    @novocaine
    novocaine committed May 26, 2022
    Configuration menu
    Copy the full SHA
    4cfb506 View commit details
    Browse the repository at this point in the history

  2. fix for removal of get_datastore()

    @novocaine
    novocaine committed May 26, 2022
    Configuration menu
    Copy the full SHA
    d30a211 View commit details
    Browse the repository at this point in the history

  3. isort

    @novocaine
    novocaine committed May 26, 2022
    Configuration menu
    Copy the full SHA
    68cae26 View commit details
    Browse the repository at this point in the history

  4. add migration

    @novocaine
    novocaine committed May 26, 2022
    Configuration menu
    Copy the full SHA
    5dbb2c0 View commit details
    Browse the repository at this point in the history

  5. comment

    @novocaine
    novocaine committed May 26, 2022
    Configuration menu
    Copy the full SHA
    64dd357 View commit details
    Browse the repository at this point in the history

  6. black

    @novocaine
    novocaine committed May 26, 2022
    Configuration menu
    Copy the full SHA
    20ab98e View commit details
    Browse the repository at this point in the history

  7. isort

    @novocaine
    novocaine committed May 26, 2022
    Configuration menu
    Copy the full SHA
    e5aa916 View commit details
    Browse the repository at this point in the history

  8. flake8

    @novocaine
    novocaine committed May 26, 2022
    Configuration menu
    Copy the full SHA
    7941d8a View commit details
    Browse the repository at this point in the history

  9. import List for python 3.7

    @novocaine
    novocaine committed May 26, 2022
    Configuration menu
    Copy the full SHA
    f7362f1 View commit details
    Browse the repository at this point in the history

  10. create a background job, and don't do anything if the tokenizer is al… 

    …ready porter
    @novocaine
    novocaine committed May 26, 2022
    Configuration menu
    Copy the full SHA
    f1769f9 View commit details
    Browse the repository at this point in the history

  11. When creating a new db, create it with tokenize=porter in the first p… 

    …lace
    @novocaine
    novocaine committed May 26, 2022
    Configuration menu
    Copy the full SHA
    de07c83 View commit details
    Browse the repository at this point in the history

Commits on May 27, 2022

  1. black

    @novocaine
    novocaine committed May 27, 2022
    Configuration menu
    Copy the full SHA
    1170e07 View commit details
    Browse the repository at this point in the history

  2. Revert change to 25/fts.py 

    This aims to optimise creation of a new site by avoiding creating and recreating the event_search table, but it has no effect without also updating full_schemas which I don't think we want to do
    @novocaine
    novocaine committed May 27, 2022
    Configuration menu
    Copy the full SHA
    b987203 View commit details
    Browse the repository at this point in the history

  3. fix json import

    @novocaine
    novocaine committed May 27, 2022
    Configuration menu
    Copy the full SHA
    6ef1ef8 View commit details
    Browse the repository at this point in the history

  4. slightly neater quote formatting

    @novocaine
    novocaine committed May 27, 2022
    Configuration menu
    Copy the full SHA
    63c4270 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2022

  1. fix missing space

    @novocaine
    novocaine committed May 30, 2022
    Configuration menu
    Copy the full SHA
    0ddf6b1 View commit details
    Browse the repository at this point in the history

  2. Add a parser to produce uniform results on all DBs

    @novocaine
    novocaine committed May 30, 2022
    Configuration menu
    Copy the full SHA
    9d77bc4 View commit details
    Browse the repository at this point in the history

  3. address flake8

    @novocaine
    novocaine committed May 30, 2022
    Configuration menu
    Copy the full SHA
    b8b2e28 View commit details
    Browse the repository at this point in the history

  4. give mypy a hint

    @novocaine
    novocaine committed May 30, 2022
    Configuration menu
    Copy the full SHA
    8506b21 View commit details
    Browse the repository at this point in the history

  5. Fix phrase handling of "word"

    @novocaine
    novocaine committed May 30, 2022
    Configuration menu
    Copy the full SHA
    e279be5 View commit details
    Browse the repository at this point in the history

  6. Add comment

    @novocaine
    novocaine committed May 30, 2022
    Configuration menu
    Copy the full SHA
    6a7cf49 View commit details
    Browse the repository at this point in the history

Commits on May 31, 2022

  1. Merge branch 'develop' into use-websearch_to_tsquery-for-fts

    @novocaine
    novocaine authored May 31, 2022
    Configuration menu
    Copy the full SHA
    92ad70a View commit details
    Browse the repository at this point in the history

  2. document negation via -

    @novocaine
    novocaine committed May 31, 2022
    Configuration menu
    Copy the full SHA
    a5f298b View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2022

  1. Merge remote-tracking branch 'origin/develop' into use-websearch_to_t… 

    …squery-for-fts
    @clokep
    clokep committed Oct 17, 2022
    Configuration menu
    Copy the full SHA
    d6ed19e View commit details
    Browse the repository at this point in the history

  2. Move the database schema to the updated directory.

    @clokep
    clokep committed Oct 17, 2022
    Configuration menu
    Copy the full SHA
    c544409 View commit details
    Browse the repository at this point in the history

  3. Use a deque.

    @clokep
    clokep committed Oct 17, 2022
    Configuration menu
    Copy the full SHA
    be742f1 View commit details
    Browse the repository at this point in the history

  4. Add basic tests for _tokenize_query.

    @clokep
    clokep committed Oct 17, 2022
    Configuration menu
    Copy the full SHA
    52700b0 View commit details
    Browse the repository at this point in the history

  5. Handle edge-cases.

    @clokep
    clokep committed Oct 17, 2022
    Configuration menu
    Copy the full SHA
    5d9d183 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2022

  1. temp

    @clokep
    clokep committed Oct 18, 2022
    Configuration menu
    Copy the full SHA
    219321b View commit details
    Browse the repository at this point in the history

  2. Fix phrase handling.

    @clokep
    clokep committed Oct 18, 2022
    Configuration menu
    Copy the full SHA
    9166035 View commit details
    Browse the repository at this point in the history

  3. Handle not with a space after.

    @clokep
    clokep committed Oct 18, 2022
    Configuration menu
    Copy the full SHA
    a7fd4f6 View commit details
    Browse the repository at this point in the history

  4. Use the int version number to check if the feature is supported.

    @clokep
    clokep committed Oct 18, 2022
    Configuration menu
    Copy the full SHA
    6751f5f View commit details
    Browse the repository at this point in the history

  5. Lint

    @clokep
    clokep committed Oct 18, 2022
    Configuration menu
    Copy the full SHA
    6e6ebd9 View commit details
    Browse the repository at this point in the history

  6. Simplify schema delta.

    @clokep
    clokep committed Oct 18, 2022
    Configuration menu
    Copy the full SHA
    3272819 View commit details
    Browse the repository at this point in the history

  7. Add docstring.

    @clokep
    clokep committed Oct 18, 2022
    Configuration menu
    Copy the full SHA
    4993e1c View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2022

  1. Remove support for parens.

    @clokep
    clokep committed Oct 24, 2022
    Configuration menu
    Copy the full SHA
    9b7bb08 View commit details
    Browse the repository at this point in the history

  2. Fix edge cases with double quotes.

    @clokep
    clokep committed Oct 24, 2022
    Configuration menu
    Copy the full SHA
    13f5306 View commit details
    Browse the repository at this point in the history

  3. Lint.

    @clokep
    clokep committed Oct 24, 2022
    Configuration menu
    Copy the full SHA
    62f6f18 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'origin/develop' into use-websearch_to_t… 

    …squery-for-fts
    @clokep
    clokep committed Oct 24, 2022
    Configuration menu
    Copy the full SHA
    abc56ad View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2022

  1. Remove backwards compat code for Postgres < 11 since (almost) EOL.

    @clokep
    clokep committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    b3755ae View commit details
    Browse the repository at this point in the history

  2. Simplify phrase handling.

    @clokep
    clokep committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    5e5fc8d View commit details
    Browse the repository at this point in the history

  3. Fix tests on postgres 10.

    @clokep
    clokep committed Oct 25, 2022
    Configuration menu
    Copy the full SHA
    223580a View commit details
    Browse the repository at this point in the history