Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Store relation info with index => always return attribute values in results #535

Open
wants to merge 20 commits into
base: dev
Choose a base branch
from

Conversation

jan-niestadt
Copy link
Member

Add ability to store relation info, so results can always include span attributes, even if we didn't search for attributes (so the "simple" term was matched, not the term that includes the attributes).

Inline tags used to be indexed and searched case- and accent-sensitively,
but we've changed this so it defaults to insensitive instead. This seems
to be the more common use case.

Set indexing.relationsSensitive to true in blacklab[-server].yaml to keep the
old behaviour, where tags where always case-sensitive.

This setting is BlackLab-wide; there is no way to e.g. configure this per index.
Because we can now either index relations/tags sensitively
or insensitively, we have to make sure we select the correct version.

Also, just rely on the _relation's sensitivity settings to
desensitize while searching, so we deal correctly with the way
the index was created.
@jan-niestadt jan-niestadt changed the title Experiment/store attributes2 Store relation info with index => always return attribute values in results Nov 29, 2024
In this case, relationId is set to -1, which is recognized as meaning
"there's no extra relation info, don't bother looking". Mostly saves
some space.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant