postgresql + pgvector configuration

[benqethan]

I tried to make txtai to load Application(yml_config), but seems the loaddata doesn't happen even i have the vector in the postgresql.
Below is the the yaml file

# Embeddings index
embeddings:
  # model: thenlper/gte-base
  ann:
    backend: pgvector
  database:
    backend: postgres
  pgvector:
    url: postgresql://pguser:pgpassword@localhost:5432/pgvector_db
    schema: txtai
  content: postgresql://pguser:pgpassword@localhost:5432/pgvector_db

writable: True

Seems it is related to this line in Application class:

if loaddata and Embeddings().exists(self.config.get("path"), self.config.get("cloud")):

Not sure how to make it work. Please help out. Thanks

[davidmezzetti]

txtai doesn't currently have a Postgres backend for index configuration.

path: local path that exists

# Embeddings index
embeddings:
  # model: thenlper/gte-base
  ann:
    backend: pgvector
  database:
    backend: postgres
  pgvector:
    url: postgresql://pguser:pgpassword@localhost:5432/pgvector_db
    schema: txtai
  content: postgresql://pguser:pgpassword@localhost:5432/pgvector_db

writable: True

How did you create the data in Postgres?

[jackyq2015]

@davidmezzetti Thanks for the reply!
I manually migrated from sqlite faiss to pg. Seems even adding path as a trick to have app to load embeddings from db, it still need to tweak a bit to pass "content" into loading below:

            # Pass path and cloud settings. Set application functions as config overrides.
            self.embeddings.load(
                self.config.get("path"),
                self.config.get("cloud"),
                {key: config[key] for key in ["functions", "transform", "content"] if key in config} if config else None,
            )

After above change, at least pgvector can be loaded. But still have other issue with search since the introduce of the batch table.

Just wondering does pg support still be considered or there might be a better component as an alternative? If it still the path going forward, I can try to create a PR for this. Let me know.

[davidmezzetti]

I'd have to research this more. I've used Postgres plenty with txtai but I'm not exactly sure about what steps were made here with migrating from Faiss/SQLite to Postgres.