Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dependency conflict between OpenAI and AWE pipeline components for Pydantic #118

Closed
bradley-erickson opened this issue Jan 17, 2024 · 1 comment

Comments

@bradley-erickson
Copy link
Collaborator

There is a dependency bug that I missed when upgrading OpenAI in #113. The newer version of OpenAI relies on Pydantic v2. The compatibility issue stands with spaCy who did not start supporting Pydantic v2 until spaCy v3.6.1.

The AWE Components used on the system require spaCy 3.3 or prior. The internal packages should be good for an upgrade; however, there are 2 additional pipeline pieces that we do not manage. spacytextblob and corereferee.

Testing locally, spacytextblob is fine to use with newer versions of spaCy. However, coreferee defines the specific spaCy models that it should allow. These models are tied to the specific version of spaCy being ran. To fix this, many models (in multiple languages) need to be added to the system. There is an open issue on their Github regarding this upgrade.

@bradley-erickson
Copy link
Collaborator Author

To test these libraries capability with spaCy, I've been:

  1. clone the packaged pipeline locally
  2. create a new environment
  3. install the pipeline
  4. install spaCy (whichever version you are using)
  5. run the tests the cloned repo provides
  6. confirm if the tests pass or fail

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done
Development

No branches or pull requests

1 participant