Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: remove use of ImagePromptTemplate in image handling and adds image utils #4467

Merged
merged 10 commits into from
Nov 8, 2024

Conversation

ogabrielluiz
Copy link
Contributor

This pull request refactors the image URL handling by replacing the ImagePromptTemplate with a new create_data_url function, which simplifies the process of generating data URLs for images. Additionally, it introduces functions to convert images to base64 format. The langchain-core dependency has been updated to version 0.3.15, and the poetry.lock file has been removed. These changes enhance the data schema for images and improve overall code maintainability.

This fixes issues found in #4448

@dosubot dosubot bot added size:M This PR changes 30-99 lines, ignoring generated files. enhancement New feature or request labels Nov 8, 2024
@github-actions github-actions bot added bug Something isn't working and removed enhancement New feature or request labels Nov 8, 2024
@dosubot dosubot bot added lgtm This PR has been approved by a maintainer size:L This PR changes 100-499 lines, ignoring generated files. and removed size:M This PR changes 30-99 lines, ignoring generated files. labels Nov 8, 2024
…dule

- Introduce fixtures for temporary cache directory and sample image creation.
- Add tests for message creation from human and AI text.
- Implement tests for messages with single and multiple images.
- Include tests for invalid image paths and messages without sender.
- Add message serialization and conversion tests.
- Ensure cleanup of cache directory after tests.
Copy link

codspeed-hq bot commented Nov 8, 2024

CodSpeed Performance Report

Merging #4467 will not alter performance

Comparing fix-imageprompt (5399c4a) with main (7114cc4)

Summary

✅ 15 untouched benchmarks

@ogabrielluiz ogabrielluiz merged commit 9827463 into main Nov 8, 2024
29 checks passed
@ogabrielluiz ogabrielluiz deleted the fix-imageprompt branch November 8, 2024 16:24
ogabrielluiz added a commit that referenced this pull request Nov 8, 2024
…ge utils (#4467)

* remove poetry.lock

* fix: update langchain-core dependency version to 0.3.15

* feat: add functions to convert images to base64 and create data URLs

* refactor: simplify image URL handling by replacing ImagePromptTemplate with create_data_url function

* Fix image URL structure in data schema to use nested dictionary format

* Add unit tests for Data schema message conversion with text and images

* test: add unit tests for image utility functions to validate base64 conversion and data URL creation

* Refactor image URL generation to use `create_data_url` utility function instead of `ImagePromptTemplate`

* Add unit tests for message handling and image processing in schema module

- Introduce fixtures for temporary cache directory and sample image creation.
- Add tests for message creation from human and AI text.
- Implement tests for messages with single and multiple images.
- Include tests for invalid image paths and messages without sender.
- Add message serialization and conversion tests.
- Ensure cleanup of cache directory after tests.

* Use platformdirs to determine cache directory paths in test_schema_message.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working lgtm This PR has been approved by a maintainer size:L This PR changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants