-
Notifications
You must be signed in to change notification settings - Fork 523
Issues: explodinggradients/ragas
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
sentence_segmenter in metric should be adapt to language in adapt function?
bug
Something isn't working
module-metrics
this is part of metrics module
#1066
opened Jul 5, 2024 by
jmgu0212
LangchainLLMWrapper - no attribute agenerate_prompt - Unable to use HuggingFace LLMs and embedding models for test set generation.
bug
Something isn't working
module-testsetgen
Module testset generation
#1065
opened Jul 4, 2024 by
netopia-gab
Given code @ https://github.com/explodinggradients/ragas is not working and raises an exeption.
bug
Something isn't working
#1064
opened Jul 3, 2024 by
muhammad-ammar12
Can you provide human assessment data mentioned in RAGAS paper?
enhancement
New feature or request
question
Further information is requested
#1063
opened Jul 2, 2024 by
awsvmaringa
Invalid n value (currently only n = 1 is supported
bug
Something isn't working
module-metrics
this is part of metrics module
question
Further information is requested
#1059
opened Jul 2, 2024 by
ARES3366
Exception in thread Thread-4: Something isn't working
asyncio.exceptions.CancelledError & asyncio.exceptions.TimeoutError
bug
#1057
opened Jul 1, 2024 by
larry-ziyue-yin
Can anybody tell me the testset generator code given in RAGAS website what columns will it actually create i think we can only get questions and ground_truth ans from testset generator and the context and answer will be generated from our rag architecture
question
Further information is requested
#1054
opened Jun 28, 2024 by
Saurabh8255
Parallelization conflict in evaluate function
bug
Something isn't working
#1052
opened Jun 27, 2024 by
aeronesto
answer_correctness giving inconsistent result
bug
Something isn't working
#1049
opened Jun 27, 2024 by
chboudry
Hello，calculate faithfulness Error: No statements were generated from the answer
bug
Something isn't working
module-metrics
this is part of metrics module
#1048
opened Jun 27, 2024 by
13416157913
Keep getting "Your authentication token is not from a valid issuer", although I got OpenAI access
bug
Something isn't working
#1047
opened Jun 26, 2024 by
ilaychen
Q: Aspect Critique: Multiple Verdicts?
module-metrics
this is part of metrics module
question
Further information is requested
#1046
opened Jun 26, 2024 by
dkhundley
Are Multi-context questions generated by using related docs or related chunks of the same doc?
question
Further information is requested
#1045
opened Jun 25, 2024 by
nikithamary
Any form of caching / reusing data while generating a synthetic dataset?
question
Further information is requested
#1044
opened Jun 25, 2024 by
NiklasClausius
feat(benchmark): Implement flexible model selection in TestsetGenerator for improved customization and consistency
enhancement
New feature or request
module-testsetgen
Module testset generation
#1042
opened Jun 24, 2024 by
donbr
ExceptionInRunner: The runner thread which was running the jobs raised an exeception. Read the traceback above to debug it
bug
Something isn't working
#1041
opened Jun 24, 2024 by
prabham17
[Feature Request] OpenLLMetry Integration (OpenTelemetry)
enhancement
New feature or request
module-metrics
this is part of metrics module
#1039
opened Jun 22, 2024 by
amitjoy
filter_question instruction may be something wrong
bug
Something isn't working
question
Further information is requested
#1038
opened Jun 21, 2024 by
jaqennnn
Prompt for Question Creation or Am I missing something
question
Further information is requested
#1037
opened Jun 20, 2024 by
TheShoes
Context Precision Example
question
Further information is requested
#1036
opened Jun 20, 2024 by
MatthewSH
Use GPT-4o instead of GPT-4?
enhancement
New feature or request
question
Further information is requested
#1035
opened Jun 20, 2024 by
arainey2022
Baidu Qianfan's model
question
Further information is requested
#1034
opened Jun 19, 2024 by
purpleofdial
Is it possible to define custom metrics with Ragas ?
question
Further information is requested
#1032
opened Jun 18, 2024 by
saadbouhya
Support for multi-modal RAG evaluation (including images, tables, etc.)
enhancement
New feature or request
#1030
opened Jun 17, 2024 by
joly-chen
Previous Next
ProTip!
Type g i on any issue or pull request to go back to the issue listing page.