Skip to content

Error when parsing JSON: Empty strings are not legal JSON5 #726

@Breamer

Description

@Breamer

I'm using a python AWS lambda function to run evaluations using Bedrock, with model Claude 3.5 sonnet and Uptrain version 0.7.1.

I'm getting an "Error when parsing JSON" error when trying to run evaluations, depending on the data processed.

Steps to reproduce the behavior:

Create a lambda function using python 3.11
Install uptrain
Use bedrock to run a factual accuracy evaluation

See error

ERROR | uptrain.operators.language.llm:parse_json:55 - Error when parsing JSON: Empty strings are not legal JSON5
ERROR | uptrain.operators.language.llm:async_process_payload:103 - Error when sending request to LLM API: Response doesn't pass the validation func.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions