Ensure that the errorLogs() function captures error logs from a script

[anna-geller]

Feature description

id: error_logs_demo
namespace: company.team

tasks:    
  - id: fail
    type: io.kestra.plugin.scripts.python.Script
    taskRunner:
      type: io.kestra.plugin.core.runner.Process
    script: |
      raise ValueError("An error occurred: This is a manually raised exception.")
errors:
  - id: alert
    type: io.kestra.plugin.core.log.Log
    message: list of error logs — {{ errorLogs() }}

Another example:

id: error_logs_demo
namespace: company.team

tasks:    
  - id: fail
    type: io.kestra.plugin.scripts.python.Script
    taskRunner:
      type: io.kestra.plugin.core.runner.Process
    script: |
      def divide_numbers(a, b):
          return a / b

      result = divide_numbers(5, 0)
      print(result)

errors:
  - id: alert
    type: io.kestra.plugin.core.log.Log
    message: list of error logs — {{ errorLogs() }}

The only error log it captures is Command failed with exit code 1 - the actual log with a reason why the task failed is not captured.

list of error logs — [{"namespace":"company.team","flowId":"error_logs_demo2","taskId":"fail","executionId":"41ClpgK5tLqp2WqKsM1U3c","taskRunId":"tfBn6QL2y51KtWxUDbWf7","attemptNumber":0,"timestamp":"2024-11-25T15:40:22.226Z","level":"ERROR","thread":"worker_4","message":"Command failed with exit code 1","deleted":false},{"namespace":"company.team","flowId":"error_logs_demo2","taskId":"fail","executionId":"41ClpgK5tLqp2WqKsM1U3c","taskRunId":"tfBn6QL2y51KtWxUDbWf7","attemptNumber":0,"timestamp":"2024-11-25T15:40:22.226Z","level":"ERROR","thread":"worker_4","message":"io.kestra.core.models.tasks.runners.TaskException: Command failed with exit code 1","deleted":false}]

[wrussell1999]

This is an example with S3 Copy that fails.

id: error_logs_demo
namespace: company.team

tasks:    
  - id: copy
    type: io.kestra.plugin.aws.s3.Copy
    accessKeyId: "<access-key>"
    secretKeyId: "<secret-key>"
    region: "eu-central-1"
    from:
      bucket: "my-bucket"
      key: "path/to/file"
    to:
      bucket: "my-bucket2"
      key: "path/to/file2"

errors:
  - id: alert
    type: io.kestra.plugin.core.log.Log
    message: list of error logs — {{ errorLogs() }}

Result:

develop EE

[loicmathieu]

@anna-geller for your two examples, Python wrote logs in WARNING that why they are not returned by the errorLogs() methods.

[anna-geller]

Python wrote logs in WARNING

yup, this is unfortunate since this is an actual error in the Python script (value error + zero division error)

[loicmathieu]

It's because we log the standard error as WARNING and not ERROR

[anna-geller]

can we change it? 🙏 we should (even if this would mean a BC)

[loicmathieu]

can we change it? 🙏 we should (even if this would mean a BC)

This needs to be investigated and validated by Ludo, better to open a new issue to discuss that.

[anna-geller]

ok, follow up issue kestra-io/plugin-scripts#190