Skip to content

[Bug]: Incorrect traceback for some tests run on Python 3.10. #23566

@AnandInguva

Description

@AnandInguva

What happened?

Beam failing test: https://ci-beam.apache.org/job/beam_PostCommit_Python310_PR/3/testReport/apache_beam.examples.dataframe.flight_delays_it_test/FlightDelaysTest/test_flight_delays/

Dill has reported a bug uqfoundation/dill#488.

From the issue:

Between 3.9 and 3.10, the number of arguments to build a CodeType didn't change, but co_lnotab was replaced with co_linetable.

In the test, Beam Panda's usage calls inspect.stack() which leads to the above mentioned bug.

Pandas has removed inspect.stack() due to some perf issues.

1.3.x: https://github.com/pandas-dev/pandas/blob/66e3805b8cabe977f40c05259cc3fcf7ead5687d/pandas/util/_exceptions.py#L32

1.4.x: https://github.com/pandas-dev/pandas/blob/1.4.x/pandas/util/_exceptions.py

pandas-dev/pandas#46881

This created a corrupted stack trace in python 3.10 test which don't happen in other python versions.

  • Dill has a solution merged on to the main branch and will be available in the next dill release.

Issue Priority

Priority: 2

Issue Component

Component: sdk-py-core

Metadata

Metadata

Assignees

No one assigned

    Labels

    P2bugcoredone & doneIssue has been reviewed after it was closed for verification, followups, etc.python

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions