Skip to content

chore: performance tests for ESDK-python - #680

Merged
RitvikKapila merged 33 commits into
mpl-reviewedfrom
perf-tests
Jun 5, 2024
Merged

chore: performance tests for ESDK-python#680
RitvikKapila merged 33 commits into
mpl-reviewedfrom
perf-tests

Conversation

@RitvikKapila

Copy link
Copy Markdown
Contributor

Issue #, if available:

Description of changes:
Performance tests for ESDK-python for comparison between keyrings and master key providers based on execution time and memory used.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Check any applicable:

  • Were any files moved? Moving files changes their URL, which breaks all hyperlinks to the files.

@RitvikKapila
RitvikKapila requested a review from a team as a code owner May 17, 2024 19:31
Comment thread performance_tests/README.md Outdated
Comment thread performance_tests/consolidate_results.py Outdated
Comment thread performance_tests/requirements_mpl.txt Outdated
Comment thread performance_tests/src/pylintrc Outdated
Comment thread performance_tests/test/keyrings/pylintrc Outdated

@lucasmcdonald3 lucasmcdonald3 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's your plan for running this in CI?
I wonder if you can put this in GHA...

Comment thread performance_tests/README.md Outdated
Comment thread performance_tests/README.md Outdated
Comment thread performance_tests/README.md Outdated
Comment thread performance_tests/consolidate_results.py Outdated
Comment thread performance_tests/consolidate_results.py Outdated
Comment thread performance_tests/requirements_mpl.txt
Comment thread performance_tests/src/aws_encryption_sdk_performance_tests/utils/util.py Outdated
@RitvikKapila

Copy link
Copy Markdown
Contributor Author

What's your plan for running this in CI? I wonder if you can put this in GHA...

Currently for CI, I'm thinking of putting this in CodeBuild for consistency with other tests using MPL.

Comment thread .gitignore Outdated
Comment thread codebuild/py311/performance_tests_mpl.yml
Comment thread performance_tests/README.rst Outdated
Comment thread performance_tests/results/__init__.py Outdated
Comment thread performance_tests/src/aws_encryption_sdk_performance_tests/__init__.py Outdated
Comment thread performance_tests/README.rst Outdated
return click.testing.CliRunner()


def test_create(runner):

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[curious] how much work would it be to print out the summary statistics to the codebuild logs?

@RitvikKapila RitvikKapila Jun 4, 2024

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We would be calling the consolidate results script.
It would basically mean running the consolidate_results.py script from the test python files for each of the tests.

Comment thread performance_tests/README.rst
Comment thread performance_tests/README.rst Outdated
Comment thread performance_tests/README.rst Outdated
Comment thread performance_tests/README.rst
Comment thread performance_tests/README.rst Outdated
Comment thread performance_tests/README.rst
Comment thread performance_tests/consolidate_results.py
@RitvikKapila
RitvikKapila merged commit ebbc26b into mpl-reviewed Jun 5, 2024
@RitvikKapila
RitvikKapila deleted the perf-tests branch June 5, 2024 17:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants