Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Principled Testing #20

Open
jafioti opened this issue Feb 6, 2024 · 2 comments
Open

Principled Testing #20

jafioti opened this issue Feb 6, 2024 · 2 comments
Labels
testing Related to correctness testing and performance benchmarking

Comments

@jafioti
Copy link
Owner

jafioti commented Feb 6, 2024

Currently tests are hand written and have bad coverage. We want to generate tests that can cover the entire codebase with many permutations. Should probably be done in a macro?
@jafioti jafioti added the testing Related to correctness testing and performance benchmarking label Mar 1, 2024
@jafioti
Copy link
Owner Author

jafioti commented Mar 2, 2024

This has been started with initial macros in luminal_metal/tests/mod.rs

@mohdsm81
Copy link

I am not sure if this will help, but usually Symbolic execution is used to generate these inputs that drive the application/program towards coverage of all execution paths, maybe worth looking at Kani. (I am interested in this one too, I will look at it when I have time and definitely post back here when I find something useful).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
testing Related to correctness testing and performance benchmarking
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@mohdsm81 @jafioti