ci: parametrized framework tests

[gnufede]

CI: parametrize framework tests to run them separately with Profiling, IAST or Appsec enabled

Checklist

• Change(s) are motivated and described in the PR description
• Testing strategy is described if automated tests are not included in the PR
• Risks are described (performance impact, potential for breakage, maintainability)
• Change is maintainable (easy to change, telemetry, documentation)
• Library release note guidelines are followed or label changelog/no-changelog is set
• Documentation is included (in-code, generated user docs, public corp docs)
• Backport labels are set (if applicable)
• If this PR changes the public interface, I've notified @DataDog/apm-tees.

Reviewer Checklist

• Title is accurate
• All changes are related to the pull request's stated goal
• Description motivates each change
• Avoids breaking API changes
• Testing strategy adequately addresses listed risks
• Change is maintainable (easy to change, telemetry, documentation)
• Release note makes sense to a user of the library
• Author has acknowledged and discussed the performance implications of this PR as reported in the benchmarks PR comment
• Backport labels are set in a manner that is consistent with the release branch maintenance policy

[datadog-dd-trace-py-rkomorn]

Datadog Report

Branch report: gnufede/framework-tests-matrix
Commit report: 58b6916
Test service: dd-trace-py

❌ 1 Failed (0 Known Flaky), 120743 Passed, 53499 Skipped, 4h 43m 59.89s Total duration (2h 41m 14.7s time saved)

❌ Failed Tests (1)

• test_auto - test_auto.py - Details

  Expand for error

   Expected status 0, got 1.
   === Captured STDOUT ===
   === End of captured STDOUT ===
   === Captured STDERR ===
   Traceback (most recent call last):
     File "tests/internal/test_auto.py", line 15, in <module>
       assert "threading" not in sys.modules
   AssertionError
   === End of captured STDERR ===
  

[pr-commenter]

Benchmarks

Benchmark execution time: 2024-05-21 15:28:01

Comparing candidate commit 87aecd5 in PR branch gnufede/framework-tests-matrix with baseline commit d8c21b0 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 209 metrics, 9 unstable metrics.

[erikayasuda]

One non-blocker, otherwise LGTM