You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
**Disadvantage ~** really difficult changes, bad maintenance, not clear what is tested and how, ...
38
38
Can be discussed somewhere between 0.5 - 1.5 depending on maturity of specific technology.
39
39
:::
40
40
41
41
(level-1)=
42
42
:::{grid-item-card} Level 1 - Code Structure
43
43
:class-header: bg-light
44
-
**Implementation:** writing very well structured scripts
45
-
**Focus:** write maintainable test code, minimize copy-paste code
46
-
**Example ~** unit test frameworks, pytest
44
+
**Implementation:** writing very well structured scripts
45
+
**Focus:** write maintainable test code, minimize copy-paste code
46
+
**Example ~** unit test frameworks, pytest
47
47
**Disadvantage ~** long test-related analysis (what is tested, how), long failure analysis, often disconnection between what test declares to test and what is tested in reality, ...
48
48
:::
49
49
50
50
(level-2)=
51
51
:::{grid-item-card} Level 2 - Test Structure
52
52
:class-header: bg-light
53
-
**Implementation:** build script structures based on domain language (DL)
54
-
**Focus:** write maintainable and understandable test design
**Disadvantage ~** skills to define DL needed (not common in development at the time), problems to cover big test spaces (combinations, order of actions etc.), sometimes longer development of good tests (skills needed)
57
57
:::
58
58
59
59
(level-3)=
60
60
:::{grid-item-card} Level 3 - Test Execution/Development Optimization
61
61
:class-header: bg-light
62
-
**Implementation:** build script/model/pattern that generates test cases or test flows
63
-
**Focus:** better coverage in shorter time (development/execution)
64
-
**Example ~** Model-Based Testing, property testing, fuzz testing, test randomization, AI agents
62
+
**Implementation:** build script/model/pattern that generates test cases or test flows
63
+
**Focus:** better coverage in shorter time (development/execution)
64
+
**Example ~** Model-Based Testing, property testing, fuzz testing, test randomization, AI agents
65
65
**Disadvantage ~** skills to define models, patterns, randomization needed (not common in development at the time), many technologies don't combine well Level 2 with Level 3 approaches (at the time), bad connection between Level 2 and Level 3 leads to emerging again some issues from Level 1 - long test-related analysis, long failure analysis, disconnection between what test declares to test and what is actually tested
66
66
:::
67
67
68
68
(level-4)=
69
69
:::{grid-item-card} Level 4 - Test Generation
70
70
:class-header: bg-light
71
-
**Implementation:** build set of action/verification steps and/or test description (model, specification...)
72
-
**Focus:** automate majority of test design phase (creation and generation)
73
-
**Example ~** AI agents, specification-based generation, advanced MBT where model is specification also for development, maybe some data-driven testing
71
+
**Implementation:** build set of action/verification steps and/or test description (model, specification...)
72
+
**Focus:** automate majority of test design phase (creation and generation)
73
+
**Example ~** AI agents, specification-based generation, advanced MBT where model is specification also for development, maybe some data-driven testing
74
74
**Disadvantage ~** skills needed, no existing common frameworks (at the time), bad connection with previous levels will lead to emerging previous disadvantages
75
75
:::
76
76
77
77
(level-5)=
78
78
:::{grid-item-card} Level 5 - Future Level
79
79
:class-header: bg-light
80
-
**Implementation:** To be defined
81
-
**Focus:** To be defined
82
-
**Example ~** Emerging approaches and methodologies
80
+
**Implementation:** To be defined
81
+
**Focus:** To be defined
82
+
**Example ~** Emerging approaches and methodologies
0 commit comments