main-2024-05-20-162322-e5c795cc May 20, 2024

UPDATES

Issues addressed in this release:

• #2019 - [BUG] spec test for pod_memory_hog failing
• #2020 - Fix bug with Litmus Pod Mem Test #2019

Artifact info:

• Commit: main-2024-05-20-162322-e5c795cc
• SHA256SUM: 66ca6656f1b0da73282efd58af08c2cb5cbd60ec0f859349702d51781d894090 cnf-testsuite-main-2024-05-20-162322-e5c795cc.tar.gz

v1.2.0 May 09, 2024

Release Notes for v1.2.0 (Thursday, May 9, 2024)

Changes since v1.1.0 (April 17, 2024)

🙌 Kudos

We appreciate everyone who helped with Release v1.2.0! 🎉

Special thanks to contributors:

• @agentpoyo
• @collivier
• @denverwilliams
• @HashNuke
• @horecoli
• @kosstennbl
• @lixuna
• @martin-mat
• @ptacemic
• @svteb
• @Smitholi67
• @taylor
• @wavell

Please submit a PR to add your name to the MAINTAINERS.md.

✨ Enhancements

• #1949 - Remove all hardcoded EOL K8s version
• #1954 - Spec: removed backticks execution method and use new logging
• #1997, #2012 - Added option to run Cert command for only Essential Tests,
• #1962 - Enhancement: Add test name before and after the test in console output
• #1958 - Add test case identifiers for tests being executed to console output and more informative console output
• #1984 - Remove -ti in docker and kubectl calls
• #1988 - Check if cluster-tools are installed untill timeout
• #1953 - Set helm_install_namespace in all example cnf-testsuite.yml

🐛 Bug Fixes

• #2011 - Fix human readable task_runtime for time display on console
• #1495 - [BUG] Remove Log.info wrappers when running shell commands in spec tests
• #1948 - [BUG] Update all Kubernetes version in Gates (stop pinning v1.23 EOL)
• #1909 - [BUG] Spec tests are unable to find local Helm installation.
• #1978 - Minor change to fix immutable configmaps typo
• #1972 - Prevent microservice tests from passing on errors
• #1959 - Fixed false-postive (PASSED) result of specialized_init_system on nginx (sample-cnfs/sample-ndn-privileged)
• #1952 - [BUG] coredns should pass default_namespace
• #1973, #1987 - Fixed pod_memory_hog spec which was failing in github actions after PR merge to main
• #1977 - [BUG] pod_dns_error is always SKIPPED when "containerd" runtime is used
• #1974 - [BUG] pod_delete test outputs API text during cert run

🔧 Maintenance

• #1998 - #1948 Kind version upgrade
• #1965, #2006 - cni_compatible installs obsolete cluster (v1.21 and no cgroup v2 support). remove cni_compatible from cert tests
• #2004 - (#1993, #1999, #2003) Upgrade Kubescape to v3.0.8 and fix affected tests
• #1986, #1969 - Change location of increase_decrease_capacity task

📖 Documentation

N/A

---

Artifact info:

• Commit: v1.2.0
• SHA256SUM: fdf76c6b7c38fb15d5b0f8fbb9140475f732ea09a0858c9cbb3b5bf2ac91898e cnf-testsuite-v1.2.0.tar.gz

main-2024-05-09-164553-0893b2ac May 09, 2024

UPDATES

Issues addressed in this release:

Artifact info:

• Commit: main-2024-05-09-164553-0893b2ac
• SHA256SUM: 6ad3d0e159dfdcbaf2b8a27d78bf5872d1b94244e7e7ea1716ecdb4c4e55908f cnf-testsuite-main-2024-05-09-164553-0893b2ac.tar.gz

main-2024-05-09-162635-47958a02 May 09, 2024

UPDATES

Issues addressed in this release:

• #1949 - Remove all hardcoded EOL K8s version
• #1954 - spec: remove backticks and use new logging
• #1495 - [BUG] Remove Log.info wrappers when running shell commands in spec tests
• #1948 - [BUG] Update all Kubernetes version in Gates (stop pinning v1.23 EOL)

Artifact info:

• Commit: main-2024-05-09-162635-47958a02
• SHA256SUM: c8c4b8dc963f0e3d4af9ccb6910821853ebc18039763c79711462dd6b1b7a023 cnf-testsuite-main-2024-05-09-162635-47958a02.tar.gz

main-2024-05-07-103643-7b211009 May 07, 2024

UPDATES

Issues addressed in this release:

• #2011 - Fix human readable task_runtime
• #2014 - Update MAINTAINERS.md
• #2010 - [BUG] Fix issues introduced human readable task_runtime change

Artifact info:

• Commit: main-2024-05-07-103643-7b211009
• SHA256SUM: 876cfc382826291a070a270aed37bf1a5e4f877cbe360086ad20f4562d03d655 cnf-testsuite-main-2024-05-07-103643-7b211009.tar.gz

main-2024-05-02-134818-a05c159e May 02, 2024

UPDATES

Issues addressed in this release:

• #2012 - cert: rework certification tasks, add "essential" argument
• #1997 - Option to run Cert command for only Essential Tests

Artifact info:

• Commit: main-2024-05-02-134818-a05c159e
• SHA256SUM: ae873d35e5f88b01f08a8bd9aae7d8e5db18609aaae14a74be9d5686172b208b cnf-testsuite-main-2024-05-02-134818-a05c159e.tar.gz

main-2024-04-28-031521-538aa3eb April 28, 2024

UPDATES

Issues addressed in this release:

• #1962 - Enhancement: Add test name before and after the test in console output
• #1958 - [Feature] Add test case identifiers for tests being executed to console output and more informative console output

Artifact info:

• Commit: main-2024-04-28-031521-538aa3eb
• SHA256SUM: ac9518ff238fd9d0b9bda68df00cecbc33a02b72155b270f26f8a9a5c48822ff cnf-testsuite-main-2024-04-28-031521-538aa3eb.tar.gz

main-2024-04-27-193329-6b617a8c April 27, 2024

UPDATES

Issues addressed in this release:

• #2009 - Timer in results now human readable

Artifact info:

• Commit: main-2024-04-27-193329-6b617a8c
• SHA256SUM: 3314d48d19bb7ff3c39ae76aea81c9796fee1b86bc7cef8619fe629f0023a048 cnf-testsuite-main-2024-04-27-193329-6b617a8c.tar.gz

timer-main-merge-2024-04-27-035320-9b345b50 April 27, 2024

UPDATES

Issues addressed in this release:

Artifact info:

• Commit: timer-main-merge-2024-04-27-035320-9b345b50
• SHA256SUM: 5e0ed2b919dd93d90e504ad9e1b8d96ef9f00f15eb1d1ad5ac267803206c7271 cnf-testsuite-timer-main-merge-2024-04-27-035320-9b345b50.tar.gz

main-2024-04-25-185210-f812650e April 25, 2024

UPDATES

Issues addressed in this release:

• #2006 - remove cni_compatible from cert tests
• #1965 - [BUG] cni_compatible installs obsolete cluster (v1.21 and no cgroup v2 support). Part of cert ?

Artifact info:

• Commit: main-2024-04-25-185210-f812650e
• SHA256SUM: a97ed8d05f91d3967d894ed7095b19bf38e3cea045b6efb825afaa7b04bf89ec cnf-testsuite-main-2024-04-25-185210-f812650e.tar.gz