mantle/kola/harness.go: add snooze support for tests

[saqibali-2k]

Add snooze support for tests as described here.

[cgwalters]

Looks sane to me! Just one minor comment.

[dustymabe]

nice work! Is there any way possible we can add some extra logging (not debug) to the console when a test gets snoozed? Since the code now has differing behavior based on time (i.e. tests ran fine yesterday, and today they are failing, but nothing changed!) I think it's important that we mention very loudly when we don't run a test because of the policy/configuration we've set.

[saqibali-2k]

Is there any way possible we can add some extra logging (not debug) to the console when a test gets snoozed?

We can move the if obj.SnoozeDate != "" clause to the bottom of the loop, and add a print statement at the end of the clause. So it should look something like this:

		if len(obj.Arches) > 0 && !hasString(arch, obj.Arches) {
			continue
		}
		if len(stream) > 0 && len(obj.Streams) > 0 && !hasString(stream, obj.Streams) {
			continue
		}

		if obj.SnoozeDate != "" {
			snoozeDate, err := time.Parse(snoozeFormat, obj.SnoozeDate)
			if err != nil {
				return err
			} else if today.After(snoozeDate) {
				continue
			}
                        fmt.Printf("🕒  Snoozing test until %s \n", snoozeDate.Format("Jan 02 2006"))
		}

		fmt.Printf("⚠️  Skipping kola test pattern \"%s\":\n", obj.Pattern)
		fmt.Printf("  👉 %s\n", obj.Tracker)
		DenylistedTests = append(DenylistedTests, obj.Pattern)

And the output will look like:

🕒  Snoozing test until Jun 07 2022
⚠️  Skipping kola test pattern "fcos.internet":
  👉 https://github.com/coreos/coreos-assembler/pull/1478

[dustymabe]

🕒  Snoozing test until Jun 07 2022
⚠️  Skipping kola test pattern "fcos.internet":
  👉 https://github.com/coreos/coreos-assembler/pull/1478

Looks mostly good. Maybe just add the test name in there too just to
make it completely obvious:

🕒  Snoozing test pattern "fcos.internet" until Jun 07 2022
⚠️  Skipping kola test pattern "fcos.internet":
 👉 https://github.com/coreos/coreos-assembler/pull/1478

[jlebon]

Cool stuff! Some minor comments, but LGTM overall.

[dustymabe]

LGTM

[jlebon]

LGTM! Optional nits only, happy to defer.

[jlebon]

LGTM! Will let someone else have a final look and press the button.

[dustymabe]

LGTM - Nice work @saqibali-2k