Don't run integration tests on official builds

[davidwengier]

This has been discussed a few times, thought i'd have a crack at it.

@jaredpar PTAL

Fixes #8809

[davidwengier]

/azp run

[azure-pipelines]

Azure Pipelines successfully started running 2 pipeline(s).

[333fred]

What was the reasoning on this?

[davidwengier]

What was the reasoning on this?

If you search for an email in your mailbox called "Proposed Validation matrix" you hopefully can refresh your memory, but I believe this is "the Roslyn way"

[333fred]

Gotcha, thanks. Do we already have the daily integration test run leg that mentioned? I don't want to see this merged without that having been set up.

[davidwengier]

We have had https://devdiv.visualstudio.com/DevDiv/_build?definitionId=15591&_a=summary for a long time. Did the email mention anything about the daily run needing to be green? 🙈

[333fred]

I'd say lets get that off the floor before merging this.

[davidwengier]

@Cosifne fixed the integration tests 🎉🎉🎉 https://devdiv.visualstudio.com/DevDiv/_build/results?buildId=7792212&view=results 🎉🎉🎉

Will leave things for a week to make sure its stable, and then merge this.

[RikkiGibson]

Does this skip tests on rolling builds generally? (i.e. the build that kicks off on the public queue after merging a PR.) I thought we still want to run tests for those.

[davidwengier]

i.e. the build that kicks off on the public queue after merging a PR

If I'm understanding you correctly, no, that would be this pipeline: https://devdiv.visualstudio.com/DevDiv/_build?definitionId=15591&_a=summary
That runs integration tests against main every 6 hours, from a different yaml file. We'd also still run them in PRs.

[davidwengier]

We resolved in the weekly tooling sync that we would review the rolling test pipeline, so I'm going to merge this.

[RikkiGibson]

Thanks David!