[CI] Simplify CI by using `alldeps` image whenever possible #4219

Job	Run time
Linux (Self build + no-assertions) / Build + LIT	8m 19s
build-win / Build + LIT	44m 3s
macOS / Build	12m 9s
e2e-lin (Intel Arc A-Series Graphics with Level Zero, ["Linux", "arc"], --param matrix-xmx8=True,... / Intel Arc A-Series Graphics with Level Zero	12m 29s
e2e-lin (Intel GEN12 Graphics with Level Zero, ["Linux", "gen12"], level_zero:gpu;opencl:fpga, true) / Intel GEN12 Graphics with Level Zero	33m 20s
e2e-lin (AMD/HIP, ["Linux", "amdgpu"], -u 1001 --device=/dev/dri --device=/dev/kfd, hip:gpu, false) / AMD/HIP	11m 33s
e2e-lin (Perf tests on Intel Arc A-Series Graphics system, ["Linux", "arc"], {"LIT_FILTER":"Perfo... / Perf tests on Intel Arc A-Series Graphics system	2m 26s
e2e-lin (Perf tests on Intel GEN12 Graphics system, ["Linux", "gen12"], {"LIT_FILTER":"Performanc... / Perf tests on Intel GEN12 Graphics system	2m 55s
e2e-win / Intel GEN12 Graphics with Level Zero	1m 15s
	2h 8m 29s

Provide feedback