Switch to typescript project references and incremental builds

[rudolf]

Developing Typescript with VSCode is currently frustratingly slow:

• Opening files in another one of Kibana's 24 independant typescript projects sometimes takes > 60s "initializing TS language features"
• cmd+clicking references within some projects takes > 60s (in my experience test seems to be the slowest)
• Not all type errors show up under VSCode's "problems"
• Running a complete typecheck takes > 60s which slows down the development cycle when doing large type refactors

I believe using [typescript references](https://www.typescriptlang.org/docs/handbook/project-references.html and incremental builds we should be able to make the build time much faster, have type errors show up without having to run scripts/type_check and improve type lookups and navigation in VSCode.

The first iteration #72280

Steps

• src/test_utils to TS project Introduce TS incremental builds & move src/test_utils to TS project  #76082
• src/core to TS project Extract src/core in a separate TS project #76785
• src/plugins/kibana_utils to TS project Add TS projects for src/plugins & x-pack/plugins #78440
• x-pack/plugins/licensing to TS project Add TS projects for src/plugins & x-pack/plugins #78440
• document migration path for other plugins Document ts project references setup #78586
• create a tool to identify plugin deps Create tool to identify plugin import dependencies to support TS project references migration #79343
• plugins migrate to TS project refs. meta issue [Meta] Migrate Kibana plugins to TS project references #80508

[elasticmachine]

Pinging @elastic/kibana-operations

[spalger]

I've tried to do this a couple times but it wasn't very easy, though I agree it's worth putting real effort into.

[trusktr]

This is unrelated to Kibana (I was Googling for Project References information), but when I try running tsc --build --incremental --tsBuildInfoFile ./.buildinfo where --build enabled the new Project References features, it complains error TS5072: Unknown build option '--tsBuildInfoFile'.

I'm not sure, but I think that incremental builds are a default feature of Project References (--build) if I read that that doc page correctly.

EDIT: Ah, yep! This is what I see in watch mode with --build --watch:

[7:43:06 PM] File change detected. Starting incremental compilation...

Note the "incremental" part. So, yeah, it is incremental by default. Cool!

[rudolf]

I did a quick (and dirty) spike to get incremental builds working for Kibana: #46772

[mshustov]

@rudolf Could you measure the effect with TS built-in diagnostic tools https://github.com/microsoft/TypeScript/wiki/Performance#investigating-issues?

[rudolf]

@rudolf Could you measure the effect with TS built-in diagnostic tools

Good idea!

[elasticmachine]

Pinging @elastic/kibana-platform (Team:Platform)

[jinmu03]

Combined this issue with #72280