[do not merge] Implement dynamic configuration and much more

[tatiana]

PoC that implements the feature requested in ticket #81, in addition to many other provider changes.

It contains an example DAG using dynamic configuration to trigger two other DAGs.

This ticket should not be reviewed or merged since we're creating many follow-up tickets that will be simpler to review.

Some of the follow-up PRs include:

• Fix the local development environment and update documentation #92
• Simplify the project structure and debugging #93
• Enable running all integration tests against Kind in the CI #95
• Add Airflow 2.10 (released in August 2024) to tests #96
• Improve Astro CLI DAGs tests so hatch test-cov doesn't fail #97
• Stop catching generic Exception in triggerer  #98
• Fix running make docker-run when there is a new version #99
• Stop catching generic Exception in operators #100
• Fix Makefile #101
• Remove pytest durations from tests #102
• Support using callable config in @ray.task #103

more are about to come.

[tatiana]

I still need to create individual PRs to address the following that was implemented in the current PR:

Hooks

1. Remove default GPU (also in decorator)

Operator

1. Fix namespace
2. Check on service status
3. Improvement on exception handling
4. (WIP - pending tests and configuration) node IP
5. (WIP - need to make this work and add tests) test_connection