Refactoring of the TRAINING stage

[HealthyPear]

Context

See #91

Description

• the entry point for protopipe-TRAINING should simply change from pointing to protopipe.scripts.data_training.py to ctapipe-process
• a new example configuration file training.json should be added to protopipe/aux/ example_config_files, maybe also a pure DL1b one (for DL1a there will be already the example files for using TwoPassWindowSum)
• the code related to protopipe-MODEL should be updated to support input from ctapipe, namely it should load data from the output of the new protopipe-TRAINING with ctapipe.io.TableLoader
• all benchmarking notebooks related to the TRAINING stage should be updated to use ctapipe.io.TableLoader

These are the minimal changes to apply in order to not create breaking changes, any other improvement should be the focus of subsequent pull requests.

Caveats

It is not currently possible to refactor the whole pipeline, so the DL2 script won't be interested in these changes.
This means that its configuration will be still done using analysis.yaml.
This is not ideal as it could lead to some issues or bugs...

One idea would be to separate the estimation part of the code in order to use ctapipe-process also for DL2.

[kosack]

you could perhaps also consider generating a JSON config file for ctapipe-process from your YAML config, rather than supplying one. That would ensure they are synchronized.

[HealthyPear]

But they don't have the same nomenclature, how would you do this automatically (I am assuming this since you wrote "generating")?

[kosack]

You would have to write a function that translates one to the other. Not pretty, but it would work. write_ctapipe_config(protpipe_config_dict, filename)