support for custom command line parameters (e.g. -U foo=bar)

[jjallaire-aisi]

Would be great if in addition to -T, -S and -M inspect allowed custom command line parameters, say -U for user/universal/unspecified, which could be retrieved manually.

Motivation: models and solvers are examples of components that can be shared by different evals and parametrised independently of the rest of the eval. But if I want to create a common component which doesn't conform to either model or solver API, then there is no way to make it parametrisable without updating every task to read and propagate component parameters.

[jjallaire-aisi]

Note, equivalent (but way less elegant!) way of doing this now is through CLI bound environment variables, e.g.

FOO=bar BAZ=qux inspect eval math.py

Then from code:

os.environ.get("FOO")