BART: add linear response, increase number of trees fitted per step #5044
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This adds the option to use a linear fit to compute the values of the leaf_nodes. A new argument "response" control if the leaf_node are computed using the mean value (as previously), a linear fit or a mix. I have set "mix" by default. At in preliminary test it seems to provide a better general performance (close to just using linear). This also increase the number of trees fitted per step, increasing the computational cost, but improving diagnostics. This also includes other small fixes.