Skip to content

retowyss/cross-val-sim

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Cross Validation Simulator

This small collection of functions evaluates models with respect to their cross-validation RMSE. Any type of model fitting function may be evaluated.

Preview

Getting Started

Inspect and run main.m to see this in action.

Findings

No rigorous experiments were completed. However, we can make two observations. First, models with the true number of parameters almost always fit best. Second, there is cross over in RMSE between models. This means that what we use to assess the performance of a model is a function of the evaluation parameter k (the number of folds).

Compatibility

This was developed on GNU Octave (version 4.0.0) and no tests were run for Matlab.

About

Scratching the holy-grail of cross validation

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages