adding test file for top-down harmonization #79
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR provides a notebook that is a first prototype for implementing top-down harmonization approaches.
It has a main operational function
distribute_level()
which tries to harmonize higher-dimensional trajectories (e.g., down to regions or sectors) consistent with lower-dimensional total (e.g., global total emissions).The process begins by first using standard harmonization to harmonize global totals, and then attempts to successively harmonize higher-dimensional data. It is not perfect now and needs to be explored/played with to try to sharpen.
It may be that the best approach is not optimization-based at all but rather rule based, we have to see.
Required data files to run this are attached
harm_test_hist.csv.gz
harm_test_model.csv.gz
CC @coroa @chrisroadmap @znicholls @jkikstra