Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

USC-SIkJalpha round1 - 24-25 #99

Merged
merged 7 commits into from
Aug 28, 2024
Merged

Conversation

maa989
Copy link
Contributor

@maa989 maa989 commented Aug 24, 2024

No description provided.

Copy link

Run validation on files: 2024-08-11-USC-SIkJalpha.parquet
❌ Error 101: At least one column name is misspelled or does not correspond to the expected column names. The column(s) do(es) not correspond to the standard

Copy link

If the submission contains projection file(s) with quantile projection, a pdf containing visualization plots of the submission is available and downloadable in the GitHub actions. Please click on 'details' on the right of the 'Validate submission' checks. The pdf is available in a ZIP file as an artifact of the GH Actions. For more information, please see here

Copy link

Run validation on files: 2024-08-11-USC-SIkJalpha.parquet
❌ Error 101: At least one column name is misspelled or does not correspond to the expected column names. The column(s) do(es) not correspond to the standard

Copy link

If the submission contains projection file(s) with quantile projection, a pdf containing visualization plots of the submission is available and downloadable in the GitHub actions. Please click on 'details' on the right of the 'Validate submission' checks. The pdf is available in a ZIP file as an artifact of the GH Actions. For more information, please see here

@LucieContamin
Copy link
Collaborator

Hi @maa989,

Thanks for your submission, just to provide more information, it seems that your projection files is missing the column run_grouping and, as a reminder, the output_type_id column should be set to NA for sample output type.

Please let me know if any issues or questions,

Best, Lucie

Copy link

Run validation on files: 2024-08-11-USC-SIkJalpha.parquet

Required values:

❌ Error 006: The submission is missing some required values, please check:
origin_date: 2024-08-11
scenario_id: c("A-2024-08-01", "C-2024-08-01", "E-2024-08-01", "B-2024-08-01", "D-2024-08-01", "F-2024-08-01")
target: c("inc death", "inc hosp")
horizon: 43
age_group: 0-130
location: US

Columns:

No errors or warnings found on the column names and numbers

Scenarios:

No errors or warnings found on scenario name and scenario id columns

Origin Date Column:

No errors or warnings found on the column 'origin_date'

Value and Type Columns:

🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. 355 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 11, inc hosp, 0-4;
group: 2024-08-11, A-2024-08-01, 78, inc hosp, 0-4;
group: 2024-08-11, B-2024-08-01, 78, inc hosp, 0-4;
etc.
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. 361 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 11, inc hosp, 0-4;
group: 2024-08-11, A-2024-08-01, 78, inc hosp, 0-4;
group: 2024-08-11, B-2024-08-01, 78, inc hosp, 0-4;
etc.
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, A-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, B-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, C-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, D-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, E-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, F-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, A-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, B-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, C-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, D-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, E-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, F-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. 709 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 11, inc hosp, 0-4;
group: 2024-08-11, A-2024-08-01, 78, inc hosp, 0-4;
group: 2024-08-11, B-2024-08-01, 78, inc hosp, 0-4;
etc.
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, A-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, B-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, C-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, D-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, E-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, F-2024-08-01, 78, peak size hosp, 0-130

Target Columns:

🟡 Warning 605: The projections should contain at least 43 weeks of projection. The data frame contains only: 42 week(s). The projection might not be included in the Ensembles.
❌ Error 607: At least one target week is missing in the time series. 8618400 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 53, inc hosp, 1, 0-4, sample, 1;
group: 2024-08-11, B-2024-08-01, 53, inc hosp, 1, 0-4, sample, 1;
group: 2024-08-11, C-2024-08-01, 53, inc hosp, 1, 0-4, sample, 1;
etc.
❌ Error 607: At least one target week is missing in the time series. 8769600 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 53, inc hosp, 1, 0-4, sample, 1;
group: 2024-08-11, B-2024-08-01, 53, inc hosp, 1, 0-4, sample, 1;
group: 2024-08-11, C-2024-08-01, 53, inc hosp, 1, 0-4, sample, 1;
etc.
❌ Error 607: At least one target week is missing in the time series. 69552 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, US, inc death, 1, 0-4, quantile, 0.01;
group: 2024-08-11, B-2024-08-01, US, inc death, 1, 0-4, quantile, 0.01;
group: 2024-08-11, C-2024-08-01, US, inc death, 1, 0-4, quantile, 0.01;
etc.
❌ Error 607: At least one target week is missing in the time series. 3964464 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 53, inc hosp, 1, 0-4, quantile, 0.01;
group: 2024-08-11, B-2024-08-01, 53, inc hosp, 1, 0-4, quantile, 0.01;
group: 2024-08-11, C-2024-08-01, 53, inc hosp, 1, 0-4, quantile, 0.01;
etc.

Locations:

No errors or warnings found on Location

Sample:

❌ Error 902: The minimal accepted grouping includes the column(s): horizon, age_group, scenario_id, the column(s): horizon seem to be missing (or is missing a sub-group), please verify.

Column Pairing information:

Run grouping pairing:
c("scenario_id (A-2024-08-01, B-2024-08-01, C-2024-08-01, D-2024-08-01, E-2024-08-01, F-2024-08-01)", "horizon (1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42)", "location (01, 02, 04, 05, 06, 08, 09, 10, 11, 12, 13, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 44, 45, 46, 47, 48, 49, 50, 51, 53, 54, 55, 56, 60, 66, 69, 72, 78)",
"age_group (0-130, 0-4, 18-49, 5-17, 50-64, 65-130)")
Stochastic run pairing:
No stochasticity
Number of Samples: 100

Column Pairing information:

Run grouping pairing:
c("scenario_id (A-2024-08-01, B-2024-08-01, C-2024-08-01, D-2024-08-01, E-2024-08-01, F-2024-08-01)", "target", "horizon (1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42)", "age_group (0-130, 0-4, 18-49, 5-17, 50-64, 65-130)")
Stochastic run pairing:
No stochasticity
Number of Samples: 100

Quantiles:

❌ Error 403: Quantiles values are not increasing with quantiles, please verify: 2024-08-11, A-2024-08-01, US, cum death, 11, 65-130
❌ Error 403: Quantiles values are not increasing with quantiles, 2226 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 31, cum hosp, 25, 65-130;
group: 2024-08-11, C-2024-08-01, 06, cum hosp, 2, 0-130;
group: 2024-08-11, C-2024-08-01, 06, cum hosp, 3, 0-130;
etc.

Age Group:

No errors or warnings found on Age_group

Copy link

If the submission contains projection file(s) with quantile projection, a pdf containing visualization plots of the submission is available and downloadable in the GitHub actions. Please click on 'details' on the right of the 'Validate submission' checks. The pdf is available in a ZIP file as an artifact of the GH Actions. For more information, please see here

Copy link

Run validation on files: 2024-08-11-USC-SIkJalpha.parquet

Required values:

❌ Error 006: The submission is missing some required values, please check:
origin_date: 2024-08-11
scenario_id: c("A-2024-08-01", "C-2024-08-01", "E-2024-08-01", "B-2024-08-01", "D-2024-08-01", "F-2024-08-01")
target: c("inc death", "inc hosp")
horizon: 43
age_group: 0-130
location: US

Columns:

No errors or warnings found on the column names and numbers

Scenarios:

No errors or warnings found on scenario name and scenario id columns

Origin Date Column:

No errors or warnings found on the column 'origin_date'

Value and Type Columns:

🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. 355 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 11, inc hosp, 0-4;
group: 2024-08-11, A-2024-08-01, 78, inc hosp, 0-4;
group: 2024-08-11, B-2024-08-01, 78, inc hosp, 0-4;
etc.
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. 361 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 11, inc hosp, 0-4;
group: 2024-08-11, A-2024-08-01, 78, inc hosp, 0-4;
group: 2024-08-11, B-2024-08-01, 78, inc hosp, 0-4;
etc.
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, A-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, B-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, C-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, D-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, E-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, F-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, A-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, B-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, C-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, D-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, E-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, F-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. 709 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 11, inc hosp, 0-4;
group: 2024-08-11, A-2024-08-01, 78, inc hosp, 0-4;
group: 2024-08-11, B-2024-08-01, 78, inc hosp, 0-4;
etc.
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, A-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, B-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, C-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, D-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, E-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, F-2024-08-01, 78, peak size hosp, 0-130

Target Columns:

🟡 Warning 605: The projections should contain at least 43 weeks of projection. The data frame contains only: 42 week(s). The projection might not be included in the Ensembles.
❌ Error 607: At least one target week is missing in the time series. 8618400 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 53, inc hosp, 1, 0-4, sample, 1;
group: 2024-08-11, B-2024-08-01, 53, inc hosp, 1, 0-4, sample, 1;
group: 2024-08-11, C-2024-08-01, 53, inc hosp, 1, 0-4, sample, 1;
etc.
❌ Error 607: At least one target week is missing in the time series. 8769600 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 53, inc hosp, 1, 0-4, sample, 1;
group: 2024-08-11, B-2024-08-01, 53, inc hosp, 1, 0-4, sample, 1;
group: 2024-08-11, C-2024-08-01, 53, inc hosp, 1, 0-4, sample, 1;
etc.
❌ Error 607: At least one target week is missing in the time series. 69552 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, US, inc death, 1, 0-4, quantile, 0.01;
group: 2024-08-11, B-2024-08-01, US, inc death, 1, 0-4, quantile, 0.01;
group: 2024-08-11, C-2024-08-01, US, inc death, 1, 0-4, quantile, 0.01;
etc.
❌ Error 607: At least one target week is missing in the time series. 3964464 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 53, inc hosp, 1, 0-4, quantile, 0.01;
group: 2024-08-11, B-2024-08-01, 53, inc hosp, 1, 0-4, quantile, 0.01;
group: 2024-08-11, C-2024-08-01, 53, inc hosp, 1, 0-4, quantile, 0.01;
etc.

Locations:

No errors or warnings found on Location

Sample:

❌ Error 902: The minimal accepted grouping includes the column(s): horizon, age_group, scenario_id, the column(s): horizon seem to be missing (or is missing a sub-group), please verify.

Column Pairing information:

Run grouping pairing:
c("scenario_id (A-2024-08-01, B-2024-08-01, C-2024-08-01, D-2024-08-01, E-2024-08-01, F-2024-08-01)", "horizon (1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42)", "location (01, 02, 04, 05, 06, 08, 09, 10, 11, 12, 13, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 44, 45, 46, 47, 48, 49, 50, 51, 53, 54, 55, 56, 60, 66, 69, 72, 78)",
"age_group (0-130, 0-4, 18-49, 5-17, 50-64, 65-130)")
Stochastic run pairing:
No stochasticity
Number of Samples: 100

Column Pairing information:

Run grouping pairing:
c("scenario_id (A-2024-08-01, B-2024-08-01, C-2024-08-01, D-2024-08-01, E-2024-08-01, F-2024-08-01)", "target", "horizon (1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42)", "age_group (0-130, 0-4, 18-49, 5-17, 50-64, 65-130)")
Stochastic run pairing:
No stochasticity
Number of Samples: 100

Quantiles:

❌ Error 403: Quantiles values are not increasing with quantiles, please verify: 2024-08-11, A-2024-08-01, US, cum death, 11, 65-130
❌ Error 403: Quantiles values are not increasing with quantiles, 2226 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 31, cum hosp, 25, 65-130;
group: 2024-08-11, C-2024-08-01, 06, cum hosp, 2, 0-130;
group: 2024-08-11, C-2024-08-01, 06, cum hosp, 3, 0-130;
etc.

Age Group:

No errors or warnings found on Age_group

Copy link

If the submission contains projection file(s) with quantile projection, a pdf containing visualization plots of the submission is available and downloadable in the GitHub actions. Please click on 'details' on the right of the 'Validate submission' checks. The pdf is available in a ZIP file as an artifact of the GH Actions. For more information, please see here

Copy link

Run validation on files: 2024-08-11-USC-SIkJalpha.parquet

Required values:

No missing required value found

Columns:

No errors or warnings found on the column names and numbers

Scenarios:

No errors or warnings found on scenario name and scenario id columns

Origin Date Column:

No errors or warnings found on the column 'origin_date'

Value and Type Columns:

🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. 355 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 11, inc hosp, 0-4;
group: 2024-08-11, A-2024-08-01, 78, inc hosp, 0-4;
group: 2024-08-11, B-2024-08-01, 78, inc hosp, 0-4;
etc.
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. 361 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 11, inc hosp, 0-4;
group: 2024-08-11, A-2024-08-01, 78, inc hosp, 0-4;
group: 2024-08-11, B-2024-08-01, 78, inc hosp, 0-4;
etc.
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, A-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, B-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, C-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, D-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, E-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, F-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, A-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, B-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, C-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, D-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, E-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, F-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. 709 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 11, inc hosp, 0-4;
group: 2024-08-11, A-2024-08-01, 78, inc hosp, 0-4;
group: 2024-08-11, B-2024-08-01, 78, inc hosp, 0-4;
etc.
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, A-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, B-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, C-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, D-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, E-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, F-2024-08-01, 78, peak size hosp, 0-130

Target Columns:

No errors or warnings found in target and associated columns

Locations:

No errors or warnings found on Location

Sample:

Column Pairing information:

Run grouping pairing:
c("scenario_id (A-2024-08-01, B-2024-08-01, C-2024-08-01, D-2024-08-01, E-2024-08-01, F-2024-08-01)", "horizon", "location (01, 02, 04, 05, 06, 08, 09, 10, 11, 12, 13, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 44, 45, 46, 47, 48, 49, 50, 51, 53, 54, 55, 56, 60, 66, 69, 72, 78)", "age_group (0-130, 0-4, 18-49, 5-17, 50-64, 65-130)")
Stochastic run pairing:
No stochasticity
Number of Samples: 100

Column Pairing information:

Run grouping pairing:
c("scenario_id (A-2024-08-01, B-2024-08-01, C-2024-08-01, D-2024-08-01, E-2024-08-01, F-2024-08-01)", "target", "horizon", "age_group (0-130, 0-4, 18-49, 5-17, 50-64, 65-130)")
Stochastic run pairing:
No stochasticity
Number of Samples: 100

Quantiles:

No errors or warnings found on quantiles values and format

Age Group:

No errors or warnings found on Age_group

Copy link

If the submission contains projection file(s) with quantile projection, a pdf containing visualization plots of the submission is available and downloadable in the GitHub actions. Please click on 'details' on the right of the 'Validate submission' checks. The pdf is available in a ZIP file as an artifact of the GH Actions. For more information, please see here

@LucieContamin
Copy link
Collaborator

Hi @maa989 ,

Thanks for the submission, I just wanted to verify that I understand the sample ID information correctly, so the submission contains 100 samples with:

  • Run_grouping: group by scenario, location, target, horizon, age group
  • Stochastic_run: all 1 (No stochasticity)

Is that correct?

Please let me know if any issues or questions,
Best, Lucie

@maa989
Copy link
Contributor Author

maa989 commented Aug 26, 2024

Hi @LucieContamin,
Yes that is correct. There is no stochasticity and the 100 samples are grouped by scenario, location, target, horizon, and age group.

Let me know if you have any other questions or concerns.

Best,
Majd

@LucieContamin
Copy link
Collaborator

Hi @maa989 ,

Thanks for the answer. I have another question if that's ok. It seems that the stochastic_run column contains 1 for all output type, will it be able to fix it so that it contains 1 for sample output type but NA for all the others output type, please?

Please let me know if any issues or questions,
Best, Lucie

@LucieContamin
Copy link
Collaborator

Hi @maa989 ,

Thanks for the update, just for information the NA in the output type id column is not read properly in R, you can set it up in the same way as how you set the NA in the stochastic_run and run_grouping columns for "quantile" value for example.

Please let me know if any issues or questions,
Best, Lucie

Copy link

Run validation on files: 2024-08-11-USC-SIkJalpha.parquet

Required values:

No missing required value found

Columns:

No errors or warnings found on the column names and numbers

Scenarios:

No errors or warnings found on scenario name and scenario id columns

Origin Date Column:

No errors or warnings found on the column 'origin_date'

Value and Type Columns:

🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. 355 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 11, inc hosp, 0-4;
group: 2024-08-11, A-2024-08-01, 78, inc hosp, 0-4;
group: 2024-08-11, B-2024-08-01, 78, inc hosp, 0-4;
etc.
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. 361 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 11, inc hosp, 0-4;
group: 2024-08-11, A-2024-08-01, 78, inc hosp, 0-4;
group: 2024-08-11, B-2024-08-01, 78, inc hosp, 0-4;
etc.
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, A-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, B-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, C-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, D-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, E-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, F-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, A-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, B-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, C-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, D-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, E-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, F-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. 709 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 11, inc hosp, 0-4;
group: 2024-08-11, A-2024-08-01, 78, inc hosp, 0-4;
group: 2024-08-11, B-2024-08-01, 78, inc hosp, 0-4;
etc.
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, A-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, B-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, C-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, D-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, E-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, F-2024-08-01, 78, peak size hosp, 0-130

Target Columns:

No errors or warnings found in target and associated columns

Locations:

No errors or warnings found on Location

Sample:

Column Pairing information:

Run grouping pairing:
c("scenario_id (A-2024-08-01, B-2024-08-01, C-2024-08-01, D-2024-08-01, E-2024-08-01, F-2024-08-01)", "horizon", "location (01, 02, 04, 05, 06, 08, 09, 10, 11, 12, 13, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 44, 45, 46, 47, 48, 49, 50, 51, 53, 54, 55, 56, 60, 66, 69, 72, 78)", "age_group (0-130, 0-4, 18-49, 5-17, 50-64, 65-130)")
Stochastic run pairing:
No stochasticity
Number of Samples: 100

Column Pairing information:

Run grouping pairing:
c("scenario_id (A-2024-08-01, B-2024-08-01, C-2024-08-01, D-2024-08-01, E-2024-08-01, F-2024-08-01)", "target", "horizon", "age_group (0-130, 0-4, 18-49, 5-17, 50-64, 65-130)")
Stochastic run pairing:
No stochasticity
Number of Samples: 100

Quantiles:

No errors or warnings found on quantiles values and format

Age Group:

No errors or warnings found on Age_group

Copy link

If the submission contains projection file(s) with quantile projection, a pdf containing visualization plots of the submission is available and downloadable in the GitHub actions. Please click on 'details' on the right of the 'Validate submission' checks. The pdf is available in a ZIP file as an artifact of the GH Actions. For more information, please see here

@maa989
Copy link
Contributor Author

maa989 commented Aug 27, 2024

Hi @LucieContamin,

I implemented a fix for the output type id column, but I couldn't set it up in the exact same way as I set the NA in the stochastic_run and run_grouping columns for "quantile" value. So please let me know if this fix still causes any issues or if you have any questions.

Best,
Majd

Copy link

Run validation on files: 2024-08-11-USC-SIkJalpha.parquet

Required values:

No missing required value found

Columns:

No errors or warnings found on the column names and numbers

Scenarios:

No errors or warnings found on scenario name and scenario id columns

Origin Date Column:

No errors or warnings found on the column 'origin_date'

Value and Type Columns:

🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. 355 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 11, inc hosp, 0-4;
group: 2024-08-11, A-2024-08-01, 78, inc hosp, 0-4;
group: 2024-08-11, B-2024-08-01, 78, inc hosp, 0-4;
etc.
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. 361 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 11, inc hosp, 0-4;
group: 2024-08-11, A-2024-08-01, 78, inc hosp, 0-4;
group: 2024-08-11, B-2024-08-01, 78, inc hosp, 0-4;
etc.
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, A-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, B-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, C-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, D-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, E-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, F-2024-08-01, US, inc death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, A-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, B-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, C-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, D-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, E-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, F-2024-08-01, US, cum death, 5-17
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. 709 unique groups have been identified with this issue. For example:
group: 2024-08-11, A-2024-08-01, 11, inc hosp, 0-4;
group: 2024-08-11, A-2024-08-01, 78, inc hosp, 0-4;
group: 2024-08-11, B-2024-08-01, 78, inc hosp, 0-4;
etc.
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, A-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, B-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, C-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, D-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, E-2024-08-01, 78, peak size hosp, 0-130
🟡 Warning 505: Some location/target/scenario groups have a unique value for the whole projection period. Please verify: 2024-08-11, F-2024-08-01, 78, peak size hosp, 0-130

Target Columns:

No errors or warnings found in target and associated columns

Locations:

No errors or warnings found on Location

Sample:

Column Pairing information:

Run grouping pairing:
c("scenario_id (A-2024-08-01, B-2024-08-01, C-2024-08-01, D-2024-08-01, E-2024-08-01, F-2024-08-01)", "horizon", "location (01, 02, 04, 05, 06, 08, 09, 10, 11, 12, 13, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 44, 45, 46, 47, 48, 49, 50, 51, 53, 54, 55, 56, 60, 66, 69, 72, 78)", "age_group (0-130, 0-4, 18-49, 5-17, 50-64, 65-130)")
Stochastic run pairing:
No stochasticity
Number of Samples: 100

Column Pairing information:

Run grouping pairing:
c("scenario_id (A-2024-08-01, B-2024-08-01, C-2024-08-01, D-2024-08-01, E-2024-08-01, F-2024-08-01)", "target", "horizon", "age_group (0-130, 0-4, 18-49, 5-17, 50-64, 65-130)")
Stochastic run pairing:
No stochasticity
Number of Samples: 100

Quantiles:

No errors or warnings found on quantiles values and format

Age Group:

No errors or warnings found on Age_group

Copy link

If the submission contains projection file(s) with quantile projection, a pdf containing visualization plots of the submission is available and downloadable in the GitHub actions. Please click on 'details' on the right of the 'Validate submission' checks. The pdf is available in a ZIP file as an artifact of the GH Actions. For more information, please see here

@LucieContamin
Copy link
Collaborator

Thank you for the update, it seems to be all good now.

Please let me know if any issues or questions,
Best, Lucie

@LucieContamin LucieContamin merged commit 1699831 into midas-network:main Aug 28, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants