Skip to content

Fix: main history fix#161

Merged
FlorianDeconinck merged 133 commits into
mainfrom
main_history_fix
Jun 2, 2025
Merged

Fix: main history fix#161
FlorianDeconinck merged 133 commits into
mainfrom
main_history_fix

Conversation

@fmalatino
Copy link
Copy Markdown
Contributor

Description
This PR fixes the issues created during haphazard attempt to fix merge conflicts for release 2025.05.00

Checklist:

  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • My changes generate no new warnings
  • Any dependent changes have been merged and published in downstream modules
  • New check tests, if applicable, are included

oelbert and others added 30 commits August 27, 2024 13:15
…_externals

[feature] Expose stencil vertical domain to Frozen Stencil
…reshold_override' into feature/multimodal_metric_threshold_override
…reshold_override' into feature/multimodal_metric_threshold_override
fmalatino and others added 25 commits February 7, 2025 14:58
… to halo size (#103)

* Adding in exception for compute domains with less than 4 points to vector_halo_update method

* Updated exception in communicator to compare halo size to compute domain size

* linting

* Moved domain size checker to SubtileGridSizer class method from_tile_params
…ble from an outside source (online model case) (#107)
* Log on rank 0
Docstrings & typi hints on logger
Stencil Config has a `verbose` option
On verbose: FrozenStencil log when run (in GT backends)

* Update `config` in orchestrate call to solve type hint inconcistencies

* Quantity helper `to_netcdf` with multi rank support
* Added feature to enable automatic detection of integer precision. Should remove the need for i32/i64 declaration (although their functionality is still retained) and replace both with the regular Int type

* change default rebuild state to false for get_factories

* Merged Float and Int precision detection functions into one common path

* Re-added old function to fulfil a PACE dependency

* updated docstring

* Added ability to declare 32 or 64 bit IntFields, overrulling the system precision

* Added one dimensional bool fields

* Fix error message in typing.py

Co-authored-by: Florian Deconinck <deconinck.florian@gmail.com>

* output type for global_set_precision

---------

Co-authored-by: Florian Deconinck <deconinck.florian@gmail.com>
Our current DaCe version is some commit from September 2024. Meanwhile DaCe matured to v1 and recently release v1.0.1. This brings the DaCe submodule to the latest stable release version.

Co-authored-by: Roman Cattaneo <1116746+romanc@users.noreply.github.com>
Linting should give fast feedback. The current workflow takes ~3mins where most of the time is spent installing (unnecessary) python packages. To run `pre-commit`, we only need the source files and `pre-commit` itself, which can be installed standalone. This brings runtime of the linting stage down to ~30 seconds.

Other changes

- update checkout action to v4
- update python setup action to v5
- change python version from 3.11.7 to 3.11 (any patch number will do)

This is a follow-up of PR NOAA-GFDL/pyFV3#40 in PyFV3.

Co-authored-by: Roman Cattaneo <1116746+romanc@users.noreply.github.com>
* Fix the type hint of Float, Int

* Attempt using TypeAlias
* Added doc files

* Adding image files to docs

* Linting

* Updated docs to reflect changes requested in PR 97

* Linting

---------

Co-authored-by: Florian Deconinck <deconinck.florian@gmail.com>
…ailure (#106)

* Save reports & netCDF for multiple ranks on failure
Fix multi modal threshold for parallel tests

* Order field by name in NetCDF

* Print all indices in logs. Sort by descernding ULP

* Allow sorting by metrics and index with `--sort_report` option

* Remove the `rank` froom SavepointCase. Access is done via `grid`

* Some docstrings
…ysics, including the Stefan-Boltzmann constant (#116)

* add namelist option

* add stephan boltzmann constant

* lint

* Apply suggestions from code review

Change comments to docstring style

Co-authored-by: Florian Deconinck <deconinck.florian@gmail.com>

---------

Co-authored-by: Florian Deconinck <deconinck.florian@gmail.com>
* add ttp

* Update ndsl/constants.py

Co-authored-by: Florian Deconinck <deconinck.florian@gmail.com>

* switch comments to docstrings for autodocs

* lint

---------

Co-authored-by: Florian Deconinck <deconinck.florian@gmail.com>
* Save all fields (pass and fail) and organize them by field

* Option `--no_report` to bypass logging & netcdf save
Move logs per variable into a `details` subfolder

* Order variable name in serialbox-to-netcdf

* `extra_data_load` function to load savepoint data saved outside the canonical savepoint

* Docs / Type Hint

* Fixed typo in error statment

---------

Co-authored-by: Charles Kropiewnicki <charles.j.krop@gmail.com>
* Removed hard-code of np.float32 from NetCDFMonitor transfer_type, replaced with Float type

* Added multiple options for NetCDF precision

* Added checking for use of 32 precision and float64 output

* Using NumPy type instead of string in NetCDFMonitor precision variable

* Added warning to netcdf_monitor.py for mismatch in precision settings

* Forgot f-string in warn message of netcdf_monitor
* Ignore `.next` caches

* CNST_OP20 is a true 64-bit

* Translate: Fix reading parameters with the right precision

* Multimodal metric: Skip reporting on expected values

* Bad commit
Co-authored-by: Roman Cattaneo <1116746+romanc@users.noreply.github.com>
Starting with numpy v1.25.0, `np.product()` is deprecated and
`np.prod()` should be used instead.

Co-authored-by: Roman Cattaneo <1116746+romanc@users.noreply.github.com>
…xposes control flow (#119)

* Update DaCe to v1.0.2

DaCe v1.0.2 brings two fixes for DaCe transformations: one for
DeadDataflowElimination and one for StateFusion.

* Bump gt4py to include refactored gt4py/dace bridge

* Test with modified pace pipeline

- added this to re-trigger the new pace pipeline after limiting zarr to
  not install v3 (for now) because of breaking API changes.
- added this note to re-trigger after fixing the pace pipeline to not
  pull requirements from `develop`.
- added this note to ret-trigger after fixing the repo name

* Revert "Test with modified pace pipeline"

This reverts commit cd6560e.

---------

Co-authored-by: Roman Cattaneo <1116746+romanc@users.noreply.github.com>
* Pass `dtype` down in allocator utils (gt4py_utils)

* Allow coriolis forces to be read in

* Edge factors are always 64-bit

* Quantity QOL

* Make sure to pass `dtype` to load the grid cleanly

* Translate grid: load coriolis forces, area 64 is 64-bit

* Bad merge

* Typo
**Description**
Port and adaptation of the initial commit of the documentation.

Fixes issue #113


**Checklist:**
- [X] I have performed a self-review of my own code
- [X] I have made corresponding changes to the documentation
- [X] My changes generate no new warnings
Co-authored-by: Florian Deconinck <deconinck.florian@gmail.com>
@fmalatino fmalatino changed the base branch from develop to main June 2, 2025 13:19
@FlorianDeconinck FlorianDeconinck merged commit b5c87d0 into main Jun 2, 2025
5 checks passed
@romanc romanc mentioned this pull request Jun 2, 2025
7 tasks
@romanc romanc deleted the main_history_fix branch June 2, 2025 19:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants