Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move libraries and applications from the tools directory to src #338

Draft
wants to merge 69 commits into
base: main
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
69 commits
Select commit Hold shift + click to select a range
c025371
Add additional ignore files in .gitignore
underwoo Dec 12, 2024
4ff2cf6
Add fregrid remap tests non-stretch grid
underwoo Dec 12, 2024
a9d793d
Remove old Test32
underwoo Dec 12, 2024
4f65369
Move test31 to fregrid/remap-file-stretchgrid
underwoo Dec 12, 2024
8caa345
Remove last part of Test31
underwoo Dec 12, 2024
4e87b85
remove old Test14
underwoo Dec 12, 2024
f86a4b9
Merge branch 'main' into remove.bats
underwoo Dec 12, 2024
d5dd299
fix t/Makefile.am trailing backslash
underwoo Dec 12, 2024
1d9dd31
Merge branch 'test.and.source.cleanup' into remove.bats
underwoo Dec 16, 2024
675d4ed
Add latlon regrid test
underwoo Dec 16, 2024
fc68e80
Add cubed-sphere fregrid test
underwoo Dec 21, 2024
0674e72
Update site-config env.sh for nco requirement
underwoo Dec 17, 2024
4ce45b7
Change several license names from FMS to FRE-NCtools
underwoo Dec 17, 2024
d9feef4
Update configure.ac to 2024.05
mlee03 Dec 19, 2024
ee79dfd
Turn on remap-stretchgrid as expensive
underwoo Dec 21, 2024
bc63e1c
Stop using non-standard asprint in test program
underwoo Dec 21, 2024
7ae6036
Correct error in test file generation codes
underwoo Dec 22, 2024
37455bb
Some vscode settings
underwoo Dec 23, 2024
efcbf13
remove Test05
underwoo Dec 23, 2024
dad6857
Migrated Test06 - fregrid extrap
underwoo Dec 25, 2024
6108ec0
Migrate test07
underwoo Dec 25, 2024
0eeb78a
remove Test09 script
underwoo Dec 25, 2024
c45b293
Merge branch 'main' into remove.bats
underwoo Dec 26, 2024
2fc0354
Migrated test for remap_land
underwoo Dec 26, 2024
f3df11a
Removed temporary python file
underwoo Dec 26, 2024
c4b6ff0
Remove old Test10
underwoo Dec 26, 2024
b7bd6b5
Remote Test10 from t/Makefile.am
underwoo Dec 26, 2024
1868985
migrate Test11 to new test framework
underwoo Dec 26, 2024
b99f70b
Remove Test11 from t directory
underwoo Dec 26, 2024
48c0da2
Add make_regional_mosaic man page
underwoo Dec 26, 2024
4be9c95
migrate Test12 to new testing framework
underwoo Dec 26, 2024
bb443aa
Remove Test12 script and data
underwoo Dec 26, 2024
892c242
Fixes to make_regional_mosaic and input-output-kinds tests
underwoo Dec 27, 2024
9d7fae8
Migrate Test13 to new testing framework
underwoo Dec 27, 2024
783f87e
Remove Test13 from t directory
underwoo Dec 27, 2024
74c2d01
Add mppncscatter man page
underwoo Dec 27, 2024
2b44e54
Add make_quick_mosaic man page
underwoo Dec 27, 2024
a1a8f25
Remove tests that are no longer required
underwoo Dec 27, 2024
22e9552
Correct random test failure with regional mosaic
underwoo Dec 30, 2024
9fc6165
Migrate river_regrid test to new test framework
underwoo Dec 30, 2024
babb81c
Remove un-needed steps in the make_quick_mosaic test
underwoo Dec 30, 2024
ec733ea
Remove river_regrid test and files
underwoo Dec 30, 2024
b015241
Add a realy hydrology test
underwoo Dec 30, 2024
e9aed1f
More updates to CONTRIBUTING.md
underwoo Dec 30, 2024
6740f4d
Fix remap-file-mpi test
underwoo Dec 30, 2024
078e5d5
Fix remap-file-mpi test
underwoo Dec 31, 2024
4ada935
Add more workflow tests
underwoo Dec 31, 2024
14d8c0f
Remove parallel build from expensive checks -- likely will overrun th…
underwoo Dec 31, 2024
f20c770
Begin migration of tools directory items
underwoo Jan 2, 2025
91c621d
Move libfrencutils to lib directory
underwoo Jan 2, 2025
c10cc9f
Move libfrencutils_gpu to lib directory
underwoo Jan 2, 2025
9cd9e3f
Fixes for libfrenctools_gpu
underwoo Jan 2, 2025
833056f
Adjust location of libfrencutils
underwoo Jan 2, 2025
309094b
Migrate check_mask to src directory
underwoo Jan 4, 2025
1929ed2
Fix rebuild of libnfu
underwoo Jan 4, 2025
af93cce
Move make_remap_file to src directory
underwoo Jan 4, 2025
f28f6ae
Move fregrid to src dir
underwoo Jan 4, 2025
841d422
Move fregrid_gpu to src directory
underwoo Jan 4, 2025
e078f7c
Move make_coupler_mosic to src
underwoo Jan 5, 2025
ba1dd28
Migrate make_hgrid to src
underwoo Jan 5, 2025
2c81d36
Migrate make_land_domain to src
underwoo Jan 16, 2025
b31225b
Migrate make_quick_mosaic to src
underwoo Jan 16, 2025
63ffe2a
Migrate make_regional_mosaic to src
underwoo Jan 16, 2025
0464842
Migrate make_solo_mosaic to src
underwoo Jan 16, 2025
ea883cb
Migrate make_topog to src
underwoo Jan 16, 2025
1412f34
Migrate make_vgrid to src/make-vgrid
underwoo Jan 16, 2025
1b1fb9d
Migrate mpp-ncscatter to src/mpp-ncscatter
underwoo Jan 16, 2025
e6ab5ad
Migrate remap_land to src/remap-land
underwoo Jan 16, 2025
956e9af
Migrate river_regrid to src directory
underwoo Jan 16, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
42 changes: 42 additions & 0 deletions .github/workflows/distcheck.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,42 @@
# Github actions CI file
# Ryan Mulhall 2020
# CI testing for the FRE-NCtools repo, builds and runs unit tests
# image dockerfile is maintained here:
# https://gitlab.gfdl.noaa.gov/fre/hpc-me
name: FRE-NCtools CI
on:
workflow_run:
workflows: ["FRE-NCtools Check Expensive"]
types:
- completed
jobs:
CI:
runs-on: ubuntu-latest
strategy:
matrix:
with_mpi: ['','--with-mpi']
enable_quad_precision: ['', '--enable-quad-precision']
container:
image: ghcr.io/noaa-gfdl/fre-nctools-ci-rocky-gnu:14.2.0_v2
env:
MPI: ${{ matrix.with_mpi }}
QUAD_P: ${{ matrix.enable_quad_precision }}
steps:
- name: Checkout
uses: actions/checkout@v4
with:
submodules: recursive
- name: Configure
run: |
mkdir build && cd build
autoreconf -i ../configure.ac
../configure $MPI $QUAD_P || cat config.log
- name: Build distribution with check
run: make DISTCHECK_CONFIGURE_FLAGS="$MPI $QUAD_P" -C build -j
- name: Save log file on failure
uses: actions/[email protected]
if: failure()
with:
name: test-suites
path: |
build/tests/test-suite.log
11 changes: 2 additions & 9 deletions .github/workflows/main.yml
Original file line number Diff line number Diff line change
Expand Up @@ -27,21 +27,14 @@ jobs:
mkdir build && cd build
autoreconf -i ../configure.ac
../configure $MPI $QUAD_P || cat config.log
- name: Build tools
- name: Build
run: make -C build -j
- name: Run all tests
if: matrix.with_mpi == ''
run: make -C build -j check SH_LOG_DRIVER_FLAGS=--comments
- name: Run most tests (skip the slow ones)
if: matrix.with_mpi == '--with-mpi'
env:
SKIP_TESTS: 4
run: make -C build -j check SH_LOG_DRIVER_FLAGS=--comments
run: make -C build -j check
- name: Save log file on failure
uses: actions/[email protected]
if: failure()
with:
name: test-suites
path: |
build/t/test-suite.log
build/tests/test-suite.log
44 changes: 44 additions & 0 deletions .github/workflows/main_expensive.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,44 @@
# Github actions CI file
# Ryan Mulhall 2020
# CI testing for the FRE-NCtools repo, builds and runs unit tests
# image dockerfile is maintained here:
# https://gitlab.gfdl.noaa.gov/fre/hpc-me
name: FRE-NCtools Check Expensive
on:
workflow_run:
workflows: ["FRE-NCtools CI"]
types:
- completed
jobs:
CI:
runs-on: ubuntu-latest
strategy:
matrix:
with_mpi: ['','--with-mpi']
enable_quad_precision: ['', '--enable-quad-precision']
container:
image: ghcr.io/noaa-gfdl/fre-nctools-ci-rocky-gnu:14.2.0_v2
env:
MPI: ${{ matrix.with_mpi }}
QUAD_P: ${{ matrix.enable_quad_precision }}
steps:
- name: Checkout
uses: actions/checkout@v4
with:
submodules: recursive
- name: Configure
run: |
mkdir build && cd build
autoreconf -i ../configure.ac
../configure $MPI $QUAD_P || cat config.log
- name: Build
run: make -C build -j
- name: Run most tests (skip the slow ones)
run: make -C build check-very-expensive
- name: Save log file on failure
uses: actions/[email protected]
if: failure()
with:
name: test-suites
path: |
build/tests/test-suite.log
60 changes: 49 additions & 11 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@
*.gz
build.fre-nctools*
build
_build
*.exe
*.1
.DS_Store
Expand All @@ -22,6 +23,7 @@ Makefile.in
# http://www.gnu.org/software/autoconf

.deps
.dirstamp
autom4te.cache
/autoscan.log
/autoscan-*.log
Expand Down Expand Up @@ -64,36 +66,62 @@ t/Test26/
*.nc

# Other build generated files
gt-*/
config.h
*.mod
postprocessing/land_utils/combine-ncc
postprocessing/land_utils/decompress-ncc
postprocessing/land_utils/is-compressed
postprocessing/land_utils/nfu_compress_mod.mod
postprocessing/land_utils/nfu_mod.mod
postprocessing/land_utils/scatter-ncc
postprocessing/mppnccombine/mppnccombine
postprocessing/plevel/moisture_convert_mod.mod
postprocessing/plevel/pinterp_utilities_mod.mod
postprocessing/plevel/plev_constants_mod.mod
postprocessing/plevel/pressure_interp_mod.mod
src/combine_restarts
src/combine-ncc
src/decompress-ncc
src/iceberg_comb.sh
src/is-compressed
src/list_ncvars
src/list_ncvars.csh
src/list_ncvars.sh
src/scatter-ncc
src/mppnccombine
src/plevel-interp
src/plevel.sh
src/print_version
src/split_ncvars.pl
src/timavg
src/timavg.csh
src/time_average
src/version.h
src/version.inc
tests/c_test_version
tests/create_5degree_topog
tests/create_daily_tile_files
tests/create_land_remap_files
tests/create_mask_topog
tests/create_ocean_mask_grid
tests/create_plevel_test_ncfile
tests/create_regional_file
tests/create_runoff_file
tests/create_temp_salt_file
tests/create_timeavg_test_ncfiles
tests/f_test_version
tools/check_mask/check_mask
tools/cubic_utils/make_remap_file
tools/fregrid/fregrid
tools/fregrid/fregrid_parallel
tools/make_coupler_mosaic/make_coupler_mosaic
tools/make_coupler_mosaic/make_coupler_mosaic_parallel
tools/make_hgrid/make_hgrid
tools/make_land_domain/make_land_domain
tools/make_quick_mosaic/make_quick_mosaic
tools/make_regional_mosaic/make_regional_mosaic
tools/make_solo_mosaic/make_solo_mosaic
tools/make_topog/make_topog
tools/make_topog/make_topog_parallel
tools/make_vgrid/make_vgrid
tools/mppncscatter/mppncscatter
tools/nc_null_check/nc_null_check
tools/ncexists/ncexists
tools/remap_land/remap_land
tools/remap_land/remap_land_parallel
tools/river_regrid/river_regrid
tools/runoff_regrid/runoff_regrid
tools/runoff_regrid/runoff_regrid_parallel
tools/simple_hydrog/lakes/cr_lake_files
tools/simple_hydrog/libfmslite/constants_mod.mod
tools/simple_hydrog/libfmslite/horiz_interp_bilinear_mod.mod
Expand All @@ -104,3 +132,13 @@ tools/simple_hydrog/postp/cp_river_vars
tools/simple_hydrog/rmvpr/rmv_parallel_rivers
tools/transfer_to_mosaic_grid/transfer_to_mosaic_grid

# Ignore generated files from vscode makefile extension
defines.awk
subs*.awk
conftest
conftest.*
confdefs.*
confinc.*
confmf.*
conf*/
conf*.file
6 changes: 0 additions & 6 deletions .vscode/c_cpp_properties.json
Original file line number Diff line number Diff line change
Expand Up @@ -7,9 +7,6 @@
"/opt/homebrew/include"
],
"defines": [],
"macFrameworkPath": [
"/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/System/Library/Frameworks"
],
"compilerPath": "/usr/bin/clang",
"cStandard": "c17",
"cppStandard": "c++17",
Expand All @@ -22,9 +19,6 @@
"${HOME}/opt/homebrew/include"
],
"defines": [],
"macFrameworkPath": [
"/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/System/Library/Frameworks"
],
"compilerPath": "/usr/bin/clang",
"cStandard": "c17",
"cppStandard": "c++17",
Expand Down
26 changes: 25 additions & 1 deletion .vscode/settings.json
Original file line number Diff line number Diff line change
Expand Up @@ -36,5 +36,29 @@
"/#include.*/",
]
}
]
],
"makefile.dryrunSwitches": [
"--always-make",
"--print-directory",
"--dry-run",
"--assume-old=Makefile",
"Makefile",
"all",
"AM_MAKEFLAGS=--assume-old=Makefile Makefile"
],
"fortran.linter.includePaths": [
"/opt/homebrew/include",
"${workspaceFolder}/**"
],
"fortran.fortls.preprocessor.directories": [
"/opt/homebrew/include",
"./lib"
],
"fortran.fortls.suffixes": [
"inc"
],
"fortran.fortls.directories": [
"./**",
"/opt/homebrew/include"
],
}
Loading
Loading