Skip to content

Conversation

@pp-mo
Copy link
Member

@pp-mo pp-mo commented Feb 12, 2017

Get tests passing after moving to 'generic lazy data handling for cube data operations.

Changes added on top of #2356.
Also depends on #2362

What this includes...

  • allow the iris._lazy_data module to tolerate + understand (realise) Biggus as well as Dask arrays (temporarily)
  • add routines for converting masked-arrays to+from NaN-arrays
    • at present, 'array_as_lazy' not used by any standard code, so this should only affect existing data where it has NaNs
  • addressed test failures + errors with use of @skip_biggus

@pp-mo pp-mo force-pushed the dask_abstract_lazy_cubedata branch 3 times, most recently from 305411c to fd238b3 Compare February 13, 2017 15:18
@pp-mo pp-mo force-pushed the dask_abstract_lazy_cubedata branch from 5a45bf0 to 247551b Compare February 13, 2017 16:54
@marqh
Copy link
Member

marqh commented Feb 13, 2017

following long discussions in the team we are adopting this implementation in the short term. We will trial it with the pp and netCDF loaders and the merge & concatenate capabilities

further design and implementation decisions will be made following those activities

@marqh marqh merged commit 2324f03 into SciTools:dask Feb 13, 2017
@QuLogic QuLogic modified the milestone: dask Feb 13, 2017
@QuLogic QuLogic modified the milestones: dask, v2.0 Aug 2, 2017
@pp-mo pp-mo deleted the dask_abstract_lazy_cubedata branch March 18, 2022 15:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants